00010000:00010000:1.0F:1713507933.215686:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1713507933.853140:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0F:1713507933.853189:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877321856 00000100:00100000:2.0:1713507933.853230:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16829 00000100:00100000:2.0:1713507933.853235:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137129c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+142:23697:x1796742877321856:12345-192.168.203.24@tcp:101:lsof.0 00010000:00010000:2.0:1713507933.853253:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507933.853267:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09d680/0x209a6de5bc985a79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b65f expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.853311:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09d8c0/0x209a6de5bc985a80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.853322:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09d8c0/0x209a6de5bc985a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.853330:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09d8c0/0x209a6de5bc985a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713507933.853388:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:2.0:1713507933.853391:0:13683:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:2.0:1713507933.853409:0:13683:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09d8c0/0x209a6de5bc985a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.853427:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09d680/0x209a6de5bc985a79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b65f expref: 144 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.853438:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09d8c0/0x209a6de5bc985a80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b65f expref: 143 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.853459:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:2.0:1713507933.853462:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713507933.853464:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09d8c0, rc 0) 00000100:00100000:2.0:1713507933.853515:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137129c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+143:23697:x1796742877321856:12345-192.168.203.24@tcp:101:lsof.0 Request processed in 278us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507933.853550:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16829 00000100:00100000:0.0:1713507933.855201:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507933.855243:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877321920 00000100:00100000:2.0:1713507933.855272:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16830 00000100:00100000:2.0:1713507933.855277:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+10:23697:x1796742877321920:12345-192.168.203.24@tcp:101:lsof.0 00010000:00010000:2.0:1713507933.855287:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507933.855294:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09db00/0x209a6de5bc985a87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b666 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.855320:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09dd40/0x209a6de5bc985a8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.855329:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09dd40/0x209a6de5bc985a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.855336:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09dd40/0x209a6de5bc985a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713507933.855367:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:2.0:1713507933.855369:0:13683:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:2.0:1713507933.855378:0:13683:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09dd40/0x209a6de5bc985a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.855393:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09db00/0x209a6de5bc985a87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b666 expref: 12 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.855403:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09dd40/0x209a6de5bc985a8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b666 expref: 11 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.855409:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:2.0:1713507933.855417:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713507933.855418:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09dd40, rc 0) 00000100:00100000:2.0:1713507933.855450:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+11:23697:x1796742877321920:12345-192.168.203.24@tcp:101:lsof.0 Request processed in 171us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507933.855455:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16830 00000100:00100000:2.0:1713507933.856690:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507933.856705:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877321984 00000100:00100000:2.0:1713507933.856719:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16831 00000100:00100000:2.0:1713507933.856721:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c11300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca88ec92-e358-41d9-8ccb-5b2a7c736474+6:23697:x1796742877321984:12345-192.168.203.24@tcp:101:lsof.0 00010000:00010000:2.0:1713507933.856729:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507933.856734:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09df80/0x209a6de5bc985a95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b66d expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.856752:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e1c0/0x209a6de5bc985a9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.856757:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e1c0/0x209a6de5bc985a9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.856761:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e1c0/0x209a6de5bc985a9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713507933.856782:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:2.0:1713507933.856783:0:13683:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:2.0:1713507933.856788:0:13683:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e1c0/0x209a6de5bc985a9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.856797:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09df80/0x209a6de5bc985a95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b66d expref: 8 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.856811:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e1c0/0x209a6de5bc985a9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b66d expref: 7 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507933.856815:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:2.0:1713507933.856817:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1713507933.856818:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09e1c0, rc 0) 00000100:00100000:2.0:1713507933.856846:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c11300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca88ec92-e358-41d9-8ccb-5b2a7c736474+7:23697:x1796742877321984:12345-192.168.203.24@tcp:101:lsof.0 Request processed in 123us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507933.856849:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16831 00000100:00100000:2.0:1713507933.943746:0:2868:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1713507933.943764:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881316288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1713507933.943815:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1713507933.943858:0:8539:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881316288 00000100:00100000:3.0:1713507933.943922:0:8539:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1713507933.943926:0:8539:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c11c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+36:2868:x1796742881316288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1713507933.943954:0:8539:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 133627904 pending 15335424 free 3850371072 avail 3848273920 00000100:00100000:3.0:1713507933.943993:0:8539:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c11c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+36:2868:x1796742881316288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507933.943998:0:8539:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1713507933.944025:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013712a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881316288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1713507933.970897:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507933.970991:0:8148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877322048 00002000:00100000:2.0:1713507933.971024:0:8148:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x9cd:0x0] (1503232->1735423) req@ffff88013712da40 x1796742877322048/t0(0) o4->3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8@192.168.203.24@tcp:709/0 lens 488/0 e 0 to 0 dl 1713507939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:2.0:1713507933.971031:0:8148:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88013712da40 with x1796742877322048 ext(1503232->1735423) 00002000:00010000:2.0:1713507933.971034:0:8148:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013712da40 00000100:00100000:2.0:1713507933.971057:0:8148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4059 00000100:00100000:2.0:1713507933.971061:0:8148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+11:1842:x1796742877322048:12345-192.168.203.24@tcp:4:cat.0 00000100:00100000:2.0:1713507933.973999:0:8148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+13:1842:x1796742877322048:12345-192.168.203.24@tcp:4:cat.0 Request processed in 2934us (3104us total) trans 17179874151 rc 0/0 00000100:00100000:2.0:1713507933.974007:0:8148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4059 00002000:00100000:2.0:1713507933.974014:0:8148:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x9cd:0x0] (1503232->1735423) req@ffff88013712da40 x1796742877322048/t17179874151(0) o4->3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8@192.168.203.24@tcp:709/0 lens 488/448 e 0 to 0 dl 1713507939 ref 1 fl Complete:/0/0 rc 0/0 job:'cat.0' 00002000:00100000:2.0:1713507933.974025:0:8148:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88013712da40 with x1796742877322048 ext(1503232->1735423) 00002000:00010000:2.0:1713507933.974028:0:8148:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013712da40 00000100:00100000:0.0:1713507933.975693:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881316352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1713507933.975727:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713507933.975812:0:8539:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881316352 00000100:00100000:2.0:1713507933.975831:0:8539:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1713507933.975834:0:8539:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+33:2868:x1796742881316352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1713507933.975844:0:8539:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 87359488 pending 17039360 free 3847225344 avail 3845128192 00000020:00020000:2.0:1713507933.975847:0:8539:0:(tgt_grant.c:257:tgt_grant_sanity_check()) ofd_statfs: tot_granted 83951616 != fo_tot_granted 87359488 00000020:00020000:2.0:1713507933.975849:0:8539:0:(tgt_grant.c:260:tgt_grant_sanity_check()) ofd_statfs: tot_pending 13631488 != fo_tot_pending 17039360 00000100:00100000:1.0:1713507933.975869:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507933.975871:0:8539:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+33:2868:x1796742881316352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507933.975874:0:8539:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1713507933.975893:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c12140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881316352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1713507933.975894:0:10855:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877322112 00000100:00100000:1.0:1713507933.975894:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507933.975916:0:10855:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877322176 00000100:00100000:1.0:1713507933.975920:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507933.975922:0:15079:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 1060 00000100:00100000:0.0:1713507933.975927:0:15079:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d224740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e5d772fc-dba6-4403-8dc4-1b435c13cf43+16:1839:x1796742877322112:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 00000100:00100000:2.0:1713507933.975932:0:10855:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877322240 00000100:00100000:3.0:1713507933.975936:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 1061 00010000:00010000:0.0:1713507933.975937:0:15079:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713507933.975942:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d224c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5d772fc-dba6-4403-8dc4-1b435c13cf43+17:1842:x1796742877322176:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1713507933.975943:0:9528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 1062 00000100:00100000:1.0:1713507933.975948:0:9528:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1f45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5d772fc-dba6-4403-8dc4-1b435c13cf43+17:1839:x1796742877322240:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1713507933.975950:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1713507933.975951:0:15079:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880131cdcd80/0x209a6de5bc984f58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158af12 expref: 17 pid: 12983 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507933.975957:0:9528:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507933.975958:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880131cdf840/0x209a6de5bc984f5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158af3c expref: 17 pid: 12983 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507933.975965:0:9528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880131cddf80/0x209a6de5bc984f66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158af43 expref: 15 pid: 12983 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507933.975967:0:15079:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713507933.975970:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713507933.975978:0:9528:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1713507933.975987:0:15079:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d224740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e5d772fc-dba6-4403-8dc4-1b435c13cf43+14:1839:x1796742877322112:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507933.975997:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d224c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5d772fc-dba6-4403-8dc4-1b435c13cf43+14:1842:x1796742877322176:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 Request processed in 45us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507933.976001:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 1061 00000100:00100000:1.0:1713507933.976003:0:9528:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1f45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5d772fc-dba6-4403-8dc4-1b435c13cf43+14:1839:x1796742877322240:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 Request processed in 55us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1713507933.976004:0:15079:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 1060 00000100:00100000:1.0:1713507933.976010:0:9528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 1062 00000100:00100000:0.0:1713507933.976293:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507933.976327:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877322432 00000100:00100000:2.0:1713507933.976342:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12083 00000100:00100000:2.0:1713507933.976345:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+13:23705:x1796742877322432:12345-192.168.203.24@tcp:9:umount.0 00000020:00020000:2.0:1713507933.976353:0:14149:0:(tgt_grant.c:257:tgt_grant_sanity_check()) ofd_obd_disconnect: tot_granted 83951616 != fo_tot_granted 87359488 00000020:00020000:2.0:1713507933.976354:0:14149:0:(tgt_grant.c:260:tgt_grant_sanity_check()) ofd_obd_disconnect: tot_pending 13631488 != fo_tot_pending 17039360 00000020:00000080:2.0:1713507933.976358:0:14149:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x209a6de5bc984f7b 00000020:00010000:2.0:1713507933.976361:0:14149:0:(genops.c:1857:obd_stale_export_put()) Put export ffff88008fa37000: total 1 00000100:00080000:2.0:1713507933.976363:0:14149:0:(import.c:86:import_set_state_nolock()) ffff88008fa35800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000020:00010000:0.0:1713507933.976377:0:6516:0:(genops.c:1843:obd_stale_export_get()) Get export ffff88008fa37000: total 1 00000001:00000004:2.0:1713507933.976382:0:14149:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874151 00010000:00010000:0.0:1713507933.976404:0:6516:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff88008fa37000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1713507933.976435:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d040d80/0x209a6de5bc985a10 lrc: 0/0,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5fd expref: 12 pid: 19515 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713507933.976450:0:6516:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb size from disk: 1236608 -> 1735424 00002000:00010000:0.0:1713507933.976452:0:6516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb mtime from disk: 1713507931 -> 1713507933 00002000:00010000:0.0:1713507933.976454:0:6516:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb ctime from disk: 1713507931 -> 1713507933 00010000:00010000:0.0:1713507933.976463:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131cdd8c0/0x209a6de5bc985a48 lrc: 0/0,0 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1503232->1736703) gid 0 flags: 0x44801000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b627 expref: 10 pid: 14149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507933.976478:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+10:23705:x1796742877322432:12345-192.168.203.24@tcp:9:umount.0 Request processed in 131us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507933.976482:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12083 00010000:00010000:0.0:1713507933.976485:0:6516:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export ffff88008fa37000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1713507933.976496:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507933.976498:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507933.976499:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507933.978614:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507933.978628:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877322624 00000100:00100000:2.0:1713507933.978646:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12084 00000100:00100000:2.0:1713507933.978648:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+17:23705:x1796742877322624:12345-192.168.203.24@tcp:9:umount.0 00000020:00000080:2.0:1713507933.978664:0:14149:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x209a6de5bc984f74 00000020:00010000:2.0:1713507933.978666:0:14149:0:(genops.c:1857:obd_stale_export_put()) Put export ffff88009172d800: total 2 00000100:00080000:2.0:1713507933.978668:0:14149:0:(import.c:86:import_set_state_nolock()) ffff880091729800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000001:00000004:2.0:1713507933.978683:0:14149:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841380 00000020:00010000:1.0:1713507933.978733:0:13607:0:(genops.c:1843:obd_stale_export_get()) Get export ffff88009172d800: total 2 00010000:00010000:1.0:1713507933.978756:0:13607:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff88009172d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1713507933.978778:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a09d200/0x209a6de5bc985a56 lrc: 0/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b63c expref: 15 pid: 6954 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713507933.978780:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+15:23705:x1796742877322624:12345-192.168.203.24@tcp:9:umount.0 Request processed in 130us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507933.978785:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12084 00010000:00010000:1.0:1713507933.978791:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929261c0/0x209a6de5bc985a4f lrc: 0/0,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b635 expref: 13 pid: 15078 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507933.978798:0:13607:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export ffff88009172d800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1713507933.978804:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507933.978804:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507933.978805:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507933.982209:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507933.982277:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877322816 00000100:00100000:2.0:1713507933.982306:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16832 00000100:00100000:2.0:1713507933.982309:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+11:23705:x1796742877322816:12345-192.168.203.24@tcp:39:umount.0 00000020:00000080:2.0:1713507933.982326:0:13683:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x209a6de5bc984f6d 00000020:00010000:2.0:1713507933.982333:0:13683:0:(genops.c:1857:obd_stale_export_put()) Put export ffff8800a1d42800: total 3 00000100:00080000:2.0:1713507933.982335:0:13683:0:(import.c:86:import_set_state_nolock()) ffff8800a1d44800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000020:00010000:0.0:1713507933.982359:0:8156:0:(genops.c:1843:obd_stale_export_get()) Get export ffff8800a1d42800: total 3 00000001:00000004:2.0:1713507933.982360:0:13683:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589952733 00010000:00010000:0.0:1713507933.982374:0:8156:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff8800a1d42800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1713507933.982386:0:8156:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:0.0:1713507933.982388:0:8156:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1713507933.982392:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde880/0x209a6de5bc985a1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b604 expref: 10 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507933.982402:0:8156:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:0.0:1713507933.982404:0:8156:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1713507933.982405:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09dd40/0x209a6de5bc985a8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b666 expref: 9 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507933.982422:0:8156:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:0.0:1713507933.982423:0:8156:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1713507933.982425:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985a25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b60b expref: 8 pid: 13044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507933.982434:0:8156:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:0.0:1713507933.982436:0:8156:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1713507933.982437:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d041440/0x209a6de5bc985031 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158afeb expref: 7 pid: 13043 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507933.982457:0:8156:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export ffff8800a1d42800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1713507933.982467:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507933.982469:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507933.982470:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713507933.982493:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8+4:23705:x1796742877322816:12345-192.168.203.24@tcp:39:umount.0 Request processed in 183us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507933.982497:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16832 00000100:00100000:0.0:1713507934.146292:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.146337:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.146362:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.146391:0:9528:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877322944 00000100:00100000:0.0:1713507934.146399:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.146421:0:15079:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877322880 00000100:00100000:3.0:1713507934.146433:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877323008 00000100:00100000:0.0:1713507934.146435:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877323520 00000100:00100000:1.0:1713507934.146448:0:9528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 1063 00000100:00100000:2.0:1713507934.146454:0:15079:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 1064 00000100:00100000:0.0:1713507934.146454:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12085 00000100:00100000:1.0:1713507934.146456:0:9528:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a19300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5d772fc-dba6-4403-8dc4-1b435c13cf43+14:1840:x1796742877322944:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1713507934.146458:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca88ec92-e358-41d9-8ccb-5b2a7c736474+33:23725:x1796742877323520:12345-192.168.203.24@tcp:9:umount.0 00000100:00100000:2.0:1713507934.146459:0:15079:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e5d772fc-dba6-4403-8dc4-1b435c13cf43+14:1839:x1796742877322880:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 00000100:00100000:3.0:1713507934.146470:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 1065 00010000:00010000:2.0:1713507934.146472:0:15079:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713507934.146472:0:9528:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713507934.146474:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5d772fc-dba6-4403-8dc4-1b435c13cf43+14:1839:x1796742877323008:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 00000020:00020000:0.0:1713507934.146478:0:14149:0:(tgt_grant.c:257:tgt_grant_sanity_check()) ofd_obd_disconnect: tot_granted 75431936 != fo_tot_granted 78839808 00000020:00020000:0.0:1713507934.146480:0:14149:0:(tgt_grant.c:260:tgt_grant_sanity_check()) ofd_obd_disconnect: tot_pending 13631488 != fo_tot_pending 17039360 00010000:00010000:3.0:1713507934.146481:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1713507934.146485:0:14149:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x209a6de5bc984fa5 00010000:00010000:3.0:1713507934.146490:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880131cdc900/0x209a6de5bc984f90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158af9e expref: 14 pid: 12983 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.146490:0:15079:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880131cdf180/0x209a6de5bc984f82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158af6d expref: 14 pid: 12983 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.146490:0:9528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880131cdc6c0/0x209a6de5bc984f89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158af97 expref: 14 pid: 12983 timeout: 0 lvb_type: 0 00000020:00010000:0.0:1713507934.146490:0:14149:0:(genops.c:1857:obd_stale_export_put()) Put export ffff88008fa35000: total 4 00000100:00080000:0.0:1713507934.146493:0:14149:0:(import.c:86:import_set_state_nolock()) ffff88008fa30000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:3.0:1713507934.146510:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713507934.146512:0:9528:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:0.0:1713507934.146514:0:14149:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874151 00010000:00010000:2.0:1713507934.146515:0:15079:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713507934.146576:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5d772fc-dba6-4403-8dc4-1b435c13cf43+11:1839:x1796742877323008:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 Request processed in 101us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.146581:0:15079:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e5d772fc-dba6-4403-8dc4-1b435c13cf43+11:1839:x1796742877322880:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 Request processed in 120us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.146581:0:9528:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a19300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5d772fc-dba6-4403-8dc4-1b435c13cf43+11:1840:x1796742877322944:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 Request processed in 124us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.146582:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 1065 00000100:00100000:2.0:1713507934.146592:0:15079:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 1064 00000100:00100000:1.0:1713507934.146596:0:9528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 1063 00000020:00010000:1.0:1713507934.146613:0:6517:0:(genops.c:1843:obd_stale_export_get()) Get export ffff88008fa35000: total 4 00010000:00010000:1.0:1713507934.146616:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.146651:0:6517:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff88008fa35000, canceled 0 locks, left on hash table 7. 00000100:00100000:0.0:1713507934.146665:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca88ec92-e358-41d9-8ccb-5b2a7c736474+31:23725:x1796742877323520:12345-192.168.203.24@tcp:9:umount.0 Request processed in 205us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1713507934.146671:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12085 00010000:00010000:1.0:1713507934.146692:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008daf2d00/0x209a6de5bc9852c3 lrc: 0/0,0 mode: --/PW res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b118 expref: 30 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.146713:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008daf2880/0x209a6de5bc9852a7 lrc: 0/0,0 mode: --/PW res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b0fc expref: 29 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.146725:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008daf0fc0/0x209a6de5bc98532c lrc: 0/0,0 mode: --/PW res: [0x9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b149 expref: 28 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.146738:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985348 lrc: 0/0,0 mode: --/PW res: [0x9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b165 expref: 27 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.146752:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092926ac0/0x209a6de5bc985341 lrc: 0/0,0 mode: --/PW res: [0x9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b15e expref: 26 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.146765:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092926d00/0x209a6de5bc9852ae lrc: 0/0,0 mode: --/PW res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b103 expref: 25 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.146787:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc9852ca lrc: 0/0,0 mode: --/PW res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b11f expref: 24 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.146796:0:6517:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export ffff88008fa35000, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1713507934.146807:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.146808:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.146809:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.148636:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.148690:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877323968 00000100:00100000:2.0:1713507934.148730:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12086 00000100:00100000:2.0:1713507934.148737:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca88ec92-e358-41d9-8ccb-5b2a7c736474+32:23725:x1796742877323968:12345-192.168.203.24@tcp:9:umount.0 00000020:00000080:2.0:1713507934.148755:0:14149:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x209a6de5bc984f9e 00000020:00010000:2.0:1713507934.148758:0:14149:0:(genops.c:1857:obd_stale_export_put()) Put export ffff88009172d000: total 5 00000100:00080000:2.0:1713507934.148761:0:14149:0:(import.c:86:import_set_state_nolock()) ffff880091728800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000001:00000004:2.0:1713507934.148793:0:14149:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841380 00000020:00010000:0.0:1713507934.148796:0:6516:0:(genops.c:1843:obd_stale_export_get()) Get export ffff88009172d000: total 5 00010000:00010000:0.0:1713507934.148816:0:6516:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff88009172d000, canceled 0 locks, left on hash table 6. 00010000:00010000:0.0:1713507934.148842:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092926400/0x209a6de5bc985333 lrc: 0/0,0 mode: --/PW res: [0x9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b150 expref: 31 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.148891:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092925440/0x209a6de5bc98534f lrc: 0/0,0 mode: --/PW res: [0x9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->33554431) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b16c expref: 31 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.148905:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092925f80/0x209a6de5bc9852bc lrc: 0/0,0 mode: --/PW res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b111 expref: 28 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.148917:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008daf1440/0x209a6de5bc9852b5 lrc: 0/0,0 mode: --/PW res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b10a expref: 27 pid: 14149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.148924:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca88ec92-e358-41d9-8ccb-5b2a7c736474+26:23725:x1796742877323968:12345-192.168.203.24@tcp:9:umount.0 Request processed in 186us (288us total) trans 0 rc 0/0 00010000:00010000:0.0:1713507934.148930:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008daf21c0/0x209a6de5bc9852d1 lrc: 0/0,0 mode: --/PW res: [0x9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b126 expref: 26 pid: 14149 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.148932:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12086 00010000:00010000:0.0:1713507934.148944:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092927a80/0x209a6de5bc98533a lrc: 0/0,0 mode: --/PW res: [0x9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b157 expref: 24 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.148952:0:6516:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export ffff88009172d000, canceled 6 locks, left on hash table 0. 00010000:00010000:0.0:1713507934.148962:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.148963:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.148964:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.151755:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.151847:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324096 00000100:00100000:2.0:1713507934.151890:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16833 00000100:00100000:2.0:1713507934.151896:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca88ec92-e358-41d9-8ccb-5b2a7c736474+7:23725:x1796742877324096:12345-192.168.203.24@tcp:39:umount.0 00000020:00000080:2.0:1713507934.151919:0:13683:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x209a6de5bc984f97 00000020:00010000:2.0:1713507934.151924:0:13683:0:(genops.c:1857:obd_stale_export_put()) Put export ffff88009c763000: total 6 00000100:00080000:2.0:1713507934.151927:0:13683:0:(import.c:86:import_set_state_nolock()) ffff88009c764800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000001:00000004:2.0:1713507934.151970:0:13683:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589952733 00000020:00010000:1.0:1713507934.152014:0:13607:0:(genops.c:1843:obd_stale_export_get()) Get export ffff88009c763000: total 6 00010000:00010000:1.0:1713507934.152040:0:13607:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff88009c763000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1713507934.152056:0:13607:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:1.0:1713507934.152058:0:13607:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1713507934.152063:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008daf0d80/0x209a6de5bc984fb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158afc8 expref: 7 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.152077:0:13607:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:1.0:1713507934.152078:0:13607:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1713507934.152080:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e1c0/0x209a6de5bc985a9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b66d expref: 4 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.152087:0:13607:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export ffff88009c763000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1713507934.152094:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.152095:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.152096:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713507934.152117:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca88ec92-e358-41d9-8ccb-5b2a7c736474+2:23725:x1796742877324096:12345-192.168.203.24@tcp:39:umount.0 Request processed in 219us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.152125:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16833 00000100:00100000:0.0:1713507934.167972:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.168023:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324160 00000100:00100000:2.0:1713507934.168064:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16834 00000100:00100000:2.0:1713507934.168068:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a197c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+143:23727:x1796742877324160:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.168079:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.168090:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09d680/0x209a6de5bc985aa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b674 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168127:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168136:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168142:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168149:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168173:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168178:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168263:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168268:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168272:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1713507934.168299:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x4bc:0x0]: returning size 16777217 00000004:00200000:2.0:1713507934.168302:0:13683:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1713507934.168311:0:13683:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168317:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168321:0:13683:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168324:0:13683:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168328:0:13683:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168332:0:13683:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09e400 already unused, calling callback (ffffffffa134d360) 00010000:00010000:2.0:1713507934.168334:0:13683:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168338:0:13683:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168344:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:2.0:1713507934.168346:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713507934.168348:0:13683:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168351:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e400/0x209a6de5bc985aaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168372:0:13683:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168376:0:13683:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168379:0:13683:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168382:0:13683:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09e640 already unused, calling callback (ffffffffa134d360) 00010000:00010000:2.0:1713507934.168383:0:13683:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168386:0:13683:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168390:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc10ab304 (ffff880091bc3d00) 00010000:00010000:2.0:1713507934.168391:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713507934.168392:0:13683:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168395:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e640/0x209a6de5bc985ab1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168411:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09d680/0x209a6de5bc985aa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b674 expref: 145 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168418:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b674 expref: 144 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.168429:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:2.0:1713507934.168430:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1713507934.168431:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09e880, rc 0) 00000100:00100000:2.0:1713507934.168456:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a197c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+144:23727:x1796742877324160:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 387us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.168461:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16834 00000100:00100000:0.0:1713507934.174918:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.175006:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324224 00000100:00100000:2.0:1713507934.175037:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12087 00000100:00100000:2.0:1713507934.175041:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a184c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+24:1840:x1796742877324224:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.175050:0:14149:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.175061:0:14149:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 2/0,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b67b expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1713507934.175078:0:14149:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9cd:0x0] initial LVB size: 1735424, mtime: 0x66220e5d, atime: 0x66220e5a, ctime: 0x66220e5d, blocks: 0x87 00010000:00010000:2.0:1713507934.175090:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.175092:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.175099:0:14149:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b67b expref: 25 pid: 14149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.175107:0:14149:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b67b expref: 25 pid: 14149 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.175112:0:14149:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09eac0, rc 0) 00000100:00100000:2.0:1713507934.175139:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a184c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:1840:x1796742877324224:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.175163:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12087 00000100:00100000:0.0:1713507934.176195:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.176280:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324352 00000100:00100000:2.0:1713507934.176305:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16835 00000100:00100000:2.0:1713507934.176308:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+144:23727:x1796742877324352:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.176316:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.176321:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ed00/0x209a6de5bc985ac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b682 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.176357:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.176364:0:13683:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b674 expref: 145 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.176367:0:13683:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.176386:0:13683:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b674 expref: 145 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.176393:0:13683:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b674 expref: 145 pid: 13683 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.176411:0:13683:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c12600 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:13683:1796742881316416:192.168.203.24@tcp:104: 00000100:00100000:2.0:1713507934.176445:0:13683:0:(client.c:2492:ptlrpc_set_wait()) set ffff880130463000 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.177190:0:13683:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c12600 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:13683:1796742881316416:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.177203:0:13683:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.177482:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.177554:0:6514:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324416 00010000:00010000:2.0:1713507934.177569:0:6514:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b674 expref: 146 pid: 13683 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.177589:0:6514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7859 00000100:00100000:2.0:1713507934.177592:0:6514:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+146:1839:x1796742877324416:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1713507934.177597:0:6514:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713507934.177600:0:6514:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b674 expref: 146 pid: 13683 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.177605:0:6514:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b674 expref: 146 pid: 13683 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.177613:0:6514:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09e880/0x209a6de5bc985ab8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b674 expref: 146 pid: 13683 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.177633:0:6514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:2.0:1713507934.177635:0:6514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.177639:0:6514:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.177643:0:6514:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.177654:0:6514:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713507934.177674:0:13683:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.177675:0:6514:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+145:1839:x1796742877324416:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 Request processed in 82us (194us total) trans 0 rc 0/0 00010000:00010000:3.0:1713507934.177679:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.177679:0:6514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7859 00000004:00200000:3.0:1713507934.177698:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x4bc:0x0]: returning size 16777217 00010000:00010000:3.0:1713507934.177774:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ed00/0x209a6de5bc985ac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b682 expref: 146 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.177790:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b682 expref: 145 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.177795:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:3.0:1713507934.177796:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1713507934.177797:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09ef40, rc 0) 00000100:00100000:3.0:1713507934.177815:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+145:23727:x1796742877324352:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 1506us (1622us total) trans 8589952734 rc 0/0 00000100:00100000:3.0:1713507934.177819:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16835 00000100:00100000:0.0:1713507934.178829:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.178895:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324480 00000100:00100000:3.0:1713507934.178920:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16836 00000100:00100000:3.0:1713507934.178923:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+145:23727:x1796742877324480:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.178931:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.178936:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc900/0x209a6de5bc985adb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b689 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.178955:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.178969:0:13683:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b682 expref: 146 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.178973:0:13683:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.178985:0:13683:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b682 expref: 146 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.178990:0:13683:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b682 expref: 146 pid: 13683 timeout: 537 lvb_type: 0 00000100:00100000:3.0:1713507934.178995:0:13683:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880090498e40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:13683:1796742881316480:192.168.203.24@tcp:104: 00000100:00100000:3.0:1713507934.179021:0:13683:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5f00 going to sleep for 6 seconds 00000100:00100000:3.0:1713507934.179859:0:13683:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880090498e40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:13683:1796742881316480:192.168.203.24@tcp:104: 00010000:00010000:3.0:1713507934.179873:0:13683:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.179974:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.180010:0:6514:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324544 00010000:00010000:2.0:1713507934.180021:0:6514:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b682 expref: 147 pid: 13683 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.180038:0:6514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7860 00000100:00100000:2.0:1713507934.180041:0:6514:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+147:1839:x1796742877324544:12345-192.168.203.24@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1713507934.180045:0:6514:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713507934.180047:0:6514:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b682 expref: 147 pid: 13683 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.180052:0:6514:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b682 expref: 147 pid: 13683 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.180059:0:6514:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985acd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4bc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b682 expref: 147 pid: 13683 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.180065:0:6514:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:2.0:1713507934.180067:0:6514:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.180071:0:6514:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.180074:0:6514:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.180089:0:6514:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713507934.180094:0:13683:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.180098:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713507934.180111:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x4bc:0x0]: returning size 16777217 00000100:00100000:2.0:1713507934.180111:0:6514:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+146:1839:x1796742877324544:12345-192.168.203.24@tcp:103:ldlm_bl_01.0 Request processed in 69us (140us total) trans 0 rc 0/0 00000004:00200000:3.0:1713507934.180112:0:13683:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1713507934.180115:0:6514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7860 00000004:00010000:3.0:1713507934.180118:0:13683:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.180126:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.180137:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc900/0x209a6de5bc985adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b689 expref: 146 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.180143:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b689 expref: 145 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.180147:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:3.0:1713507934.180148:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713507934.180149:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cdd680, rc 0) 00000100:00100000:3.0:1713507934.180180:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+145:23727:x1796742877324480:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 1256us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.180184:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16836 00000100:00100000:0.0:1713507934.181245:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.181315:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324672 00000100:00100000:3.0:1713507934.181338:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16837 00000100:00100000:3.0:1713507934.181341:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+145:23727:x1796742877324672:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.181348:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.181352:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde880/0x209a6de5bc985ae9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b690 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.181380:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd8c0/0x209a6de5bc985af0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.181386:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd8c0/0x209a6de5bc985af0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.181398:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd8c0/0x209a6de5bc985af0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713507934.181404:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x4bc:0x0]: returning size 16777217 00010000:00010000:3.0:1713507934.181441:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde880/0x209a6de5bc985ae9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b690 expref: 148 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.181448:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd8c0/0x209a6de5bc985af0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b690 expref: 147 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.181452:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:3.0:1713507934.181453:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1713507934.181454:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cdd8c0, rc 0) 00000100:00100000:3.0:1713507934.181479:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+147:23727:x1796742877324672:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 137us (236us total) trans 8589952735 rc 0/0 00000100:00100000:3.0:1713507934.181483:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16837 00000100:00100000:0.0:1713507934.182294:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.182314:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.182327:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324736 00000100:00100000:0.0:1713507934.182330:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.182345:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324800 00000100:00100000:0.0:1713507934.182348:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.182349:0:8143:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324928 00000100:00100000:2.0:1713507934.182357:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325056 00000100:00100000:0.0:1713507934.182362:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.182365:0:8143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12088 00000100:00100000:3.0:1713507934.182368:0:8143:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:1840:x1796742877324736:12345-192.168.203.24@tcp:1:lfs.0 00000100:00100000:2.0:1713507934.182368:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324864 00000100:00100000:1.0:1713507934.182378:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12089 00000100:00100000:1.0:1713507934.182383:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1840:x1796742877324800:12345-192.168.203.24@tcp:1:lfs.0 00000100:00100000:2.0:1713507934.182384:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12090 00010000:00010000:3.0:1713507934.182385:0:8143:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 3/0,1 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.182385:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.182388:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a18e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:1840:x1796742877324928:12345-192.168.203.24@tcp:1:lfs.0 00010000:00010000:3.0:1713507934.182392:0:8143:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d042400/0x209a6de5bc9859bc lrc: 2/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5be expref: 18 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.182396:0:8143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713507934.182399:0:15031:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 3/0,1 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.182401:0:8143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713507934.182401:0:14149:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 3/0,1 mode: --/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.182401:0:8540:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877324992 00010000:00010000:3.0:1713507934.182402:0:8143:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 4/0,1 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.182410:0:14149:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d043840/0x209a6de5bc9859ca lrc: 2/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5d3 expref: 19 pid: 19515 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713507934.182413:0:8143:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d042400/0x209a6de5bc9859bc lrc: 3/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5be expref: 19 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.182413:0:15031:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d041f80/0x209a6de5bc9859c3 lrc: 2/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->389119) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5c5 expref: 27 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.182414:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713507934.182414:0:8540:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12091 00010000:00010000:2.0:1713507934.182415:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.182416:0:14149:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 4/0,1 mode: --/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.182417:0:15031:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713507934.182418:0:15031:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713507934.182419:0:8143:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d042400/0x209a6de5bc9859bc lrc: 4/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5be expref: 19 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:1.0:1713507934.182419:0:15031:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 4/0,1 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.182419:0:8540:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a18980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1840:x1796742877325056:12345-192.168.203.24@tcp:1:lfs.0 00000100:00100000:3.0:1713507934.182425:0:8143:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880090498e40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8143:1796742881316544:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.182427:0:14149:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d043840/0x209a6de5bc9859ca lrc: 3/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5d3 expref: 19 pid: 19515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.182431:0:15031:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d041f80/0x209a6de5bc9859c3 lrc: 3/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->389119) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5c5 expref: 27 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.182432:0:14149:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d043840/0x209a6de5bc9859ca lrc: 4/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5d3 expref: 19 pid: 19515 timeout: 537 lvb_type: 1 00010000:00010000:0.0:1713507934.182435:0:8540:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 3/0,1 mode: --/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.182436:0:15031:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d041f80/0x209a6de5bc9859c3 lrc: 4/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->389119) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5c5 expref: 27 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:1.0:1713507934.182441:0:15031:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d224c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:15031:1796742881316672:192.168.203.24@tcp:104: 00000100:00100000:3.0:1713507934.182443:0:8143:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5f00 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.182446:0:14149:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c12600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14149:1796742881316608:192.168.203.24@tcp:104: 00010000:00010000:0.0:1713507934.182446:0:8540:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc98595a lrc: 2/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b58d expref: 27 pid: 6953 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.182452:0:8540:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713507934.182453:0:15146:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12092 00010000:00010000:0.0:1713507934.182453:0:8540:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.182454:0:8540:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 4/0,1 mode: --/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.182456:0:15146:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1840:x1796742877324864:12345-192.168.203.24@tcp:1:lfs.0 00000100:00100000:1.0:1713507934.182460:0:15031:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a92de540 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.182464:0:14149:0:(client.c:2492:ptlrpc_set_wait()) set ffff880130463000 going to sleep for 6 seconds 00010000:00010000:3.0:1713507934.182466:0:15146:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 3/0,1 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.182470:0:8540:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc98595a lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b58d expref: 27 pid: 6953 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.182471:0:15146:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 2/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b67b expref: 27 pid: 14149 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713507934.182472:0:8142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12093 00010000:00010000:3.0:1713507934.182475:0:15146:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.182475:0:15146:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713507934.182475:0:8142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1840:x1796742877324992:12345-192.168.203.24@tcp:1:lfs.0 00010000:00010000:3.0:1713507934.182476:0:15146:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 4/0,1 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.182478:0:8540:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc98595a lrc: 4/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b58d expref: 27 pid: 6953 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.182485:0:15146:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b67b expref: 27 pid: 14149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.182485:0:8142:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 3/0,1 mode: --/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.182486:0:8540:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880093159c80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8540:1796742881316736:192.168.203.24@tcp:104: 00010000:00010000:1.0:1713507934.182491:0:8142:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d043600/0x209a6de5bc985a09 lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5f6 expref: 19 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.182495:0:8142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.182496:0:8142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.182497:0:15146:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 4/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b67b expref: 27 pid: 14149 timeout: 537 lvb_type: 1 00010000:00010000:1.0:1713507934.182500:0:8142:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 4/0,1 mode: --/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.182502:0:15146:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009049ed40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:15146:1796742881316800:192.168.203.24@tcp:104: 00010000:00010000:1.0:1713507934.182510:0:8142:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d043600/0x209a6de5bc985a09 lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5f6 expref: 19 pid: 19515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.182510:0:8540:0:(client.c:2492:ptlrpc_set_wait()) set ffff880131a61600 going to sleep for 6 seconds 00000100:00100000:3.0:1713507934.182514:0:15146:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5e40 going to sleep for 6 seconds 00010000:00010000:1.0:1713507934.182515:0:8142:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d043600/0x209a6de5bc985a09 lrc: 4/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5f6 expref: 19 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:1.0:1713507934.182543:0:8142:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d224740 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8142:1796742881316864:192.168.203.24@tcp:104: 00000100:00100000:1.0:1713507934.182557:0:8142:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a92de3c0 going to sleep for 6 seconds 00000100:00100000:3.0:1713507934.183349:0:8143:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880090498e40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8143:1796742881316544:192.168.203.24@tcp:104: 00010000:00010000:3.0:1713507934.183360:0:8143:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 3/0,1 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.183545:0:15031:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d224c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:15031:1796742881316672:192.168.203.24@tcp:104: 00010000:00010000:1.0:1713507934.183562:0:15031:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 3/0,1 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.183593:0:14149:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c12600 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14149:1796742881316608:192.168.203.24@tcp:104: 00000100:00100000:1.0:1713507934.183600:0:8540:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880093159c80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8540:1796742881316736:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.183605:0:14149:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 3/0,1 mode: --/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.183610:0:8540:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 3/0,1 mode: --/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.183629:0:8142:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d224740 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8142:1796742881316864:192.168.203.24@tcp:104: 00000100:00100000:0.0:1713507934.183631:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00010000:00010000:1.0:1713507934.183637:0:8142:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 3/0,1 mode: --/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.183647:0:15146:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009049ed40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:15146:1796742881316800:192.168.203.24@tcp:104: 00000100:00100000:2.0:1713507934.183648:0:6514:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325184 00000100:00100000:0.0:1713507934.183653:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00010000:00010000:3.0:1713507934.183656:0:15146:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 3/0,1 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.183660:0:6514:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc98595a lrc: 4/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b58d expref: 28 pid: 6953 timeout: 537 lvb_type: 0 00000100:00100000:0.0:1713507934.183667:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.183669:0:10855:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325120 00010000:00010000:3.0:1713507934.183679:0:10855:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d042400/0x209a6de5bc9859bc lrc: 4/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5be expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.183679:0:6514:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325312 00010000:00010000:2.0:1713507934.183684:0:6514:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d043840/0x209a6de5bc9859ca lrc: 4/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5d3 expref: 21 pid: 19515 timeout: 537 lvb_type: 1 00000100:00100000:0.0:1713507934.183689:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.183692:0:10855:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325248 00000100:00100000:2.0:1713507934.183694:0:6514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7861 00010000:00010000:3.0:1713507934.183698:0:10855:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d041f80/0x209a6de5bc9859c3 lrc: 4/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->389119) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5c5 expref: 29 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.183698:0:6514:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1840:x1796742877325184:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1713507934.183701:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00010000:00010000:2.0:1713507934.183703:0:6514:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713507934.183705:0:10855:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325440 00010000:00010000:3.0:1713507934.183709:0:10855:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d043600/0x209a6de5bc985a09 lrc: 4/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5f6 expref: 22 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.183711:0:6514:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc98595a lrc: 4/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b58d expref: 29 pid: 6953 timeout: 537 lvb_type: 0 00000100:00100000:1.0:1713507934.183711:0:9528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7862 00000100:00100000:1.0:1713507934.183731:0:9528:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1f41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+22:1839:x1796742877325120:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1713507934.183733:0:6514:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc98595a lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b58d expref: 29 pid: 6953 timeout: 537 lvb_type: 0 00000100:00100000:0.0:1713507934.183735:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.183740:0:10855:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325376 00010000:00010000:2.0:1713507934.183742:0:6514:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc98595a lrc: 0/0,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b58d expref: 30 pid: 6953 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.183745:0:10855:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 4/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b67b expref: 30 pid: 14149 timeout: 537 lvb_type: 1 00010000:00010000:1.0:1713507934.183746:0:9528:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713507934.183751:0:10855:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7863 00000100:00100000:3.0:1713507934.183754:0:10855:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+22:1840:x1796742877325312:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1713507934.183758:0:9528:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d042400/0x209a6de5bc9859bc lrc: 4/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5be expref: 22 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.183759:0:10855:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713507934.183759:0:6514:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.183761:0:6514:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.183762:0:6514:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 3/0,1 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.183764:0:9528:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d042400/0x209a6de5bc9859bc lrc: 3/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5be expref: 22 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.183765:0:10855:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d043840/0x209a6de5bc9859ca lrc: 4/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5d3 expref: 22 pid: 19515 timeout: 537 lvb_type: 1 00010000:00010000:2.0:1713507934.183768:0:6514:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 4/0,1 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.183770:0:10855:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d043840/0x209a6de5bc9859ca lrc: 3/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5d3 expref: 22 pid: 19515 timeout: 537 lvb_type: 1 00010000:00010000:1.0:1713507934.183774:0:9528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d042400/0x209a6de5bc9859bc lrc: 0/0,0 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5be expref: 22 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.183779:0:10855:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d043840/0x209a6de5bc9859ca lrc: 0/0,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5d3 expref: 21 pid: 19515 timeout: 537 lvb_type: 1 00010000:00010000:2.0:1713507934.183782:0:6514:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713507934.183783:0:9528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.183784:0:9528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.183785:0:9528:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 3/0,1 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.183787:0:10855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.183789:0:10855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.183790:0:10855:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 3/0,1 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.183790:0:9528:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 4/0,1 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.183790:0:8540:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 3/0,1 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.183796:0:10855:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 4/0,1 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.183797:0:8540:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 3/0,1 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.183798:0:9528:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713507934.183804:0:6514:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1840:x1796742877325184:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 Request processed in 104us (174us total) trans 0 rc 0/0 00010000:00010000:3.0:1713507934.183809:0:10855:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713507934.183810:0:6514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7861 00000100:00100000:1.0:1713507934.183812:0:9528:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1f41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1839:x1796742877325120:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 Request processed in 81us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1713507934.183812:0:8540:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 3/0,1 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.183816:0:9528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7862 00010000:00010000:0.0:1713507934.183817:0:8540:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 2/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.183824:0:6514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7864 00000100:00100000:3.0:1713507934.183826:0:10855:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1840:x1796742877325312:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.183827:0:6514:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1839:x1796742877325248:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1713507934.183827:0:8540:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713507934.183833:0:6514:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1713507934.183838:0:10855:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7863 00000100:00100000:1.0:1713507934.183841:0:9528:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7865 00010000:00010000:2.0:1713507934.183842:0:6514:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d041f80/0x209a6de5bc9859c3 lrc: 4/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->389119) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5c5 expref: 28 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:1.0:1713507934.183843:0:9528:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1840:x1796742877325440:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1713507934.183847:0:9528:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1713507934.183848:0:8540:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a18980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1840:x1796742877325056:12345-192.168.203.24@tcp:1:lfs.0 Request processed in 1429us (1500us total) trans 0 rc 0/0 00010000:00010000:2.0:1713507934.183849:0:6514:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d041f80/0x209a6de5bc9859c3 lrc: 3/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->389119) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5c5 expref: 28 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:3.0:1713507934.183851:0:10855:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7866 00010000:00010000:1.0:1713507934.183854:0:9528:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d043600/0x209a6de5bc985a09 lrc: 4/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5f6 expref: 18 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:3.0:1713507934.183855:0:10855:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1839:x1796742877325376:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1713507934.183855:0:8540:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12091 00010000:00010000:3.0:1713507934.183861:0:10855:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713507934.183861:0:6514:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d041f80/0x209a6de5bc9859c3 lrc: 0/0,0 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->389119) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5c5 expref: 28 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:1.0:1713507934.183881:0:9528:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d043600/0x209a6de5bc985a09 lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5f6 expref: 18 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.183884:0:6514:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.183884:0:8156:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713507934.183885:0:10855:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 4/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b67b expref: 26 pid: 14149 timeout: 537 lvb_type: 1 00010000:00010000:2.0:1713507934.183886:0:6514:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.183887:0:8156:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 2/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.183890:0:9528:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d043600/0x209a6de5bc985a09 lrc: 0/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b5f6 expref: 18 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.183892:0:6514:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 3/0,1 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.183893:0:8156:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880092925200 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:3.0:1713507934.183894:0:10855:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b67b expref: 26 pid: 14149 timeout: 537 lvb_type: 1 00010000:00010000:1.0:1713507934.183896:0:9528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.183896:0:9528:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.183897:0:9528:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 3/0,1 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.183899:0:6514:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 4/0,1 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.183900:0:8156:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 2/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.183901:0:9528:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 4/0,1 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.183906:0:8156:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 3/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.183910:0:9528:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713507934.183913:0:10855:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a09eac0/0x209a6de5bc985abf lrc: 0/0,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b67b expref: 26 pid: 14149 timeout: 537 lvb_type: 1 00010000:00010000:2.0:1713507934.183914:0:6514:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1713507934.183926:0:8156:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 1/0,0 mode: --/PW res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.183948:0:10855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.183948:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092925200/0x209a6de5bc985b13 lrc: 0/0,0 mode: --/PW res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8540 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.183949:0:10855:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713507934.183949:0:9528:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:1840:x1796742877325440:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 Request processed in 105us (249us total) trans 0 rc 0/0 00010000:00010000:3.0:1713507934.183951:0:10855:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 3/0,1 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.183953:0:9528:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7865 00010000:00010000:3.0:1713507934.183956:0:10855:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 4/0,1 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.183958:0:6514:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:1839:x1796742877325248:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 Request processed in 129us (269us total) trans 0 rc 0/0 00010000:00010000:0.0:1713507934.183962:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1713507934.183963:0:6514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7864 00010000:00010000:1.0:1713507934.183963:0:8142:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 3/0,1 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.183963:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.183964:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.183966:0:8142:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 3/0,1 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.183968:0:10855:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713507934.183974:0:8142:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 3/0,1 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.183983:0:8142:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 2/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.183984:0:10855:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315df00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+24:1839:x1796742877325376:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 Request processed in 128us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.183989:0:10855:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7866 00010000:00010000:1.0:1713507934.183991:0:8142:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1713507934.183998:0:6517:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713507934.184000:0:6517:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 2/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.184005:0:6517:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d040240 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:3.0:1713507934.184006:0:15146:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 3/0,1 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.184007:0:8142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+16:1840:x1796742877324992:12345-192.168.203.24@tcp:1:lfs.0 Request processed in 1532us (1624us total) trans 0 rc 0/0 00010000:00010000:0.0:1713507934.184007:0:6517:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 2/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.184011:0:8142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12093 00010000:00010000:0.0:1713507934.184012:0:6517:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 3/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.184016:0:15146:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 3/0,1 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.184020:0:6517:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 1/0,0 mode: --/PW res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184021:0:15031:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 3/0,1 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184025:0:15031:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 3/0,1 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.184028:0:15146:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 3/0,1 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184032:0:15031:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 3/0,1 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.184033:0:15146:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 2/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.184033:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985b21 lrc: 0/0,0 mode: --/PW res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184035:0:15031:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 2/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.184041:0:14149:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 3/0,1 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.184043:0:15146:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1713507934.184043:0:6517:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1713507934.184045:0:6517:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 2/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.184047:0:14149:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 3/0,1 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184049:0:15031:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1713507934.184050:0:6517:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdef40 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:0.0:1713507934.184051:0:6517:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 2/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.184056:0:6517:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 3/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.184059:0:14149:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 3/0,1 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.184063:0:6517:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 1/0,0 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.184064:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+23:1840:x1796742877324800:12345-192.168.203.24@tcp:1:lfs.0 Request processed in 1683us (1752us total) trans 0 rc 0/0 00010000:00010000:2.0:1713507934.184065:0:14149:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 2/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.184066:0:15146:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bc71eae4-4dba-4b1f-9a3b-55899db60475+23:1840:x1796742877324864:12345-192.168.203.24@tcp:1:lfs.0 Request processed in 1608us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.184068:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12089 00010000:00010000:0.0:1713507934.184068:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131cdef40/0x209a6de5bc985b1a lrc: 0/0,0 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.184071:0:15146:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12092 00010000:00010000:2.0:1713507934.184076:0:14149:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1713507934.184076:0:13607:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1713507934.184078:0:13607:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 2/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.184078:0:6517:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713507934.184079:0:6517:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 2/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.184084:0:6517:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09e880 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:0.0:1713507934.184086:0:6517:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 2/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184088:0:13607:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d041200 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:1.0:1713507934.184090:0:13607:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 2/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.184091:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.184093:0:13607:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 3/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.184096:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a18e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+15:1840:x1796742877324928:12345-192.168.203.24@tcp:1:lfs.0 Request processed in 1708us (1766us total) trans 0 rc 0/0 00010000:00010000:3.0:1713507934.184099:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.184099:0:13607:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 1/0,0 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.184099:0:6517:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 3/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184102:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d041200/0x209a6de5bc985b05 lrc: 0/0,0 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.184103:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12090 00010000:00010000:0.0:1713507934.184106:0:6517:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 1/0,0 mode: --/PW res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184111:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.184111:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a09e880/0x209a6de5bc985b0c lrc: 0/0,0 mode: --/PW res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184112:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.184113:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.184116:0:8143:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 3/0,1 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184120:0:8143:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 3/0,1 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.184122:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.184123:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.184124:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.184127:0:8143:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 3/0,1 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184130:0:8143:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 2/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.184142:0:8143:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713507934.184149:0:8156:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713507934.184164:0:8156:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 2/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.184175:0:8143:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+14:1840:x1796742877324736:12345-192.168.203.24@tcp:1:lfs.0 Request processed in 1805us (1882us total) trans 0 rc 0/0 00010000:00010000:2.0:1713507934.184179:0:8156:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdcd80 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:2.0:1713507934.184181:0:8156:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 2/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.184181:0:8143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12088 00010000:00010000:2.0:1713507934.184187:0:8156:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 3/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.184197:0:8156:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 1/0,0 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.184202:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985afe lrc: 0/0,0 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.184215:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.184216:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.184218:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.185021:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.185089:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325568 00000100:00100000:3.0:1713507934.185137:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16838 00000100:00100000:3.0:1713507934.185141:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+147:23727:x1796742877325568:12345-192.168.203.24@tcp:36:lfs.0 00010000:00010000:3.0:1713507934.185194:0:13683:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1713507934.185203:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985ae2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b689 expref: 147 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.185212:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09c240/0x209a6de5bc985a2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b612 expref: 146 pid: 13045 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.185216:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:3.0:1713507934.185223:0:13683:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713507934.185232:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.185237:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.185241:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1713507934.185983:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3472, 88 off259000 00000004:00080000:3.0:1713507934.185987:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313467233ns, next at 433063087189ns, rc = 0 00000040:00080000:3.0:1713507934.186016:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3473, 88 off259088 00000004:00080000:3.0:1713507934.186018:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313498986ns, next at 433063087189ns, rc = 0 00000040:00080000:3.0:1713507934.186058:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3481, 88 off259728 00000004:00080000:3.0:1713507934.186060:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313540405ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186085:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3482, 88 off259816 00000004:00080000:3.0:1713507934.186087:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313567310ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186107:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3474, 88 off259176 00000004:00080000:3.0:1713507934.186110:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313590416ns, next at 433063087189ns, rc = 0 00000040:00080000:3.0:1713507934.186138:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3475, 88 off259264 00000004:00080000:3.0:1713507934.186141:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313621395ns, next at 433063087189ns, rc = 0 00000040:00080000:3.0:1713507934.186177:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3483, 88 off259904 00000004:00080000:3.0:1713507934.186180:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313660360ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186207:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3484, 88 off259992 00000004:00080000:3.0:1713507934.186208:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313688760ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186225:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3485, 88 off260080 00000004:00080000:3.0:1713507934.186226:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313706865ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186252:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3476, 88 off259352 00000004:00080000:3.0:1713507934.186253:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313733940ns, next at 433063087189ns, rc = 0 00000040:00080000:3.0:1713507934.186276:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3477, 88 off259440 00000004:00080000:3.0:1713507934.186278:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313758913ns, next at 433063087189ns, rc = 0 00000040:00080000:3.0:1713507934.186296:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3486, 88 off260168 00000004:00080000:3.0:1713507934.186297:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313777776ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186318:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3487, 88 off260256 00000004:00080000:3.0:1713507934.186319:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313799916ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186335:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3478, 88 off259528 00000004:00080000:3.0:1713507934.186337:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313817781ns, next at 433063087189ns, rc = 0 00000040:00080000:3.0:1713507934.186353:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3488, 88 off260344 00000004:00080000:3.0:1713507934.186355:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313835568ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186371:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3479, 88 off259616 00000004:00080000:3.0:1713507934.186372:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313852940ns, next at 433063087189ns, rc = 0 00000040:00080000:3.0:1713507934.186388:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3480, 88 off259704 00000004:00080000:3.0:1713507934.186390:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313870693ns, next at 433063087189ns, rc = 0 00000040:00080000:3.0:1713507934.186406:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3489, 88 off260432 00000004:00080000:3.0:1713507934.186408:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313888538ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186424:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3490, 88 off260520 00000004:00080000:3.0:1713507934.186426:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437313906270ns, next at 433095107838ns, rc = 0 00000040:00080000:3.0:1713507934.186443:0:13683:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3481, 88 off259792 00000004:00080000:3.0:1713507934.186444:0:13683:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437313924741ns, next at 433063087189ns, rc = 0 00000001:00100000:0.0:1713507934.192632:0:13083:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ca88ec92-e358-41d9-8ccb-5b2a7c736474 00000020:00000080:0.0:1713507934.192636:0:13083:0:(genops.c:985:class_export_put()) final put ffff88009c763000/ca88ec92-e358-41d9-8ccb-5b2a7c736474 00000004:00010000:3.0:1713507934.192642:0:13683:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009315af80 reply state ffff8800a1ed9000 transno 8589952736 ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000001:00100000:0.0:1713507934.192648:0:13083:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8 00000020:00000080:2.0:1713507934.192650:0:302:0:(genops.c:944:class_export_destroy()) destroying export ffff88009c763000/ca88ec92-e358-41d9-8ccb-5b2a7c736474 for lustre-MDT0000 00000001:00080000:0.0:1713507934.192655:0:13083:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952733 is committed 00000020:00000080:0.0:1713507934.192659:0:13083:0:(genops.c:985:class_export_put()) final put ffff8800a1d42800/3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8 00000001:00080000:0.0:1713507934.192664:0:13083:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952731 is committed 00000001:00080000:0.0:1713507934.192671:0:13083:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952736 is committed 00000004:00080000:0.0:1713507934.192685:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1279 committed 00000004:00080000:0.0:1713507934.192689:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1281 committed 00000020:00000080:2.0:1713507934.192692:0:302:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88009c764800 for lustre-MDT0000 00000004:00080000:0.0:1713507934.192692:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1280 committed 00000004:00080000:0.0:1713507934.192694:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1278 committed 00000004:00080000:0.0:1713507934.192695:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1277 committed 00000020:00000080:2.0:1713507934.192696:0:302:0:(genops.c:944:class_export_destroy()) destroying export ffff8800a1d42800/3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8 for lustre-MDT0000 00000004:00080000:0.0:1713507934.192697:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1279 committed 00000004:00080000:0.0:1713507934.192698:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1276 committed 00010000:00080000:3.0:1713507934.192699:0:13683:0:(ldlm_lib.c:3334:target_send_reply()) Schedule reply immediately 00000004:00080000:0.0:1713507934.192704:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1278 committed 00000004:00080000:0.0:1713507934.192705:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1277 committed 00000100:00100000:3.0:1713507934.192706:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+144:23727:x1796742877325568:12345-192.168.203.24@tcp:36:lfs.0 Request processed in 7564us (7685us total) trans 8589952736 rc 0/0 00000004:00080000:0.0:1713507934.192707:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1275 committed 00000004:00080000:0.0:1713507934.192708:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1274 committed 00000004:00080000:0.0:1713507934.192709:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1276 committed 00000004:00080000:0.0:1713507934.192710:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1275 committed 00000004:00080000:0.0:1713507934.192712:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1274 committed 00000020:00000080:2.0:1713507934.192713:0:302:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff8800a1d44800 for lustre-MDT0000 00000004:00080000:0.0:1713507934.192713:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1273 committed 00000100:00100000:3.0:1713507934.192714:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16838 00000004:00080000:0.0:1713507934.192714:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1272 committed 00000004:00080000:0.0:1713507934.192716:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1273 committed 00000004:00080000:0.0:1713507934.192717:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1272 committed 00000004:00080000:0.0:1713507934.192719:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1271 committed 00000004:00080000:0.0:1713507934.192720:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1270 committed 00000100:00100000:2.0:1713507934.192726:0:2866:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d224c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881316992:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1713507934.192734:0:2852:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.192741:0:2852:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.192746:0:2852:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.192750:0:2852:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdd440 already unused, calling callback (ffffffffa134d360) 00000100:00100000:2.0:1713507934.192751:0:2866:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713507934.192753:0:2852:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.192758:0:2852:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.192764:0:2866:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d225f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881317248:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1713507934.192766:0:2852:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:0.0:1713507934.192768:0:2852:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1713507934.192773:0:2867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d2250c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881317056:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1713507934.192774:0:2852:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.192775:0:2866:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1713507934.192779:0:2852:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985b28 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.192782:0:2866:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d227200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881317504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.192790:0:2867:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.192799:0:2867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d2263c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881317312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.192799:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d224740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881316928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.192806:0:2866:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.192815:0:15146:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881316992 00000100:00100000:2.0:1713507934.192819:0:2866:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d221c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881317760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.192825:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.192831:0:15146:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317248 00000100:00100000:1.0:1713507934.192833:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317056 00000100:00100000:2.0:1713507934.192836:0:8143:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317504 00000100:00100000:3.0:1713507934.192837:0:15146:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881316928 00000100:00100000:0.0:1713507934.192840:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d225a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881317184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713507934.192843:0:15146:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12094 00000100:00100000:3.0:1713507934.192846:0:15146:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:2866:x1796742881316992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.192851:0:8143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12095 00000100:00100000:2.0:1713507934.192854:0:8143:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:2866:x1796742881317248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.192854:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713507934.192857:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12096 00000100:00100000:1.0:1713507934.192861:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093158e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:2865:x1796742881316928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.192863:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d226d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881317440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.192874:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.192877:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317184 00000100:00100000:2.0:1713507934.192882:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317440 00000100:00100000:3.0:1713507934.192883:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12097 00000100:00100000:0.0:1713507934.192883:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d222600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881317696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.192885:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c12ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:2866:x1796742881317504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.192889:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12098 00000100:00100000:2.0:1713507934.192891:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009049ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:2867:x1796742881317056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.192893:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713507934.192907:0:19515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317696 00000100:00100000:0.0:1713507934.192919:0:19515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12099 00000100:00100000:0.0:1713507934.192923:0:19515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:2865:x1796742881317184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.192932:0:8540:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12100 00000100:00100000:0.0:1713507934.192935:0:8540:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093159300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:2865:x1796742881317440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.192943:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d225580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.192960:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713507934.192965:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093158e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:2865:x1796742881316928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (141us total) trans 17179874152 rc 0/0 00000100:00100000:0.0:1713507934.192969:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d226880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.192970:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12096 00000100:00100000:3.0:1713507934.192972:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c12ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:2866:x1796742881317504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (165us total) trans 21474841381 rc 0/0 00000100:00100000:3.0:1713507934.192976:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12097 00000100:00100000:1.0:1713507934.192979:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317120 00000100:00100000:2.0:1713507934.192980:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009049ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:2867:x1796742881317056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (189us total) trans 17179874153 rc 0/0 00000100:00100000:0.0:1713507934.192981:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.192984:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317376 00000100:00100000:2.0:1713507934.192984:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12098 00000100:00100000:0.0:1713507934.192986:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d2217c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.192988:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12101 00000100:00100000:1.0:1713507934.192990:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:2865:x1796742881317696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.192991:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12102 00000100:00100000:3.0:1713507934.192994:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:2868:x1796742881317120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.192994:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12103 00000100:00100000:2.0:1713507934.192996:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:2868:x1796742881317376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.192996:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713507934.193006:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.193026:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713507934.193028:0:15078:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317632 00000100:00100000:0.0:1713507934.193033:0:2868:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1713507934.193035:0:15078:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317888 00000100:00100000:0.0:1713507934.193037:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d2276c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.193038:0:15078:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12104 00000100:00100000:2.0:1713507934.193040:0:15078:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:2868:x1796742881317632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.193046:0:2866:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713507934.193063:0:2866:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d227200/2, rc 0, transno 4901 00000100:00100000:1.0:1713507934.193063:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:2865:x1796742881317696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (170us total) trans 21474841382 rc 0/0 00000100:00100000:2.0:1713507934.193067:0:2866:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d227200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881317504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.193067:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12101 00000004:00080000:0.0:1713507934.193073:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d222600/2, rc 0, transno 4902 00000100:00100000:1.0:1713507934.193074:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317760 00000100:00100000:3.0:1713507934.193076:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:2868:x1796742881317120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (115us total) trans 17179874154 rc 0/0 00000100:00100000:0.0:1713507934.193078:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d222600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881317696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.193080:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12105 00000100:00100000:1.0:1713507934.193082:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:2868:x1796742881317888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.193083:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12102 00000004:00080000:0.0:1713507934.193085:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d224740/2, rc 0, transno 4968 00000100:00100000:0.0:1713507934.193090:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d224740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881316928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713507934.193093:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12106 00000100:00100000:2.0:1713507934.193093:0:2866:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881318016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.193096:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c12f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:2866:x1796742881317760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.193097:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881317952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.193105:0:2866:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713507934.193113:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713507934.193128:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713507934.193133:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009d222140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.193141:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:2868:x1796742881317888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (114us total) trans 21474841383 rc 0/0 00000100:00100000:1.0:1713507934.193144:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12105 00000100:00100000:2.0:1713507934.193166:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713507934.193167:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881318016 00000100:00100000:1.0:1713507934.193173:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317952 00000004:00080000:2.0:1713507934.193176:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d225580/2, rc 0, transno 4970 00000100:00100000:2.0:1713507934.193180:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d225580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.193184:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317568 00000004:00080000:2.0:1713507934.193185:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a1e3c0/2, rc 0, transno 4903 00000100:00100000:2.0:1713507934.193186:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.193187:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317824 00000100:00100000:2.0:1713507934.193188:0:2868:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1713507934.193191:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12107 00000100:00100000:2.0:1713507934.193192:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009315da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881318080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.193193:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:2866:x1796742881318016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.193202:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.193218:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c12f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:2866:x1796742881317760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (169us total) trans 21474841384 rc 0/0 00000100:00100000:3.0:1713507934.193228:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12106 00000100:00100000:3.0:1713507934.193240:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881318080 00000100:00100000:3.0:1713507934.193250:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12108 00000100:00100000:3.0:1713507934.193253:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009315c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:2865:x1796742881317952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.193264:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c13900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:2866:x1796742881318016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (158us total) trans 21474841385 rc 0/0 00000100:00100000:3.0:1713507934.193265:0:6953:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12109 00000100:00100000:3.0:1713507934.193268:0:6953:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c14280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:2868:x1796742881317568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.193268:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12107 00000100:00100000:1.0:1713507934.193274:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12110 00000100:00100000:1.0:1713507934.193276:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c14740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:2868:x1796742881317824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.193283:0:15078:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:2868:x1796742881317632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 242us (287us total) trans 21474841386 rc 0/0 00000100:00100000:2.0:1713507934.193287:0:15078:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12104 00000100:00100000:2.0:1713507934.193295:0:15078:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12111 00000100:00100000:2.0:1713507934.193297:0:15078:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c150c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:2868:x1796742881318080:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1713507934.193316:0:2866:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880131c13dc0/2, rc 0, transno 4905 00000100:00100000:0.0:1713507934.193317:0:8540:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093159300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:2865:x1796742881317440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 380us (441us total) trans 21474841387 rc 0/0 00000100:00100000:2.0:1713507934.193318:0:2866:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c13dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881318016:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1713507934.193322:0:2866:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d221c80/2, rc 0, transno 4904 00000100:00100000:2.0:1713507934.193323:0:2866:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d221c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881317760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.193323:0:8540:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12100 00000004:00080000:1.0:1713507934.193325:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d226d40/2, rc 0, transno 4907 00000100:00100000:1.0:1713507934.193328:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d226d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881317440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.193346:0:6953:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c14280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:2868:x1796742881317568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (217us total) trans 21474841388 rc 0/0 00000100:00100000:3.0:1713507934.193350:0:6953:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12109 00000100:00100000:3.0:1713507934.193361:0:2867:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1713507934.193377:0:2867:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d2250c0/2, rc 0, transno 4969 00000100:00100000:3.0:1713507934.193379:0:2867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d2250c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881317056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713507934.193381:0:2867:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1713507934.193385:0:2867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880093159c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881318144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1713507934.193391:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d2276c0/2, rc 0, transno 4908 00000100:00100000:2.0:1713507934.193393:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d2276c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.193395:0:2867:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713507934.193397:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d2217c0/2, rc 0, transno 4906 00000100:00100000:2.0:1713507934.193398:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d2217c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.193409:0:8540:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881317312 00000100:00100000:3.0:1713507934.193411:0:6953:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881318144 00000100:00100000:1.0:1713507934.193413:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c14740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:2868:x1796742881317824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (261us total) trans 21474841389 rc 0/0 00000100:00100000:1.0:1713507934.193416:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12110 00000100:00100000:3.0:1713507934.193422:0:6953:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12112 00000100:00100000:3.0:1713507934.193424:0:6953:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880090498980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:2867:x1796742881318144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.193424:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12113 00000100:00100000:1.0:1713507934.193426:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880090498e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:2867:x1796742881317312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.193435:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:2865:x1796742881317952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (322us total) trans 21474841390 rc 0/0 00000100:00100000:2.0:1713507934.193438:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12108 00000004:00080000:2.0:1713507934.193501:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d222140/2, rc 0, transno 4909 00000004:00080000:0.0:1713507934.193501:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880131c13440/2, rc 0, transno 4910 00000100:00100000:2.0:1713507934.193503:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d222140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.193505:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881317952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.193547:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:2868:x1796742881317376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 549us (564us total) trans 17179874155 rc 0/0 00000100:00100000:3.0:1713507934.193553:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12103 00000100:00100000:1.0:1713507934.193554:0:19515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009315f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:2865:x1796742881317184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 629us (698us total) trans 17179874156 rc 0/0 00000100:00100000:1.0:1713507934.193559:0:19515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12099 00000100:00100000:0.0:1713507934.193575:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.193587:0:15078:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c150c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:2868:x1796742881318080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 288us (383us total) trans 17179874157 rc 0/0 00000100:00100000:2.0:1713507934.193592:0:15078:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12111 00000004:00080000:0.0:1713507934.193597:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d225a40/2, rc 0, transno 4972 00000100:00100000:0.0:1713507934.193600:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d225a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881317184:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1713507934.193614:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009315da40/2, rc 0, transno 4973 00000100:00100000:2.0:1713507934.193617:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009315da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881318080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713507934.193621:0:15146:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:2866:x1796742881316992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 774us (870us total) trans 17179874158 rc 0/0 00000004:00080000:2.0:1713507934.193623:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d226880/2, rc 0, transno 4971 00000100:00100000:3.0:1713507934.193625:0:15146:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12094 00000100:00100000:2.0:1713507934.193625:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d226880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881317376:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1713507934.193631:0:2866:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d224c00/2, rc 0, transno 4974 00000100:00100000:0.0:1713507934.193633:0:2866:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d224c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881316992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713507934.193636:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325632 00000100:00100000:3.0:1713507934.193651:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16839 00000100:00100000:3.0:1713507934.193654:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936caf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+141:23727:x1796742877325632:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.193660:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.193666:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b697 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.193685:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b697 expref: 142 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.193691:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b697 expref: 142 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.193699:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:3.0:1713507934.193700:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1713507934.193702:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cded00, rc 0) 00000100:00100000:3.0:1713507934.193722:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936caf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+142:23727:x1796742877325632:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 66us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.193727:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16839 00000100:00100000:3.0:1713507934.193807:0:6953:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880090498980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:2867:x1796742881318144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 382us (411us total) trans 17179874159 rc 0/0 00000100:00100000:3.0:1713507934.193811:0:6953:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12112 00000004:00080000:3.0:1713507934.193825:0:2867:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880093159c80/2, rc 0, transno 4975 00000100:00100000:3.0:1713507934.193827:0:2867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880093159c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881318144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.193849:0:8143:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:2866:x1796742881317248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 994us (1072us total) trans 17179874160 rc 0/0 00000100:00100000:2.0:1713507934.193853:0:8143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12095 00000004:00080000:0.0:1713507934.193859:0:2866:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d225f00/2, rc 0, transno 4976 00000100:00100000:0.0:1713507934.193862:0:2866:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d225f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881317248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.193864:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880090498e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:2867:x1796742881317312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 435us (501us total) trans 17179874161 rc 0/0 00000004:00080000:3.0:1713507934.193867:0:2867:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88009d2263c0/2, rc 0, transno 4977 00000100:00100000:3.0:1713507934.193869:0:2867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009d2263c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881317312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.193869:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12113 00000100:00100000:0.0:1713507934.194837:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.194882:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325696 00000100:00100000:3.0:1713507934.194900:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16840 00000100:00100000:3.0:1713507934.194919:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936c8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+142:23727:x1796742877325696:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.194925:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.194931:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985b36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b69e expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.194955:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985b3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.194963:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.194969:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713507934.194986:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x4bc:0x0]: returning size 16777217 00000004:00200000:3.0:1713507934.194989:0:13683:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1713507934.194998:0:13683:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.195005:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.195019:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985b36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b69e expref: 144 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.195030:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985b3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b69e expref: 143 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.195035:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:3.0:1713507934.195047:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713507934.195053:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cdf3c0, rc 0) 00000100:00100000:3.0:1713507934.195081:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936c8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+143:23727:x1796742877325696:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 162us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.195085:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16840 00000100:00100000:0.0:1713507934.195930:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.195950:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.195965:0:8143:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325760 00000100:00100000:0.0:1713507934.195967:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.195982:0:8143:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325888 00000100:00100000:0.0:1713507934.195983:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.195985:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326016 00000100:00100000:2.0:1713507934.195990:0:8143:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325824 00000100:00100000:0.0:1713507934.195996:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.195998:0:8143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12114 00000100:00100000:2.0:1713507934.196001:0:8143:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936c84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+15:1842:x1796742877325760:12345-192.168.203.24@tcp:101:lfs.0 00000100:00100000:1.0:1713507934.196002:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877325952 00010000:00010000:2.0:1713507934.196008:0:8143:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1713507934.196013:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12115 00010000:00010000:2.0:1713507934.196015:0:8143:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 2/0,0 mode: --/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6a5 expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.196016:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936c9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+23:1842:x1796742877325888:12345-192.168.203.24@tcp:101:lfs.0 00000100:00100000:0.0:1713507934.196019:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00002000:00010000:2.0:1713507934.196025:0:8143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9a5:0x0] initial LVB size: 900320, mtime: 0x66220e5c, atime: 0x66220e5c, ctime: 0x66220e5c, blocks: 0x1 00010000:00010000:1.0:1713507934.196028:0:15031:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.196032:0:8143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713507934.196032:0:6954:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326080 00010000:00010000:2.0:1713507934.196033:0:8143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.196036:0:15031:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 2/0,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6b3 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.196038:0:15146:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12116 00010000:00010000:2.0:1713507934.196038:0:8143:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 3/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6a5 expref: 17 pid: 8143 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713507934.196042:0:15146:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936c9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bc71eae4-4dba-4b1f-9a3b-55899db60475+24:1842:x1796742877325824:12345-192.168.203.24@tcp:101:lfs.0 00000100:00100000:0.0:1713507934.196045:0:6954:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12117 00002000:00010000:1.0:1713507934.196047:0:15031:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9cd:0x0] initial LVB size: 1735424, mtime: 0x66220e5d, atime: 0x66220e5a, ctime: 0x66220e5d, blocks: 0x87 00010000:00010000:3.0:1713507934.196049:0:15146:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1713507934.196049:0:6954:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:1842:x1796742877326016:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.196054:0:8143:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 3/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6a5 expref: 17 pid: 8143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.196054:0:15031:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.196056:0:15146:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 2/0,0 mode: --/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6ac expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.196056:0:15031:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.196057:0:6954:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.196059:0:8143:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09ef40, rc 0) 00010000:00010000:1.0:1713507934.196061:0:15031:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6b3 expref: 25 pid: 15031 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713507934.196064:0:6954:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 2/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6c1 expref: -99 pid: 6954 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1713507934.196065:0:15146:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9cc:0x0] initial LVB size: 1048576, mtime: 0x66220e5b, atime: 0x66220e5a, ctime: 0x66220e5b, blocks: 0x803 00010000:00010000:1.0:1713507934.196070:0:15031:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6b3 expref: 26 pid: 15031 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713507934.196072:0:15146:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.196073:0:15146:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1713507934.196075:0:6954:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9a9:0x0] initial LVB size: 4493088, mtime: 0x66220e5c, atime: 0x66220e5c, ctime: 0x66220e5c, blocks: 0x807 00010000:00010000:3.0:1713507934.196077:0:15146:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 3/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ac expref: 26 pid: 15146 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713507934.196077:0:8143:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936c84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:1842:x1796742877325760:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 75us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1713507934.196077:0:15031:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009d040480, rc 0) 00000100:00100000:2.0:1713507934.196081:0:8143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12114 00010000:00010000:0.0:1713507934.196082:0:6954:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.196083:0:15146:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 3/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ac expref: 26 pid: 15146 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713507934.196084:0:6954:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.196088:0:15146:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cdcb40, rc 0) 00010000:00010000:0.0:1713507934.196088:0:6954:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c1 expref: 17 pid: 6954 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1713507934.196091:0:8143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12118 00000100:00100000:2.0:1713507934.196093:0:8143:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:1842:x1796742877325952:12345-192.168.203.24@tcp:101:lfs.0 00000100:00100000:1.0:1713507934.196093:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936c9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:1842:x1796742877325888:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 76us (143us total) trans 0 rc 0/0 00010000:00010000:2.0:1713507934.196097:0:8143:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1713507934.196098:0:6954:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c1 expref: 17 pid: 6954 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713507934.196099:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12115 00010000:00010000:2.0:1713507934.196101:0:8143:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 2/0,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6ba expref: -99 pid: 8143 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.196103:0:15146:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936c9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:1842:x1796742877325824:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 61us (121us total) trans 0 rc 0/0 00010000:00010000:0.0:1713507934.196106:0:6954:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880092925200, rc 0) 00000100:00100000:3.0:1713507934.196107:0:15146:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12116 00002000:00010000:2.0:1713507934.196107:0:8143:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9a8:0x0] initial LVB size: 2097152, mtime: 0x66220e5c, atime: 0x66220e5c, ctime: 0x66220e5c, blocks: 0x1 00000100:00100000:1.0:1713507934.196110:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12119 00010000:00010000:2.0:1713507934.196112:0:8143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.196112:0:8143:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1713507934.196114:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+24:1842:x1796742877326080:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.196115:0:8143:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 3/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ba expref: 18 pid: 8143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.196118:0:15031:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.196121:0:8143:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 3/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ba expref: 18 pid: 8143 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1713507934.196121:0:6954:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cb900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:1842:x1796742877326016:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 71us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1713507934.196124:0:15031:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 2/0,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6c8 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.196125:0:8143:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09f180, rc 0) 00000100:00100000:0.0:1713507934.196127:0:6954:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12117 00002000:00010000:1.0:1713507934.196131:0:15031:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9ce:0x0] initial LVB size: 4194304, mtime: 0x66220e5c, atime: 0x66220e5d, ctime: 0x66220e5c, blocks: 0x1 00000100:00100000:2.0:1713507934.196133:0:8143:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cf200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:1842:x1796742877325952:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 40us (139us total) trans 0 rc 0/0 00010000:00010000:1.0:1713507934.196138:0:15031:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.196139:0:15031:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1713507934.196142:0:8143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12118 00010000:00010000:1.0:1713507934.196142:0:15031:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c8 expref: 25 pid: 15031 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.196171:0:15031:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c8 expref: 25 pid: 15031 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.196178:0:15031:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009d042880, rc 0) 00000100:00100000:1.0:1713507934.196193:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:1842:x1796742877326080:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 79us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.196198:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12119 00000100:00100000:0.0:1713507934.198551:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.198594:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326208 00000100:00100000:3.0:1713507934.198612:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16841 00000100:00100000:3.0:1713507934.198615:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936c8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+143:23727:x1796742877326208:12345-192.168.203.24@tcp:36:lfs.0 00010000:00010000:3.0:1713507934.198632:0:13683:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507934.198645:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985b3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b69e expref: 143 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.198652:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:3.0:1713507934.198654:0:13683:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713507934.198666:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.198671:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.198676:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1713507934.198758:0:13683:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800936c8e40 reply state ffff880131e28000 transno 8589952737 ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.198799:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936c8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+144:23727:x1796742877326208:12345-192.168.203.24@tcp:36:lfs.0 Request processed in 183us (250us total) trans 8589952737 rc 0/0 00000100:00100000:3.0:1713507934.198803:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16841 00010000:00010000:2.0:1713507934.199361:0:2852:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.199368:0:2852:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.199372:0:2852:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.199375:0:2852:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdc000 already unused, calling callback (ffffffffa134d360) 00010000:00010000:2.0:1713507934.199377:0:2852:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.199380:0:2852:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.199386:0:2852:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:2.0:1713507934.199387:0:2852:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1713507934.199388:0:2852:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.199391:0:2852:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985b6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.199458:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.199497:0:19515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326272 00000100:00100000:1.0:1713507934.199538:0:19515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12120 00000100:00100000:1.0:1713507934.199541:0:19515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:23727:x1796742877326272:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:1.0:1713507934.199547:0:19515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1713507934.199552:0:19515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 2/0,0 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6cf expref: -99 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.199564:0:19515:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 2/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6a5 expref: 18 pid: 8143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.199569:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.199569:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.199571:0:19515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 4/0,0 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 18 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.199584:0:19515:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 3/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6a5 expref: 18 pid: 8143 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.199590:0:19515:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 4/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6a5 expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00000100:00100000:1.0:1713507934.199601:0:19515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1d580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19515:1796742881318208:192.168.203.24@tcp:104: 00000100:00100000:1.0:1713507934.199630:0:19515:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a92de540 going to sleep for 6 seconds 00000100:00100000:1.0:1713507934.200275:0:19515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1d580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19515:1796742881318208:192.168.203.24@tcp:104: 00010000:00010000:1.0:1713507934.200288:0:19515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 3/0,0 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 18 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.200296:0:19515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009d042640, rc 0) 00000100:00100000:1.0:1713507934.200322:0:19515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:23727:x1796742877326272:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 781us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.200327:0:19515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12120 00000100:00100000:0.0:1713507934.200423:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.200498:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326336 00010000:00010000:3.0:1713507934.200512:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 4/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6a5 expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00000100:00100000:3.0:1713507934.200544:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7867 00000100:00100000:3.0:1713507934.200547:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ce3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:1839:x1796742877326336:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1713507934.200552:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507934.200558:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 4/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6a5 expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.200570:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 3/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6a5 expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.200592:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a09ef40/0x209a6de5bc985b44 lrc: 0/0,0 mode: --/PR res: [0x9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6a5 expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.200598:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.200599:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.200601:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 2/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 17 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.200606:0:6515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 3/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 17 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.200617:0:6515:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 3/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 17 pid: 19515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.200623:0:6515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6515:1796742881318272:192.168.203.24@tcp:105: 00000100:00100000:3.0:1713507934.200643:0:6515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5240 going to sleep for 6 seconds 00000100:00100000:3.0:1713507934.201268:0:6515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6515:1796742881318272:192.168.203.24@tcp:105: 00010000:00010000:3.0:1713507934.201277:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713507934.201292:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ce3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:1839:x1796742877326336:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 Request processed in 744us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.201296:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7867 00000100:00100000:2.0:1713507934.201388:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.201426:0:19515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326400 00000100:00100000:1.0:1713507934.201443:0:19515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12121 00000100:00100000:1.0:1713507934.201446:0:19515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:23727:x1796742877326400:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:1.0:1713507934.201452:0:19515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1713507934.201467:0:19515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 2/0,0 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6d6 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.201477:0:19515:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 2/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ac expref: 26 pid: 15146 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.201482:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.201483:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.201484:0:19515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 4/0,0 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 26 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.201502:0:19515:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 3/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ac expref: 26 pid: 15146 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.201507:0:19515:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 4/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ac expref: 26 pid: 15146 timeout: 537 lvb_type: 1 00000100:00100000:1.0:1713507934.201513:0:19515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1d580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19515:1796742881318336:192.168.203.24@tcp:104: 00000100:00100000:1.0:1713507934.201549:0:19515:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a92de540 going to sleep for 6 seconds 00000100:00100000:1.0:1713507934.202103:0:19515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1d580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19515:1796742881318336:192.168.203.24@tcp:104: 00010000:00010000:1.0:1713507934.202114:0:19515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 3/0,0 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 26 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.202122:0:19515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009d043180, rc 0) 00000100:00100000:1.0:1713507934.202140:0:19515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:23727:x1796742877326400:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 692us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.202146:0:19515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12121 00000100:00100000:0.0:1713507934.202199:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.202242:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326464 00010000:00010000:3.0:1713507934.202252:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 4/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ac expref: 26 pid: 15146 timeout: 537 lvb_type: 1 00000100:00100000:3.0:1713507934.202267:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7868 00000100:00100000:3.0:1713507934.202270:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:1840:x1796742877326464:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 00010000:00010000:3.0:1713507934.202274:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507934.202280:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 4/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ac expref: 26 pid: 15146 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.202284:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 3/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ac expref: 26 pid: 15146 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.202292:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131cdcb40/0x209a6de5bc985b52 lrc: 0/0,0 mode: --/PR res: [0x9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ac expref: 26 pid: 15146 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.202297:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.202298:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.202300:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 2/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 25 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.202304:0:6515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 3/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 25 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.202314:0:6515:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 3/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 25 pid: 19515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.202319:0:6515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6515:1796742881318400:192.168.203.24@tcp:105: 00000100:00100000:3.0:1713507934.202335:0:6515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5240 going to sleep for 6 seconds 00000100:00100000:3.0:1713507934.202847:0:6515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6515:1796742881318400:192.168.203.24@tcp:105: 00010000:00010000:3.0:1713507934.202855:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713507934.202881:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cdf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:1840:x1796742877326464:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 Request processed in 609us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.202886:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7868 00000100:00100000:0.0:1713507934.202900:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.202930:0:19515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326528 00000100:00100000:2.0:1713507934.202946:0:19515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12122 00000100:00100000:2.0:1713507934.202949:0:19515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecbe3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:23727:x1796742877326528:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.202960:0:19515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.202967:0:19515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 2/0,0 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6dd expref: -99 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.202982:0:19515:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 2/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6b3 expref: 26 pid: 15031 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.202987:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.202987:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.202989:0:19515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 4/0,0 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 26 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.203010:0:19515:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6b3 expref: 26 pid: 15031 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.203016:0:19515:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 4/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6b3 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00000100:00100000:2.0:1713507934.203021:0:19515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c14c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19515:1796742881318464:192.168.203.24@tcp:104: 00000100:00100000:2.0:1713507934.203040:0:19515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009157dc00 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.203461:0:19515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c14c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19515:1796742881318464:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.203471:0:19515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 3/0,0 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 26 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.203478:0:19515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09c900, rc 0) 00000100:00100000:2.0:1713507934.203501:0:19515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecbe3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:23727:x1796742877326528:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 551us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.203511:0:19515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12122 00000100:00100000:1.0:1713507934.203591:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.203624:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326592 00010000:00010000:3.0:1713507934.203632:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 4/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6b3 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00000100:00100000:3.0:1713507934.203643:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7869 00000100:00100000:3.0:1713507934.203645:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1f46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:1840:x1796742877326592:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1713507934.203649:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507934.203654:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 4/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6b3 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.203659:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6b3 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.203666:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d040480/0x209a6de5bc985b4b lrc: 0/0,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6b3 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.203671:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.203672:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.203674:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 2/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 25 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.203678:0:6515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 3/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 25 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.203693:0:6515:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 3/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 25 pid: 19515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.203699:0:6515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6515:1796742881318528:192.168.203.24@tcp:105: 00000100:00100000:3.0:1713507934.203718:0:6515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5240 going to sleep for 6 seconds 00000100:00100000:3.0:1713507934.204196:0:6515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6515:1796742881318528:192.168.203.24@tcp:105: 00010000:00010000:3.0:1713507934.204203:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713507934.204222:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1f46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:1840:x1796742877326592:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 Request processed in 575us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.204226:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7869 00000100:00100000:0.0:1713507934.204302:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.204327:0:19515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326656 00000100:00100000:2.0:1713507934.204341:0:19515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12123 00000100:00100000:2.0:1713507934.204343:0:19515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecbe880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:23727:x1796742877326656:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.204348:0:19515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.204353:0:19515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 2/0,0 mode: --/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6e4 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.204362:0:19515:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 2/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ba expref: 18 pid: 8143 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.204366:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.204367:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.204368:0:19515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 4/0,0 mode: --/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 18 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.204377:0:19515:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 3/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ba expref: 18 pid: 8143 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.204381:0:19515:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 4/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ba expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00000100:00100000:2.0:1713507934.204386:0:19515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c14c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19515:1796742881318592:192.168.203.24@tcp:104: 00000100:00100000:2.0:1713507934.204419:0:19515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009157dc00 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.204950:0:19515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c14c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19515:1796742881318592:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.204959:0:19515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 3/0,0 mode: --/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 18 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.204980:0:19515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09f3c0, rc 0) 00000100:00100000:2.0:1713507934.205003:0:19515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecbe880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:23727:x1796742877326656:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 659us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.205007:0:19515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12123 00000100:00100000:0.0:1713507934.205042:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.205085:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326720 00010000:00010000:3.0:1713507934.205101:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 4/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ba expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00000100:00100000:3.0:1713507934.205119:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7870 00000100:00100000:3.0:1713507934.205122:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecbb440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:1840:x1796742877326720:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1713507934.205127:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507934.205134:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 4/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ba expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.205139:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 3/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ba expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.205148:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a09f180/0x209a6de5bc985b60 lrc: 0/0,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6ba expref: 18 pid: 8143 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.205177:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.205178:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.205181:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 2/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 17 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.205185:0:6515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 3/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 17 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.205197:0:6515:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 3/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 17 pid: 19515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.205202:0:6515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6515:1796742881318656:192.168.203.24@tcp:105: 00000100:00100000:3.0:1713507934.205225:0:6515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5a80 going to sleep for 6 seconds 00000100:00100000:3.0:1713507934.205781:0:6515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6515:1796742881318656:192.168.203.24@tcp:105: 00010000:00010000:3.0:1713507934.205788:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713507934.205811:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecbb440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:1840:x1796742877326720:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 Request processed in 688us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.205816:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7870 00000100:00100000:0.0:1713507934.205842:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.205871:0:19515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326784 00000100:00100000:2.0:1713507934.205884:0:19515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12124 00000100:00100000:2.0:1713507934.205886:0:19515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecb97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:23727:x1796742877326784:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.205891:0:19515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.205896:0:19515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 2/0,0 mode: --/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6eb expref: -99 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.205905:0:19515:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c1 expref: 18 pid: 6954 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.205908:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.205909:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.205910:0:19515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 4/0,0 mode: --/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 18 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.205919:0:19515:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c1 expref: 18 pid: 6954 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.205923:0:19515:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 4/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c1 expref: 18 pid: 6954 timeout: 537 lvb_type: 1 00000100:00100000:2.0:1713507934.205928:0:19515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c14c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19515:1796742881318720:192.168.203.24@tcp:104: 00000100:00100000:2.0:1713507934.205950:0:19515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009157dc00 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.206434:0:19515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c14c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:19515:1796742881318720:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.206442:0:19515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 3/0,0 mode: --/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 18 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.206448:0:19515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09f600, rc 0) 00000100:00100000:2.0:1713507934.206462:0:19515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecb97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:23727:x1796742877326784:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 575us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.206466:0:19515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12124 00000100:00100000:2.0:1713507934.206540:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.206569:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326848 00010000:00010000:3.0:1713507934.206577:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 4/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c1 expref: 18 pid: 6954 timeout: 537 lvb_type: 1 00000100:00100000:3.0:1713507934.206588:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7871 00000100:00100000:3.0:1713507934.206590:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c14c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:1840:x1796742877326848:12345-192.168.203.24@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1713507934.206594:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507934.206604:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 4/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c1 expref: 18 pid: 6954 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.206609:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c1 expref: 18 pid: 6954 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.206616:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092925200/0x209a6de5bc985b59 lrc: 0/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c1 expref: 18 pid: 6954 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.206622:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.206622:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.206625:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 2/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 17 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.206629:0:6515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 3/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 17 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.206638:0:6515:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 3/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 17 pid: 19515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.206643:0:6515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6515:1796742881318784:192.168.203.24@tcp:105: 00000100:00100000:3.0:1713507934.206659:0:6515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5a80 going to sleep for 6 seconds 00000100:00100000:0.0:1713507934.207207:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.207209:0:6515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6515:1796742881318784:192.168.203.24@tcp:105: 00010000:00010000:3.0:1713507934.207217:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713507934.207230:0:19515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326912 00000100:00100000:3.0:1713507934.207231:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c14c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:1840:x1796742877326848:12345-192.168.203.24@tcp:103:ldlm_bl_01.0 Request processed in 640us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.207235:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7871 00000100:00100000:2.0:1713507934.207249:0:19515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12125 00000100:00100000:2.0:1713507934.207251:0:19515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecb9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:23727:x1796742877326912:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.207256:0:19515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.207261:0:19515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 2/0,0 mode: --/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6f2 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.207270:0:19515:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 2/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c8 expref: 26 pid: 15031 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.207273:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.207274:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.207275:0:19515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 4/0,0 mode: --/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 26 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.207284:0:19515:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c8 expref: 26 pid: 15031 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.207296:0:19515:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 4/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c8 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00000100:00100000:2.0:1713507934.207301:0:19515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c15580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19515:1796742881318848:192.168.203.24@tcp:104: 00000100:00100000:2.0:1713507934.207318:0:19515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009157dc00 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.207688:0:19515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c15580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:19515:1796742881318848:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.207696:0:19515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 3/0,0 mode: --/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 26 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.207702:0:19515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09f840, rc 0) 00000100:00100000:2.0:1713507934.207716:0:19515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecb9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:23727:x1796742877326912:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 464us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.207720:0:19515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12125 00000100:00100000:0.0:1713507934.207827:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.207896:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877326976 00010000:00010000:3.0:1713507934.207909:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 4/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c8 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00000100:00100000:3.0:1713507934.207923:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7872 00000100:00100000:3.0:1713507934.207926:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecbbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:1840:x1796742877326976:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1713507934.207930:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507934.207936:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 4/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c8 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.207942:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c8 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.207951:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d042880/0x209a6de5bc985b67 lrc: 0/0,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6c8 expref: 26 pid: 15031 timeout: 537 lvb_type: 1 00010000:00010000:3.0:1713507934.207957:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.207958:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.207962:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 2/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 25 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.207968:0:6515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 3/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 25 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.207985:0:6515:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 3/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 25 pid: 19515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.207994:0:6515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6515:1796742881318912:192.168.203.24@tcp:105: 00000100:00100000:3.0:1713507934.208025:0:6515:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5a80 going to sleep for 6 seconds 00000100:00100000:3.0:1713507934.208614:0:6515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6515:1796742881318912:192.168.203.24@tcp:105: 00010000:00010000:3.0:1713507934.208625:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713507934.208646:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecbbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:1840:x1796742877326976:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 Request processed in 718us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.208653:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7872 00000100:00100000:0.0:1713507934.208783:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.208799:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.208812:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.208821:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.208824:0:19515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327104 00000100:00100000:2.0:1713507934.208828:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327232 00000100:00100000:0.0:1713507934.208831:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.208840:0:19515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327360 00000100:00100000:1.0:1713507934.208843:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327040 00000100:00100000:2.0:1713507934.208845:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327168 00000100:00100000:0.0:1713507934.208851:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.208855:0:19515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12126 00000100:00100000:2.0:1713507934.208855:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327296 00000100:00100000:3.0:1713507934.208860:0:19515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1840:x1796742877327104:12345-192.168.203.24@tcp:2:lfs.0 00000100:00100000:0.0:1713507934.208865:0:8143:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12127 00000100:00100000:0.0:1713507934.208869:0:8143:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecbc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1840:x1796742877327232:12345-192.168.203.24@tcp:2:lfs.0 00000100:00100000:2.0:1713507934.208875:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12128 00000100:00100000:2.0:1713507934.208878:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecb84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1840:x1796742877327360:12345-192.168.203.24@tcp:2:lfs.0 00000100:00100000:1.0:1713507934.208881:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12129 00000100:00100000:1.0:1713507934.208886:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecba140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1840:x1796742877327168:12345-192.168.203.24@tcp:2:lfs.0 00002000:00010000:0.0:1713507934.208960:0:8143:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1713507934.208962:0:8143:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb mtime from disk: 1713507932 -> 1713507933 00002000:00010000:0.0:1713507934.208963:0:8143:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb atime from disk: 1713507932 -> 1713507933 00000100:00100000:1.0:1713507934.208964:0:6953:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12130 00002000:00010000:0.0:1713507934.208965:0:8143:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb ctime from disk: 1713507932 -> 1713507935 00002000:00010000:0.0:1713507934.208966:0:8143:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1713507934.208968:0:6953:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecb9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1840:x1796742877327040:12345-192.168.203.24@tcp:2:lfs.0 00000100:00100000:2.0:1713507934.208969:0:6954:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12131 00000100:00100000:2.0:1713507934.208972:0:6954:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecbd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1840:x1796742877327296:12345-192.168.203.24@tcp:2:lfs.0 00000100:00100000:0.0:1713507934.208983:0:8143:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecbc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1840:x1796742877327232:12345-192.168.203.24@tcp:2:lfs.0 Request processed in 113us (183us total) trans 21474841391 rc 0/0 00002000:00010000:3.0:1713507934.208985:0:19515:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1713507934.208987:0:19515:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb mtime from disk: 1713507931 -> 1713507933 00000100:00100000:0.0:1713507934.208987:0:8143:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12127 00002000:00010000:3.0:1713507934.208989:0:19515:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb atime from disk: 1713507930 -> 1713507933 00002000:00010000:3.0:1713507934.208991:0:19515:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb ctime from disk: 1713507931 -> 1713507935 00002000:00010000:3.0:1713507934.208993:0:19515:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:3.0:1713507934.209012:0:19515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+30:1840:x1796742877327104:12345-192.168.203.24@tcp:2:lfs.0 Request processed in 151us (229us total) trans 17179874162 rc 0/0 00000100:00100000:3.0:1713507934.209019:0:19515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12126 00002000:00010000:1.0:1713507934.209033:0:6953:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb size from disk: 900320 -> 900320 00002000:00010000:1.0:1713507934.209040:0:6953:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb mtime from disk: 1713507932 -> 1713507933 00002000:00010000:1.0:1713507934.209041:0:6953:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb atime from disk: 1713507932 -> 1713507933 00002000:00010000:1.0:1713507934.209042:0:6953:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb ctime from disk: 1713507932 -> 1713507935 00002000:00010000:1.0:1713507934.209043:0:6953:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1713507934.209052:0:6954:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb size from disk: 4493088 -> 4493088 00002000:00010000:2.0:1713507934.209054:0:6954:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb mtime from disk: 1713507932 -> 1713507933 00002000:00010000:2.0:1713507934.209056:0:6954:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb atime from disk: 1713507932 -> 1713507933 00002000:00010000:2.0:1713507934.209062:0:6954:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb ctime from disk: 1713507932 -> 1713507935 00002000:00010000:2.0:1713507934.209063:0:6954:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1713507934.209063:0:6953:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecb9300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+21:1840:x1796742877327040:12345-192.168.203.24@tcp:2:lfs.0 Request processed in 95us (242us total) trans 21474841392 rc 0/0 00000100:00100000:1.0:1713507934.209068:0:6953:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12130 00000100:00100000:2.0:1713507934.209082:0:6954:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecbd580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1840:x1796742877327296:12345-192.168.203.24@tcp:2:lfs.0 Request processed in 108us (230us total) trans 21474841393 rc 0/0 00000100:00100000:2.0:1713507934.209086:0:6954:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12131 00002000:00010000:1.0:1713507934.209101:0:15031:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb size from disk: 1735424 -> 1735424 00002000:00010000:1.0:1713507934.209103:0:15031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb mtime from disk: 1713507933 -> 1713507933 00002000:00010000:1.0:1713507934.209104:0:15031:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb atime from disk: 1713507930 -> 1713507933 00002000:00010000:1.0:1713507934.209105:0:15031:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb ctime from disk: 1713507933 -> 1713507935 00002000:00010000:1.0:1713507934.209106:0:15031:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb blocks from disk: 135 -> 135 00000100:00100000:1.0:1713507934.209117:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecba140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1840:x1796742877327168:12345-192.168.203.24@tcp:2:lfs.0 Request processed in 231us (285us total) trans 17179874163 rc 0/0 00002000:00010000:2.0:1713507934.209119:0:8141:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1713507934.209120:0:8141:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb mtime from disk: 1713507932 -> 1713507933 00000100:00100000:1.0:1713507934.209120:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12129 00002000:00010000:2.0:1713507934.209121:0:8141:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb atime from disk: 1713507933 -> 1713507933 00002000:00010000:2.0:1713507934.209122:0:8141:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb ctime from disk: 1713507932 -> 1713507935 00002000:00010000:2.0:1713507934.209123:0:8141:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1713507934.209134:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecb84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1840:x1796742877327360:12345-192.168.203.24@tcp:2:lfs.0 Request processed in 255us (322us total) trans 17179874164 rc 0/0 00000100:00100000:2.0:1713507934.209138:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12128 00000100:00100000:0.0:1713507934.209857:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.209947:0:15442:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327488 00000100:00100000:2.0:1713507934.209975:0:15442:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 10007 00000100:00100000:2.0:1713507934.209978:0:15442:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecbed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+143:23727:x1796742877327488:12345-192.168.203.24@tcp:35:lfs.0 00000004:00010000:2.0:1713507934.210004:0:15442:0:(mdt_open.c:2304:mdt_close_resync_done()) ### [0x200000402:0x4bc:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd8c0/0x209a6de5bc985af0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b690 expref: 143 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.210023:0:15442:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.210030:0:15442:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b697 expref: 143 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.210033:0:15442:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.210054:0:15442:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b697 expref: 143 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.210060:0:15442:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b697 expref: 143 pid: 13683 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.210066:0:15442:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c15580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:15442:1796742881318976:192.168.203.24@tcp:104: 00000100:00100000:2.0:1713507934.210096:0:15442:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009157dc00 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.210742:0:15442:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c15580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:15442:1796742881318976:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.210750:0:15442:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.210918:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.210955:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327552 00010000:00010000:3.0:1713507934.210967:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b697 expref: 144 pid: 13683 timeout: 537 lvb_type: 0 00000100:00100000:3.0:1713507934.210980:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7873 00000100:00100000:3.0:1713507934.210982:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917ad580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+144:1839:x1796742877327552:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 00010000:00010000:3.0:1713507934.210987:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507934.210993:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b697 expref: 144 pid: 13683 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.210999:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b697 expref: 144 pid: 13683 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.211007:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985b2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b697 expref: 144 pid: 13683 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.211013:0:6515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:3.0:1713507934.211015:0:6515:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.211019:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.211023:0:6515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.211043:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1713507934.211065:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917ad580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+143:1839:x1796742877327552:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 Request processed in 80us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.211072:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7873 00010000:00010000:2.0:1713507934.211106:0:15442:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.211114:0:15442:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1713507934.211826:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3482, 88 off259880 00000004:00080000:2.0:1713507934.211832:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339312693ns, next at 433063087189ns, rc = 0 00000040:00080000:2.0:1713507934.211878:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3483, 88 off259968 00000004:00080000:2.0:1713507934.211881:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339361345ns, next at 433063087189ns, rc = 0 00000040:00080000:2.0:1713507934.211937:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3491, 88 off260608 00000004:00080000:2.0:1713507934.211940:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339420583ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.211975:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3492, 88 off260696 00000004:00080000:2.0:1713507934.211978:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339458293ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.212014:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3484, 88 off260056 00000004:00080000:2.0:1713507934.212017:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339497390ns, next at 433063087189ns, rc = 0 00000040:00080000:2.0:1713507934.212043:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3485, 88 off260144 00000004:00080000:2.0:1713507934.212045:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339525850ns, next at 433063087189ns, rc = 0 00000040:00080000:2.0:1713507934.212081:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3493, 88 off260784 00000004:00080000:2.0:1713507934.212083:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339564015ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.212130:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3494, 88 off260872 00000004:00080000:2.0:1713507934.212132:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339613045ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.212168:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3495, 88 off260960 00000004:00080000:2.0:1713507934.212171:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339651341ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.212191:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3486, 88 off260232 00000004:00080000:2.0:1713507934.212193:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339673531ns, next at 433063087189ns, rc = 0 00000040:00080000:2.0:1713507934.212236:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3487, 88 off260320 00000004:00080000:2.0:1713507934.212238:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339718271ns, next at 433063087189ns, rc = 0 00000040:00080000:2.0:1713507934.212256:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3496, 88 off261048 00000004:00080000:2.0:1713507934.212257:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339738002ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.212280:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3497, 88 off261136 00000004:00080000:2.0:1713507934.212282:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339762586ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.212301:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3488, 88 off260408 00000004:00080000:2.0:1713507934.212303:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339783526ns, next at 433063087189ns, rc = 0 00000040:00080000:2.0:1713507934.212320:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3498, 88 off261224 00000004:00080000:2.0:1713507934.212322:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339802736ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.212339:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3489, 88 off260496 00000004:00080000:2.0:1713507934.212341:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339821349ns, next at 433063087189ns, rc = 0 00000040:00080000:2.0:1713507934.212358:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3490, 88 off260584 00000004:00080000:2.0:1713507934.212360:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339840394ns, next at 433063087189ns, rc = 0 00000040:00080000:2.0:1713507934.212377:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3499, 88 off261312 00000004:00080000:2.0:1713507934.212383:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339863246ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.212413:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].3500, 88 off261400 00000004:00080000:2.0:1713507934.212415:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437339895587ns, next at 433095107838ns, rc = 0 00000040:00080000:2.0:1713507934.212433:0:15442:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x8:0x0].3491, 88 off260672 00000004:00080000:2.0:1713507934.212435:0:15442:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437339915389ns, next at 433063087189ns, rc = 0 00010000:00010000:0.0:1713507934.217632:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1713507934.219920:0:15442:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88008ecbed40 reply state ffff88012dcabc00 transno 8589952738 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1713507934.219920:0:13083:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 8589952738 is committed 00000004:00080000:1.0:1713507934.219924:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1289 committed 00000004:00080000:1.0:1713507934.219929:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1291 committed 00010000:00010000:3.0:1713507934.219930:0:15442:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:3.0:1713507934.219932:0:15442:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1713507934.219932:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1290 committed 00000004:00080000:1.0:1713507934.219933:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1288 committed 00010000:00010000:3.0:1713507934.219934:0:15442:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd8c0/0x209a6de5bc985af0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4bc:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b690 expref: 142 pid: 13683 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1713507934.219934:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1287 committed 00000004:00080000:1.0:1713507934.219935:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1289 committed 00000004:00080000:1.0:1713507934.219936:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1286 committed 00000004:00080000:1.0:1713507934.219938:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1288 committed 00000004:00080000:1.0:1713507934.219939:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1287 committed 00000004:00080000:1.0:1713507934.219939:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1285 committed 00000004:00080000:1.0:1713507934.219940:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1284 committed 00000004:00080000:1.0:1713507934.219941:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1286 committed 00000004:00080000:1.0:1713507934.219946:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1285 committed 00000004:00080000:1.0:1713507934.219947:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1284 committed 00000004:00080000:1.0:1713507934.219948:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1283 committed 00000004:00080000:1.0:1713507934.219949:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1282 committed 00000004:00080000:1.0:1713507934.219950:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1283 committed 00000004:00080000:1.0:1713507934.219951:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1282 committed 00000004:00080000:1.0:1713507934.219952:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1281 committed 00000004:00080000:1.0:1713507934.219952:0:13083:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1280 committed 00000100:00100000:2.0:1713507934.219984:0:2867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881319168:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1713507934.219985:0:15442:0:(ldlm_lib.c:3334:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1713507934.219993:0:15442:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecbed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+141:23727:x1796742877327488:12345-192.168.203.24@tcp:35:lfs.0 Request processed in 10013us (10136us total) trans 8589952738 rc 0/0 00000100:00100000:3.0:1713507934.219998:0:15442:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 10007 00000100:00100000:2.0:1713507934.220010:0:2867:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713507934.220023:0:2867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917a8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881319424:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1713507934.220024:0:2851:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.220030:0:2851:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.220034:0:2867:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713507934.220034:0:2851:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.220038:0:2851:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09fa80 already unused, calling callback (ffffffffa134d360) 00000100:00100000:0.0:1713507934.220039:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917ac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319040:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1713507934.220040:0:2851:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.220041:0:2867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917a8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881319616:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1713507934.220044:0:2851:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.220050:0:2867:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1713507934.220050:0:2851:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009c687c00) 00010000:00010000:1.0:1713507934.220051:0:2851:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1713507934.220053:0:2851:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.220056:0:2851:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985b9f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4bc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.220059:0:2867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917a97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881319936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.220066:0:6954:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319168 00000100:00100000:0.0:1713507934.220068:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713507934.220071:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a19300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881319232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713507934.220079:0:6954:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319424 00000100:00100000:1.0:1713507934.220082:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319616 00000100:00100000:2.0:1713507934.220084:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.220085:0:6954:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319040 00000100:00100000:0.0:1713507934.220086:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917a84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.220091:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881319488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.220095:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319232 00000100:00100000:3.0:1713507934.220114:0:6954:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12132 00000100:00100000:3.0:1713507934.220118:0:6954:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:2867:x1796742881319168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.220123:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12133 00000100:00100000:0.0:1713507934.220123:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713507934.220127:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:2867:x1796742881319424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.220130:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319296 00000100:00100000:0.0:1713507934.220138:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.220142:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12134 00000100:00100000:2.0:1713507934.220145:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:2867:x1796742881319616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.220179:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713507934.220189:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a18980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.220204:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713507934.220214:0:2865:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1713507934.220219:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319104:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1713507934.220224:0:6954:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1713507934.220227:0:6954:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb mtime from disk: 1713507933 -> 1713507933 00002000:00010000:3.0:1713507934.220228:0:6954:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb atime from disk: 1713507933 -> 1713507933 00002000:00010000:3.0:1713507934.220230:0:6954:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb ctime from disk: 1713507935 -> 1713507935 00002000:00010000:3.0:1713507934.220231:0:6954:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x9cc:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:0.0:1713507934.220235:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1713507934.220236:0:15031:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb size from disk: 4493088 -> 4493088 00002000:00010000:1.0:1713507934.220239:0:15031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb mtime from disk: 1713507933 -> 1713507933 00002000:00010000:1.0:1713507934.220241:0:15031:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb atime from disk: 1713507933 -> 1713507933 00000100:00100000:0.0:1713507934.220241:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319360:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1713507934.220243:0:15031:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb ctime from disk: 1713507935 -> 1713507935 00002000:00010000:1.0:1713507934.220245:0:15031:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x9a9:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1713507934.220263:0:6954:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:2867:x1796742881319168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 145us (253us total) trans 17179874165 rc 0/0 00000100:00100000:0.0:1713507934.220265:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713507934.220267:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:2867:x1796742881319616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (216us total) trans 21474841395 rc 0/0 00000100:00100000:3.0:1713507934.220269:0:6954:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12132 00000100:00100000:2.0:1713507934.220273:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12134 00000100:00100000:0.0:1713507934.220277:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713507934.220279:0:6954:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319552 00000100:00100000:1.0:1713507934.220279:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:2867:x1796742881319424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (243us total) trans 21474841394 rc 0/0 00000100:00100000:2.0:1713507934.220283:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319872 00000100:00100000:3.0:1713507934.220286:0:6954:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319104 00000100:00100000:1.0:1713507934.220286:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12133 00000100:00100000:2.0:1713507934.220291:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319360 00000100:00100000:0.0:1713507934.220292:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.220294:0:6954:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12135 00000100:00100000:3.0:1713507934.220296:0:6954:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917aa140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:2865:x1796742881319040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.220298:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12136 00000100:00100000:2.0:1713507934.220301:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c163c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:2868:x1796742881319232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.220303:0:2865:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917a9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.220318:0:2865:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1713507934.220338:0:8540:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319680 00000100:00100000:0.0:1713507934.220353:0:8540:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319808 00000100:00100000:0.0:1713507934.220363:0:8540:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12137 00002000:00010000:3.0:1713507934.220364:0:6954:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb size from disk: 900320 -> 900320 00002000:00010000:3.0:1713507934.220366:0:6954:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb mtime from disk: 1713507933 -> 1713507933 00002000:00010000:3.0:1713507934.220367:0:6954:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb atime from disk: 1713507933 -> 1713507933 00000100:00100000:0.0:1713507934.220367:0:8540:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917aa600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:2865:x1796742881319296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1713507934.220368:0:6954:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb ctime from disk: 1713507935 -> 1713507935 00002000:00010000:3.0:1713507934.220373:0:6954:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x9a5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1713507934.220382:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12138 00000100:00100000:1.0:1713507934.220386:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917aaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:2865:x1796742881319552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1713507934.220387:0:8141:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb size from disk: 1735424 -> 1735424 00002000:00010000:2.0:1713507934.220389:0:8141:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb mtime from disk: 1713507933 -> 1713507933 00002000:00010000:2.0:1713507934.220391:0:8141:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb atime from disk: 1713507933 -> 1713507933 00002000:00010000:2.0:1713507934.220392:0:8141:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb ctime from disk: 1713507935 -> 1713507935 00002000:00010000:2.0:1713507934.220393:0:8141:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x9cd:0x0] updating lvb blocks from disk: 135 -> 135 00000100:00100000:3.0:1713507934.220396:0:6954:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917aa140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:2865:x1796742881319040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (329us total) trans 21474841396 rc 0/0 00000100:00100000:3.0:1713507934.220400:0:6954:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12135 00000100:00100000:3.0:1713507934.220410:0:6954:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12139 00000100:00100000:2.0:1713507934.220412:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c163c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:2868:x1796742881319232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (327us total) trans 17179874166 rc 0/0 00000100:00100000:3.0:1713507934.220413:0:6954:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917aaf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:2865:x1796742881319872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.220417:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12136 00000100:00100000:2.0:1713507934.220426:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12140 00000100:00100000:2.0:1713507934.220429:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917ab900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:2865:x1796742881319104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.220471:0:15146:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12141 00000100:00100000:3.0:1713507934.220473:0:15146:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917ac280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:2865:x1796742881319360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.220497:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917aaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:2865:x1796742881319552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (317us total) trans 17179874167 rc 0/0 00000100:00100000:1.0:1713507934.220501:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12138 00000100:00100000:2.0:1713507934.220502:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917ab900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:2865:x1796742881319104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (267us total) trans 21474841397 rc 0/0 00000100:00100000:2.0:1713507934.220506:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12140 00000100:00100000:1.0:1713507934.220510:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12142 00000100:00100000:1.0:1713507934.220512:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917acc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:2865:x1796742881319680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.220542:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12143 00000100:00100000:2.0:1713507934.220547:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917ad0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:2865:x1796742881319808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1713507934.220583:0:15146:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1713507934.220585:0:15146:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb mtime from disk: 1713507933 -> 1713507933 00002000:00010000:3.0:1713507934.220586:0:15146:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb atime from disk: 1713507933 -> 1713507933 00002000:00010000:3.0:1713507934.220587:0:15146:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb ctime from disk: 1713507935 -> 1713507935 00002000:00010000:3.0:1713507934.220589:0:15146:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x9ce:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1713507934.220606:0:15146:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917ac280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:2865:x1796742881319360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (342us total) trans 17179874169 rc 0/0 00000100:00100000:3.0:1713507934.220610:0:15146:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12141 00000100:00100000:1.0:1713507934.220617:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917acc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:2865:x1796742881319680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (324us total) trans 17179874170 rc 0/0 00000100:00100000:1.0:1713507934.220621:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12142 00000100:00100000:2.0:1713507934.220629:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713507934.220643:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a184c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881319744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.220644:0:6953:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319488 00000100:00100000:3.0:1713507934.220646:0:6954:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917aaf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:2865:x1796742881319872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 233us (442us total) trans 17179874168 rc 0/0 00002000:00010000:0.0:1713507934.220649:0:8540:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1713507934.220650:0:6954:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12139 00002000:00010000:0.0:1713507934.220653:0:8540:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb mtime from disk: 1713507933 -> 1713507933 00000100:00100000:1.0:1713507934.220655:0:6953:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12144 00000100:00100000:2.0:1713507934.220658:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1713507934.220660:0:8540:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb atime from disk: 1713507933 -> 1713507933 00000100:00100000:1.0:1713507934.220662:0:6953:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c15f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:2868:x1796742881319488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1713507934.220662:0:8540:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb ctime from disk: 1713507935 -> 1713507935 00000100:00100000:3.0:1713507934.220663:0:6954:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319744 00002000:00010000:0.0:1713507934.220663:0:8540:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x9a8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1713507934.220665:0:2868:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917a9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881320000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1713507934.220673:0:6954:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12145 00000100:00100000:2.0:1713507934.220675:0:2868:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.220676:0:6954:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c16d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:2868:x1796742881319744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.220691:0:8540:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917aa600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:2865:x1796742881319296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 322us (568us total) trans 21474841398 rc 0/0 00000004:00080000:2.0:1713507934.220692:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a19300/2, rc 0, transno 4982 00000100:00100000:2.0:1713507934.220697:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a19300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881319232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.220699:0:8540:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12137 00000100:00100000:2.0:1713507934.220708:0:15078:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881320000 00000100:00100000:2.0:1713507934.220719:0:15078:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12146 00000100:00100000:2.0:1713507934.220721:0:15078:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:2868:x1796742881320000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.220743:0:6953:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c15f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:2868:x1796742881319488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (113us total) trans 17179874171 rc 0/0 00000100:00100000:1.0:1713507934.220746:0:6953:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12144 00000100:00100000:1.0:1713507934.220771:0:2866:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1713507934.220775:0:6954:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c16d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:2868:x1796742881319744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (114us total) trans 17179874172 rc 0/0 00000100:00100000:1.0:1713507934.220777:0:2866:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881320064:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713507934.220781:0:6954:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12145 00000100:00100000:1.0:1713507934.220791:0:2866:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1713507934.220802:0:6954:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881320064 00000100:00100000:2.0:1713507934.220808:0:15078:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c16880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:2868:x1796742881320000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (132us total) trans 21474841400 rc 0/0 00000100:00100000:2.0:1713507934.220812:0:15078:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12146 00000100:00100000:2.0:1713507934.220821:0:15078:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12147 00000100:00100000:2.0:1713507934.220823:0:15078:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:2866:x1796742881320064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.220870:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.220886:0:15442:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327680 00000100:00100000:3.0:1713507934.220899:0:15442:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 10008 00000100:00100000:3.0:1713507934.220902:0:15442:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+140:23727:x1796742877327680:12345-192.168.203.24@tcp:35:lfs.0 00000004:00080000:0.0:1713507934.220905:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917a8000/2, rc 0, transno 4917 00000100:00100000:2.0:1713507934.220907:0:15078:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:2866:x1796742881320064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (114us total) trans 17179874173 rc 0/0 00000100:00100000:2.0:1713507934.220913:0:15078:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12147 00000100:00100000:0.0:1713507934.220913:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1713507934.220922:0:2866:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a1cc00/2, rc 0, transno 4989 00000004:00080000:0.0:1713507934.220924:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a1df00/2, rc 0, transno 4985 00000100:00100000:1.0:1713507934.220928:0:2866:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1cc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881320064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.220928:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.220932:0:2867:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1713507934.220936:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a18000/2, rc 0, transno 4986 00000100:00100000:0.0:1713507934.220939:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1713507934.220947:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917ac740/2, rc 0, transno 4916 00000100:00100000:1.0:1713507934.220948:0:2866:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881320128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1713507934.220949:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917ac740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319040:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1713507934.220951:0:2867:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917a8980/2, rc 0, transno 4914 00000100:00100000:2.0:1713507934.220954:0:2867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917a8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881319424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1713507934.220957:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917a84c0/2, rc 0, transno 4918 00000004:00080000:2.0:1713507934.220959:0:2867:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917a8e40/2, rc 0, transno 4915 00000100:00100000:0.0:1713507934.220960:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917a84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.220961:0:2867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917a8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881319616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.220963:0:2866:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1713507934.220967:0:2867:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a1d580/2, rc 0, transno 4981 00000100:00100000:2.0:1713507934.220969:0:2867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881319168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1713507934.220969:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a1c740/2, rc 0, transno 4983 00000100:00100000:0.0:1713507934.220972:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.220977:0:15146:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881319936 00000004:00080000:0.0:1713507934.220979:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a18980/2, rc 0, transno 4984 00000004:00080000:2.0:1713507934.220981:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a1f6c0/2, rc 0, transno 4987 00000100:00100000:0.0:1713507934.220982:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a18980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.220983:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881319488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1713507934.220986:0:15146:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881320128 00000004:00080000:2.0:1713507934.220987:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a184c0/2, rc 0, transno 4988 00000100:00100000:2.0:1713507934.220989:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a184c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881319744:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1713507934.220993:0:2868:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917a9c80/2, rc 0, transno 4920 00000100:00100000:1.0:1713507934.220993:0:15146:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12148 00000100:00100000:2.0:1713507934.220995:0:2868:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917a9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2868:1796742881320000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.220995:0:15146:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c17200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:2867:x1796742881319936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.221003:0:15078:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12149 00000100:00100000:2.0:1713507934.221005:0:15078:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a18e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:2866:x1796742881320128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1713507934.221016:0:15442:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+141:23727:x1796742877327680:12345-192.168.203.24@tcp:35:lfs.0 Request processed in 112us (148us total) trans 8589952739 rc 0/0 00000100:00100000:3.0:1713507934.221021:0:15442:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 10008 00000100:00100000:1.0:1713507934.221072:0:15146:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c17200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:2867:x1796742881319936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (140us total) trans 21474841401 rc 0/0 00000100:00100000:1.0:1713507934.221076:0:15146:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12148 00000100:00100000:0.0:1713507934.221077:0:2867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917adf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881320192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.221100:0:15078:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a18e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:2866:x1796742881320128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (136us total) trans 17179874174 rc 0/0 00000100:00100000:0.0:1713507934.221101:0:2867:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1713507934.221107:0:15078:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12149 00000004:00080000:1.0:1713507934.221108:0:2866:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff880099a1c280/2, rc 0, transno 4990 00000100:00100000:1.0:1713507934.221111:0:2866:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2866:1796742881320128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1713507934.221119:0:15078:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881320192 00000004:00080000:0.0:1713507934.221121:0:2867:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917a97c0/2, rc 0, transno 4921 00000100:00100000:2.0:1713507934.221130:0:15078:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12150 00000100:00100000:0.0:1713507934.221131:0:2867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917a97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881319936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.221132:0:15078:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917ae880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:2867:x1796742881320192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.221138:0:2867:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1713507934.221143:0:2867:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800917ae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881320256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.221186:0:2867:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1713507934.221198:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742881320256 00000100:00100000:1.0:1713507934.221210:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12151 00000100:00100000:1.0:1713507934.221212:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917aed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:2867:x1796742881320256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.221230:0:15078:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917ae880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:2867:x1796742881320192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (129us total) trans 21474841402 rc 0/0 00000100:00100000:2.0:1713507934.221234:0:15078:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12150 00000004:00080000:0.0:1713507934.221249:0:2867:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917adf00/2, rc 0, transno 4922 00000100:00100000:0.0:1713507934.221253:0:2867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917adf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881320192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1713507934.221273:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917ad0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:2865:x1796742881319808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 726us (955us total) trans 21474841399 rc 0/0 00000100:00100000:2.0:1713507934.221276:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12143 00000004:00080000:0.0:1713507934.221286:0:2865:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917a9300/2, rc 0, transno 4919 00000100:00100000:0.0:1713507934.221290:0:2865:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917a9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2865:1796742881319808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1713507934.221296:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917aed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:2867:x1796742881320256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (110us total) trans 21474841403 rc 0/0 00000004:00080000:2.0:1713507934.221307:0:2867:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800917ae3c0/2, rc 0, transno 4923 00000100:00100000:1.0:1713507934.221307:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12151 00000100:00100000:2.0:1713507934.221311:0:2867:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800917ae3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2867:1796742881320256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1713507934.228744:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.228788:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327808 00000100:00100000:3.0:1713507934.228809:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16842 00000100:00100000:3.0:1713507934.228813:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917af6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+141:23729:x1796742877327808:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.228850:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.228860:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd200/0x209a6de5bc985ba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b6f9 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.228918:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.228926:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.228931:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.228938:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.228941:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.228954:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229016:0:13683:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229020:0:13683:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229024:0:13683:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229027:0:13683:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdfcc0 already unused, calling callback (ffffffffa134d360) 00010000:00010000:3.0:1713507934.229028:0:13683:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229032:0:13683:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229037:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:3.0:1713507934.229038:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713507934.229040:0:13683:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229043:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdfcc0/0x209a6de5bc985bad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229049:0:13683:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229058:0:13683:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229062:0:13683:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229065:0:13683:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cded00 already unused, calling callback (ffffffffa134d360) 00010000:00010000:3.0:1713507934.229066:0:13683:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229069:0:13683:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229072:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc10ab304 (ffff8800b4a31100) 00010000:00010000:3.0:1713507934.229074:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713507934.229074:0:13683:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229077:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cded00/0x209a6de5bc985bb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229093:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd200/0x209a6de5bc985ba6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f9 expref: 142 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229097:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd200/0x209a6de5bc985ba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f9 expref: 142 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.229102:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cdd200, rc 0) 00000100:00100000:3.0:1713507934.229134:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917af6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+141:23729:x1796742877327808:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 320us (392us total) trans 0 rc 301/301 00000100:00100000:3.0:1713507934.229139:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16842 00000100:00100000:0.0:1713507934.230272:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.230318:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877327872 00000100:00100000:3.0:1713507934.230344:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16843 00000100:00100000:3.0:1713507934.230347:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917af200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+141:23729:x1796742877327872:12345-192.168.203.24@tcp:34:lfs.0 00010000:00010000:3.0:1713507934.230367:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230373:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230378:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230384:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230388:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230391:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230442:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230447:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230459:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713507934.230474:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x4bc:0x0]: returning size 8687392 00000004:00200000:3.0:1713507934.230475:0:13683:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1713507934.230480:0:13683:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230486:0:13683:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230489:0:13683:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230492:0:13683:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230495:0:13683:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdcb40 already unused, calling callback (ffffffffa134d360) 00010000:00010000:3.0:1713507934.230496:0:13683:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230499:0:13683:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230504:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:3.0:1713507934.230505:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713507934.230506:0:13683:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230509:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcb40/0x209a6de5bc985bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230536:0:13683:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230540:0:13683:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230543:0:13683:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230545:0:13683:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdf3c0 already unused, calling callback (ffffffffa134d360) 00010000:00010000:3.0:1713507934.230546:0:13683:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230549:0:13683:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230553:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc10ab304 (ffff8800b4a31b00) 00010000:00010000:3.0:1713507934.230554:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713507934.230555:0:13683:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230558:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf3c0/0x209a6de5bc985bc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230564:0:13683:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230567:0:13683:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230576:0:13683:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230579:0:13683:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdd440 already unused, calling callback (ffffffffa134d360) 00010000:00010000:3.0:1713507934.230580:0:13683:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230583:0:13683:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230587:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009182f200) 00010000:00010000:3.0:1713507934.230588:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713507934.230588:0:13683:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.230591:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd440/0x209a6de5bc985bc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.230625:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917af200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+141:23729:x1796742877327872:12345-192.168.203.24@tcp:34:lfs.0 Request processed in 277us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.230631:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16843 00000100:00100000:0.0:1713507934.244877:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.244942:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328000 00000100:00100000:3.0:1713507934.244975:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16844 00000100:00100000:3.0:1713507934.244980:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+141:23735:x1796742877328000:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.244993:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.245003:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985bd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b700 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245081:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245089:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245094:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245101:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245105:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245108:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245214:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985be5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245219:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985be5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245223:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985be5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713507934.245228:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x4bc:0x0]: returning size 8687392 00010000:00010000:3.0:1713507934.245289:0:13683:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245297:0:13683:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245301:0:13683:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245305:0:13683:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cde400 already unused, calling callback (ffffffffa134d360) 00010000:00010000:3.0:1713507934.245307:0:13683:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245310:0:13683:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245317:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89a4700) 00010000:00010000:3.0:1713507934.245319:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713507934.245321:0:13683:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245324:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde400/0x209a6de5bc985bd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245345:0:13683:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245349:0:13683:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245353:0:13683:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245363:0:13683:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdef40 already unused, calling callback (ffffffffa134d360) 00010000:00010000:3.0:1713507934.245364:0:13683:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245367:0:13683:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245372:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc10ab304 (ffff88009182fb00) 00010000:00010000:3.0:1713507934.245373:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1713507934.245374:0:13683:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245377:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdef40/0x209a6de5bc985bde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc10ab304 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245395:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdc000/0x209a6de5bc985bd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b700 expref: 144 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245402:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdcd80/0x209a6de5bc985be5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b700 expref: 143 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.245406:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009182fa00) 00010000:00010000:3.0:1713507934.245407:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1713507934.245408:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cdcd80, rc 0) 00000100:00100000:3.0:1713507934.245454:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+143:23735:x1796742877328000:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 472us (579us total) trans 8589952740 rc 0/0 00000100:00100000:3.0:1713507934.245461:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16844 00000100:00100000:0.0:1713507934.246920:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.246971:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328064 00000100:00100000:3.0:1713507934.247000:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16845 00000100:00100000:3.0:1713507934.247006:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+143:23735:x1796742877328064:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.247018:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.247025:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985bf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b707 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.247054:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde880/0x209a6de5bc985bfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.247061:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde880/0x209a6de5bc985bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.247068:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde880/0x209a6de5bc985bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713507934.247084:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x4bc:0x0]: returning size 8687392 00000004:00200000:3.0:1713507934.247087:0:13683:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1713507934.247094:0:13683:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde880/0x209a6de5bc985bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.247100:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde880/0x209a6de5bc985bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.247110:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdd680/0x209a6de5bc985bf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b707 expref: 145 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.247118:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde880/0x209a6de5bc985bfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b707 expref: 144 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.247131:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009182fa00) 00010000:00010000:3.0:1713507934.247133:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1713507934.247134:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cde880, rc 0) 00000100:00100000:3.0:1713507934.247192:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+144:23735:x1796742877328064:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 185us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.247199:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16845 00000100:00100000:0.0:1713507934.249973:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.250003:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.250027:0:8148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328192 00000100:00100000:2.0:1713507934.250070:0:8148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328320 00000100:00100000:1.0:1713507934.250076:0:19501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4060 00000100:00100000:1.0:1713507934.250081:0:19501:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1840:x1796742877328192:12345-192.168.203.24@tcp:3:lfs.0 00000100:00100000:2.0:1713507934.250093:0:8148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4061 00000100:00100000:2.0:1713507934.250099:0:8148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1840:x1796742877328320:12345-192.168.203.24@tcp:3:lfs.0 00010000:00010000:1.0:1713507934.250103:0:19501:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 3/1,0 mode: --/PR res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.250115:0:19501:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 2/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 20 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.250119:0:8148:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 3/1,0 mode: --/PR res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.250121:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713507934.250122:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713507934.250124:0:19501:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 4/1,0 mode: --/PR res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.250132:0:8148:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 2/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 28 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.250140:0:8148:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713507934.250141:0:8148:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713507934.250145:0:19501:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 3/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 20 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.250166:0:8148:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 4/1,0 mode: --/PR res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.250174:0:19501:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 4/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:1.0:1713507934.250185:0:19501:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1b900 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:19501:1796742881320320:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.250190:0:8148:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 3/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 28 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.250199:0:8148:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 4/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 28 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.250210:0:8148:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131c176c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8148:1796742881320384:192.168.203.24@tcp:104: 00000100:00100000:1.0:1713507934.250227:0:19501:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009195f240 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.250239:0:8148:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009157dd80 going to sleep for 6 seconds 00000100:00100000:2.0:1713507934.251246:0:8148:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131c176c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8148:1796742881320384:192.168.203.24@tcp:104: 00010000:00010000:2.0:1713507934.251264:0:8148:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 3/1,0 mode: --/PR res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.251264:0:19501:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1b900 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:19501:1796742881320320:192.168.203.24@tcp:104: 00010000:00010000:1.0:1713507934.251277:0:19501:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 3/1,0 mode: --/PR res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.251340:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.251372:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.251393:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328384 00000100:00100000:1.0:1713507934.251406:0:6513:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328448 00010000:00010000:3.0:1713507934.251410:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 4/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 29 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:1.0:1713507934.251423:0:6513:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 4/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 21 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:3.0:1713507934.251438:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7874 00000100:00100000:1.0:1713507934.251442:0:6513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7875 00000100:00100000:1.0:1713507934.251446:0:6513:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+21:1842:x1796742877328448:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 00000100:00100000:3.0:1713507934.251448:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1839:x1796742877328384:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1713507934.251451:0:6513:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1713507934.251456:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1713507934.251463:0:6513:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 4/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 21 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.251469:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 4/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 29 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:1.0:1713507934.251469:0:6513:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 3/0,0 mode: PW/PW res: [0x9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 21 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.251477:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 3/0,0 mode: PW/PW res: [0x9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 29 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:1.0:1713507934.251480:0:6513:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d042640/0x209a6de5bc985b75 lrc: 0/0,0 mode: --/PW res: [0x9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6cf expref: 21 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:3.0:1713507934.251489:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d043180/0x209a6de5bc985b7c lrc: 0/0,0 mode: --/PW res: [0x9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6d6 expref: 29 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:1.0:1713507934.251489:0:6513:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.251490:0:6513:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.251492:0:6513:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 3/1,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.251497:0:6513:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 4/1,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.251506:0:6513:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1713507934.251507:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.251509:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.251511:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 3/1,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.251542:0:6513:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1842:x1796742877328448:12345-192.168.203.24@tcp:103:ldlm_bl_04.0 Request processed in 96us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.251547:0:6513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7875 00010000:00010000:3.0:1713507934.251549:0:6515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 4/1,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.251559:0:19501:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 3/1,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.251565:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713507934.251568:0:19501:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 3/1,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.251575:0:8148:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 3/1,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.251583:0:8148:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 3/1,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.251586:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1839:x1796742877328384:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 Request processed in 142us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.251593:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7874 00000100:00100000:0.0:1713507934.251738:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.251780:0:19503:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328576 00000100:00100000:3.0:1713507934.251801:0:19503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4062 00000100:00100000:3.0:1713507934.251806:0:19503:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1839:x1796742877328576:12345-192.168.203.24@tcp:3:lfs.0 00010000:00010000:3.0:1713507934.251838:0:19503:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 3/1,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.251848:0:19503:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 2/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 29 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.251855:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713507934.251856:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713507934.251857:0:19503:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 4/1,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.251874:0:19503:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 3/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 29 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.251882:0:19503:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 4/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 29 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:3.0:1713507934.251903:0:19503:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:19503:1796742881320448:192.168.203.24@tcp:104: 00000100:00100000:3.0:1713507934.251949:0:19503:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5300 going to sleep for 6 seconds 00000100:00100000:3.0:1713507934.253182:0:19503:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:19503:1796742881320448:192.168.203.24@tcp:104: 00000100:00100000:0.0:1713507934.253184:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00010000:00010000:3.0:1713507934.253194:0:19503:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 3/1,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.253234:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328640 00010000:00010000:2.0:1713507934.253249:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 4/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 30 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.253274:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7876 00000100:00100000:2.0:1713507934.253278:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1f42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+30:1839:x1796742877328640:12345-192.168.203.24@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1713507934.253284:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713507934.253297:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 4/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 30 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.253303:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 3/0,0 mode: PW/PW res: [0x9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 30 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.253311:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a09c900/0x209a6de5bc985b83 lrc: 0/0,0 mode: --/PW res: [0x9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6dd expref: 30 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.253326:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.253327:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.253328:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 3/1,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.253332:0:6515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 4/1,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.253343:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713507934.253358:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1f42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1839:x1796742877328640:12345-192.168.203.24@tcp:103:ldlm_bl_01.0 Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.253361:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7876 00010000:00010000:3.0:1713507934.253363:0:19503:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 3/1,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.253370:0:19503:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 3/1,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.254995:0:19501:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 3/1,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.255008:0:19501:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 2/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.255034:0:19501:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713507934.255066:0:13607:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713507934.255071:0:13607:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 2/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.255078:0:13607:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d042880 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:2.0:1713507934.255080:0:13607:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 2/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.255082:0:19501:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371297c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1840:x1796742877328192:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 4999us (5109us total) trans 0 rc 901120/901120 00000100:00100000:1.0:1713507934.255091:0:19501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4060 00010000:00010000:2.0:1713507934.255093:0:13607:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 3/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.255104:0:13607:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 1/0,0 mode: --/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.255108:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d042880/0x209a6de5bc985c01 lrc: 0/0,0 mode: --/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.255118:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.255119:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.255120:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.255455:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.255549:0:19501:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328768 00000100:00100000:1.0:1713507934.255584:0:19501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4063 00000100:00100000:1.0:1713507934.255588:0:19501:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1839:x1796742877328768:12345-192.168.203.24@tcp:3:lfs.0 00010000:00010000:1.0:1713507934.255603:0:19501:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 3/1,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.255614:0:19501:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 2/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 19 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.255619:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713507934.255620:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713507934.255622:0:19501:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 4/1,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.255646:0:19501:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 3/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 19 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.255670:0:19501:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 4/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 19 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:1.0:1713507934.255677:0:19501:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1b900 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:19501:1796742881320512:192.168.203.24@tcp:104: 00000100:00100000:1.0:1713507934.255710:0:19501:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009195f240 going to sleep for 6 seconds 00010000:00010000:2.0:1713507934.257315:0:8148:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 3/1,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.257322:0:8148:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 2/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.257339:0:8148:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1713507934.257358:0:6517:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713507934.257362:0:6517:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 2/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.257370:0:6517:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09fa80 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:0.0:1713507934.257371:0:6517:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 2/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.257374:0:8148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013712b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1840:x1796742877328320:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 7275us (7370us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1713507934.257379:0:8148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4061 00010000:00010000:0.0:1713507934.257385:0:6517:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 3/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.257395:0:6517:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 1/0,0 mode: --/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.257398:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a09fa80/0x209a6de5bc985c08 lrc: 0/0,0 mode: --/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.257420:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.257421:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.257422:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.257887:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.257891:0:19501:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1b900 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:19501:1796742881320512:192.168.203.24@tcp:104: 00010000:00010000:1.0:1713507934.257906:0:19501:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 3/1,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.257934:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328832 00010000:00010000:2.0:1713507934.257949:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 4/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.257973:0:6515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7877 00000100:00100000:2.0:1713507934.257978:0:6515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f39c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1839:x1796742877328832:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1713507934.257991:0:6515:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713507934.258004:0:6515:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 4/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.258012:0:6515:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 3/0,0 mode: PW/PW res: [0x9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.258025:0:6515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a09f3c0/0x209a6de5bc985b8a lrc: 0/0,0 mode: --/PW res: [0x9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6e4 expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.258034:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.258036:0:6515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.258038:0:6515:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 3/1,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.258044:0:6515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 4/1,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.258058:0:6515:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713507934.258070:0:19501:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 3/1,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.258079:0:19501:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 3/1,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.258087:0:6515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f39c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1839:x1796742877328832:12345-192.168.203.24@tcp:103:ldlm_bl_03.0 Request processed in 108us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.258093:0:6515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7877 00010000:00010000:3.0:1713507934.259015:0:19503:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 3/1,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.259023:0:19503:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 2/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.259044:0:19503:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1713507934.259083:0:19503:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:1839:x1796742877328576:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 7274us (7344us total) trans 0 rc 688128/688128 00000100:00100000:3.0:1713507934.259092:0:19503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4062 00010000:00010000:2.0:1713507934.259116:0:8156:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713507934.259122:0:8156:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 2/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.259131:0:8156:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdc900 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:2.0:1713507934.259132:0:8156:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 2/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.259146:0:8156:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.259191:0:8156:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 1/0,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.259195:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131cdc900/0x209a6de5bc985c0f lrc: 0/0,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.259207:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.259208:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.259209:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.262906:0:19501:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 3/1,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.262918:0:19501:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 2/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.262942:0:19501:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1713507934.262964:0:6516:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713507934.262969:0:6516:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 2/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.262977:0:6516:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d040240 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:0.0:1713507934.262979:0:6516:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 2/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.262983:0:19501:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f397c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:1839:x1796742877328768:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 7393us (7529us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1713507934.262984:0:6516:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 3/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.262995:0:6516:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 1/0,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.262997:0:19501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4063 00010000:00010000:0.0:1713507934.262999:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d040240/0x209a6de5bc985c16 lrc: 0/0,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.263015:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.263016:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.263018:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.278591:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.278626:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.278690:0:19501:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877328960 00000100:00100000:3.0:1713507934.278723:0:19503:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329088 00000100:00100000:1.0:1713507934.278739:0:19501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4064 00000100:00100000:1.0:1713507934.278743:0:19501:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+18:1839:x1796742877328960:12345-192.168.203.24@tcp:3:lfs.0 00000100:00100000:3.0:1713507934.278760:0:19503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4065 00010000:00010000:1.0:1713507934.278764:0:19501:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 3/1,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.278765:0:19503:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+26:1839:x1796742877329088:12345-192.168.203.24@tcp:3:lfs.0 00010000:00010000:1.0:1713507934.278776:0:19501:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 2/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 18 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.278781:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713507934.278782:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1713507934.278784:0:19501:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 4/1,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.278792:0:19503:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 3/1,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.278802:0:19503:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 2/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 26 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.278804:0:19501:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 3/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 18 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.278807:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713507934.278808:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1713507934.278809:0:19503:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 4/1,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.278811:0:19501:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 4/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 18 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:1.0:1713507934.278819:0:19501:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099a1b900 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:19501:1796742881320576:192.168.203.24@tcp:104: 00010000:00010000:3.0:1713507934.278823:0:19503:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 3/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 26 pid: 19515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.278828:0:19503:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 4/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 26 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:3.0:1713507934.278834:0:19503:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:19503:1796742881320640:192.168.203.24@tcp:104: 00000100:00100000:1.0:1713507934.278858:0:19501:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009195f840 going to sleep for 6 seconds 00000100:00100000:0.0:1713507934.278860:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.278866:0:19503:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a4e5b40 going to sleep for 6 seconds 00000100:00100000:0.0:1713507934.278912:0:19502:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329216 00000100:00100000:0.0:1713507934.278928:0:19502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4066 00000100:00100000:0.0:1713507934.278931:0:19502:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f38980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1839:x1796742877329216:12345-192.168.203.24@tcp:3:lfs.0 00010000:00010000:0.0:1713507934.278941:0:19502:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 3/1,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.278947:0:19502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713507934.278948:0:19502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1713507934.278949:0:19502:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 3/1,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.278953:0:19502:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 3/1,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.279313:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.279415:0:8148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329344 00000100:00100000:2.0:1713507934.279447:0:8148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4067 00000100:00100000:2.0:1713507934.279450:0:8148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1839:x1796742877329344:12345-192.168.203.24@tcp:3:lfs.0 00010000:00010000:2.0:1713507934.279463:0:8148:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 3/1,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.279470:0:8148:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713507934.279471:0:8148:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1713507934.279472:0:8148:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 3/1,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.279488:0:8148:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 3/1,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.279680:0:19501:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099a1b900 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:19501:1796742881320576:192.168.203.24@tcp:104: 00000100:00100000:0.0:1713507934.279687:0:19503:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009049f6c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:19503:1796742881320640:192.168.203.24@tcp:104: 00010000:00010000:1.0:1713507934.279697:0:19501:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 3/1,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.279702:0:19503:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 3/1,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.279725:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.279745:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.279746:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329472 00010000:00010000:0.0:1713507934.279760:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 4/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 28 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:0.0:1713507934.279779:0:6515:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329408 00010000:00010000:0.0:1713507934.279784:0:6515:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 4/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00000100:00100000:2.0:1713507934.279786:0:15079:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7878 00000100:00100000:2.0:1713507934.279789:0:15079:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c14c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1840:x1796742877329472:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 00000100:00100000:1.0:1713507934.279796:0:6513:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 7879 00010000:00010000:2.0:1713507934.279797:0:15079:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1713507934.279802:0:6513:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c176c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1839:x1796742877329408:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1713507934.279811:0:15079:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 4/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 28 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:1.0:1713507934.279811:0:6513:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1713507934.279818:0:15079:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 3/0,0 mode: PW/PW res: [0x9ce:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 28 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:1.0:1713507934.279823:0:6513:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 4/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.279830:0:15079:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985b98 lrc: 0/0,0 mode: --/PW res: [0x9ce:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6f2 expref: 28 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:1.0:1713507934.279833:0:6513:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 3/0,0 mode: PW/PW res: [0x9a9:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.279839:0:15079:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.279840:0:15079:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.279841:0:15079:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 3/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.279844:0:6513:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985b91 lrc: 0/0,0 mode: --/PW res: [0x9a9:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b6eb expref: 20 pid: 19515 timeout: 537 lvb_type: 0 00010000:00010000:2.0:1713507934.279846:0:15079:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 4/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.279851:0:15079:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.279851:0:15079:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.279852:0:15079:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 3/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.279854:0:6513:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.279855:0:15079:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 4/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.279855:0:6513:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.279857:0:6513:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.279861:0:6513:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 4/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.279865:0:6513:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.279866:0:15079:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1713507934.279866:0:6513:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.279866:0:6513:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.279869:0:6513:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 4/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.279870:0:8148:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 3/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.279870:0:19503:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 3/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.279875:0:19503:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 3/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.279882:0:8148:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 3/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.279888:0:6513:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1713507934.279890:0:15079:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c14c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1840:x1796742877329472:12345-192.168.203.24@tcp:103:ldlm_bl_05.0 Request processed in 100us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.279895:0:15079:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7878 00000100:00100000:1.0:1713507934.279904:0:6513:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c176c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1839:x1796742877329408:12345-192.168.203.24@tcp:103:ldlm_bl_02.0 Request processed in 103us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.279909:0:6513:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 7879 00010000:00010000:2.0:1713507934.279917:0:19502:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.279921:0:19502:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.279922:0:19501:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.279926:0:19501:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.283304:0:19501:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.283315:0:19501:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.283333:0:19501:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713507934.283357:0:13607:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713507934.283361:0:13607:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.283362:0:19501:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1839:x1796742877328960:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 4617us (4773us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1713507934.283368:0:19501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4064 00010000:00010000:3.0:1713507934.283375:0:13607:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d041d40 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:3.0:1713507934.283377:0:13607:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.283381:0:13607:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.283391:0:13607:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 1/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.283394:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d041d40/0x209a6de5bc985c1d lrc: 0/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.283405:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.283406:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.283407:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.284835:0:19502:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.284844:0:19502:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.284864:0:19502:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1713507934.284888:0:6517:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713507934.284892:0:6517:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.284900:0:6517:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880092926d00 already unused, calling callback (ffffffffa080e1b0) 00000100:00100000:2.0:1713507934.284901:0:19502:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f38980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bc71eae4-4dba-4b1f-9a3b-55899db60475+17:1839:x1796742877329216:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 5968us (6040us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1713507934.284902:0:6517:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.284908:0:19502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4066 00010000:00010000:0.0:1713507934.284909:0:6517:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.284921:0:6517:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 1/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.284926:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092926d00/0x209a6de5bc985c2b lrc: 0/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.284943:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.284949:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.284950:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.286687:0:8148:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 3/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.286698:0:8148:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 2/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.286721:0:8148:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1713507934.286754:0:8156:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713507934.286758:0:8156:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 2/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.286763:0:8148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1839:x1796742877329344:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 7311us (7450us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1713507934.286766:0:8156:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09fcc0 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:2.0:1713507934.286768:0:8156:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 2/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.286771:0:8148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4067 00010000:00010000:2.0:1713507934.286775:0:8156:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.286797:0:8156:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 1/0,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.286803:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c32 lrc: 0/0,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.286825:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.286826:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.286828:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.290293:0:19503:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 3/1,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.290302:0:19503:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 2/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.290322:0:19503:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1713507934.290358:0:19503:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+25:1839:x1796742877329088:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 11592us (11732us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1713507934.290364:0:19503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4065 00010000:00010000:0.0:1713507934.290386:0:6516:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713507934.290391:0:6516:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 2/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.290399:0:6516:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdc6c0 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:0.0:1713507934.290401:0:6516:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 2/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.290406:0:6516:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.290417:0:6516:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 1/0,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.290421:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131cdc6c0/0x209a6de5bc985c24 lrc: 0/0,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.290434:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.290435:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.290436:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.308306:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.308325:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.308338:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.308353:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.308362:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.308364:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329536 00000100:00100000:2.0:1713507934.308373:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329600 00000100:00100000:0.0:1713507934.308383:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.308395:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329664 00000100:00100000:2.0:1713507934.308397:0:8141:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329728 00000100:00100000:3.0:1713507934.308403:0:8142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329792 00000100:00100000:1.0:1713507934.308404:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329856 00000100:00100000:2.0:1713507934.308410:0:8141:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12152 00000100:00100000:2.0:1713507934.308414:0:8141:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1842:x1796742877329536:12345-192.168.203.24@tcp:101:lfs.0 00000100:00100000:1.0:1713507934.308414:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12153 00000100:00100000:1.0:1713507934.308418:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1842:x1796742877329600:12345-192.168.203.24@tcp:101:lfs.0 00000100:00100000:0.0:1713507934.308418:0:15146:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12154 00000100:00100000:0.0:1713507934.308422:0:15146:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bc71eae4-4dba-4b1f-9a3b-55899db60475+27:1841:x1796742877329664:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:2.0:1713507934.308426:0:8141:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1713507934.308426:0:14149:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:3.0:1713507934.308430:0:8142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12155 00000100:00100000:3.0:1713507934.308433:0:8142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1842:x1796742877329728:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:0.0:1713507934.308433:0:15146:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1713507934.308437:0:8141:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c39 lrc: 2/0,0 mode: --/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b70e expref: -99 pid: 8141 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.308438:0:14149:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d043a80/0x209a6de5bc985c40 lrc: 2/0,0 mode: --/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b715 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.308439:0:8142:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1713507934.308440:0:15146:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092926ac0/0x209a6de5bc985c47 lrc: 2/0,0 mode: --/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b71c expref: -99 pid: 15146 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.308446:0:8142:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cdf180/0x209a6de5bc985c4e lrc: 2/0,0 mode: --/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b723 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1713507934.308452:0:14149:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9cc:0x0] initial LVB size: 1048576, mtime: 0x66220e5d, atime: 0x66220e5d, ctime: 0x66220e5f, blocks: 0x803 00002000:00010000:0.0:1713507934.308452:0:15146:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9cd:0x0] initial LVB size: 1735424, mtime: 0x66220e5d, atime: 0x66220e5d, ctime: 0x66220e5f, blocks: 0x87 00002000:00010000:3.0:1713507934.308456:0:8142:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9a8:0x0] initial LVB size: 2097152, mtime: 0x66220e5d, atime: 0x66220e5d, ctime: 0x66220e5f, blocks: 0x1 00002000:00010000:2.0:1713507934.308456:0:8141:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9a5:0x0] initial LVB size: 900320, mtime: 0x66220e5d, atime: 0x66220e5d, ctime: 0x66220e5f, blocks: 0x1 00010000:00010000:3.0:1713507934.308462:0:8142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.308462:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.308462:0:15146:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.308463:0:8141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.308464:0:8142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.308464:0:8141:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.308464:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.308464:0:15146:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.308470:0:8142:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cdf180/0x209a6de5bc985c4e lrc: 3/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b723 expref: 21 pid: 8142 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.308470:0:8141:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c39 lrc: 3/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b70e expref: 21 pid: 8141 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.308470:0:14149:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d043a80/0x209a6de5bc985c40 lrc: 3/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b715 expref: 29 pid: 14149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713507934.308470:0:15146:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092926ac0/0x209a6de5bc985c47 lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b71c expref: 29 pid: 15146 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713507934.308477:0:8142:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131cdf180/0x209a6de5bc985c4e lrc: 3/0,0 mode: PR/PR res: [0x9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b723 expref: 21 pid: 8142 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.308478:0:8141:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a09fcc0/0x209a6de5bc985c39 lrc: 3/0,0 mode: PR/PR res: [0x9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b70e expref: 21 pid: 8141 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.308478:0:14149:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d043a80/0x209a6de5bc985c40 lrc: 3/0,0 mode: PR/PR res: [0x9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b715 expref: 29 pid: 14149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713507934.308478:0:15146:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092926ac0/0x209a6de5bc985c47 lrc: 3/0,0 mode: PR/PR res: [0x9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b71c expref: 29 pid: 15146 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713507934.308482:0:8142:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cdf180, rc 0) 00010000:00010000:1.0:1713507934.308482:0:14149:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009d043a80, rc 0) 00010000:00010000:2.0:1713507934.308483:0:8141:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09fcc0, rc 0) 00010000:00010000:0.0:1713507934.308483:0:15146:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880092926ac0, rc 0) 00000100:00100000:3.0:1713507934.308505:0:8142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+21:1842:x1796742877329728:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 72us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.308505:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1842:x1796742877329600:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 88us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.308509:0:8142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12155 00000100:00100000:2.0:1713507934.308509:0:8141:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+21:1842:x1796742877329536:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 95us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.308512:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12153 00000100:00100000:0.0:1713507934.308513:0:15146:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1841:x1796742877329664:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 90us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.308515:0:8141:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12152 00000100:00100000:0.0:1713507934.308534:0:15146:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12154 00000100:00100000:3.0:1713507934.308536:0:8142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12156 00000100:00100000:3.0:1713507934.308539:0:8142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f384c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1842:x1796742877329856:12345-192.168.203.24@tcp:101:lfs.0 00000100:00100000:1.0:1713507934.308541:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12157 00010000:00010000:3.0:1713507934.308543:0:8142:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1713507934.308545:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+19:1841:x1796742877329792:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.308548:0:8142:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cddf80/0x209a6de5bc985c55 lrc: 2/0,0 mode: --/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b731 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.308551:0:14149:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:3.0:1713507934.308554:0:8142:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9ce:0x0] initial LVB size: 4194304, mtime: 0x66220e5d, atime: 0x66220e5d, ctime: 0x66220e5f, blocks: 0x1 00010000:00010000:1.0:1713507934.308558:0:14149:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d0406c0/0x209a6de5bc985c5c lrc: 2/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b72a expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.308560:0:8142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.308564:0:8142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.308567:0:8142:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cddf80/0x209a6de5bc985c55 lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b731 expref: 28 pid: 8142 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1713507934.308568:0:14149:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9a9:0x0] initial LVB size: 4493088, mtime: 0x66220e5d, atime: 0x66220e5d, ctime: 0x66220e5f, blocks: 0x807 00010000:00010000:3.0:1713507934.308573:0:8142:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131cddf80/0x209a6de5bc985c55 lrc: 3/0,0 mode: PR/PR res: [0x9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b731 expref: 28 pid: 8142 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.308575:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.308576:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.308577:0:8142:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cddf80, rc 0) 00010000:00010000:1.0:1713507934.308580:0:14149:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0406c0/0x209a6de5bc985c5c lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b72a expref: 20 pid: 14149 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1713507934.308588:0:8142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f384c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1842:x1796742877329856:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 49us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.308592:0:8142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12156 00010000:00010000:1.0:1713507934.308600:0:14149:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d0406c0/0x209a6de5bc985c5c lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b72a expref: 20 pid: 14149 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.308607:0:14149:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009d0406c0, rc 0) 00000100:00100000:1.0:1713507934.308630:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1841:x1796742877329792:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.308636:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12157 00000100:00100000:0.0:1713507934.309898:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.309996:0:19503:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877329984 00000100:00100000:2.0:1713507934.310027:0:19503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4068 00000100:00100000:2.0:1713507934.310030:0:19503:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1840:x1796742877329984:12345-192.168.203.24@tcp:3:lfs.0 00010000:00010000:2.0:1713507934.310044:0:19503:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 3/1,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.310050:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.310051:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.310053:0:19503:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.310059:0:19503:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.311579:0:19503:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 3/1,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.311586:0:19503:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.311603:0:19503:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1713507934.311628:0:19503:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1840:x1796742877329984:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 1597us (1731us total) trans 0 rc 298784/298784 00000100:00100000:2.0:1713507934.311633:0:19503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4068 00010000:00010000:3.0:1713507934.311658:0:13607:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713507934.311662:0:13607:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.311669:0:13607:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09f600 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:3.0:1713507934.311671:0:13607:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 2/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.311675:0:13607:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 3/0,0 mode: PR/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.311684:0:13607:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 1/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.311687:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a09f600/0x209a6de5bc985c63 lrc: 0/0,0 mode: --/PR res: [0x9a9:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.311696:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.311702:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.311703:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.313392:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.313431:0:19503:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877330112 00002000:00100000:2.0:1713507934.313446:0:19503:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x9a9:0x0] (4198400->4497407) req@ffff880091f3bdc0 x1796742877330112/t0(0) o3->bc71eae4-4dba-4b1f-9a3b-55899db60475@192.168.203.24@tcp:710/0 lens 488/0 e 0 to 0 dl 1713507940 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lfs.0' 00002000:00100000:2.0:1713507934.313453:0:19503:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff880091f3bdc0 with x1796742877330112 ext(4198400->4497407) 00002000:00010000:2.0:1713507934.313456:0:19503:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091f3bdc0 00000100:00100000:2.0:1713507934.313471:0:19503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4069 00000100:00100000:2.0:1713507934.313474:0:19503:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1842:x1796742877330112:12345-192.168.203.24@tcp:3:lfs.0 00000100:00100000:2.0:1713507934.315081:0:19503:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1842:x1796742877330112:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 1602us (1687us total) trans 0 rc 294912/294912 00000100:00100000:2.0:1713507934.315090:0:19503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4069 00002000:00100000:2.0:1713507934.315113:0:19503:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x9a9:0x0] (4198400->4497407) req@ffff880091f3bdc0 x1796742877330112/t0(0) o3->bc71eae4-4dba-4b1f-9a3b-55899db60475@192.168.203.24@tcp:710/0 lens 488/440 e 0 to 0 dl 1713507940 ref 1 fl Complete:/0/0 rc 294912/294912 job:'lfs.0' 00002000:00100000:2.0:1713507934.315120:0:19503:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff880091f3bdc0 with x1796742877330112 ext(4198400->4497407) 00002000:00010000:2.0:1713507934.315122:0:19503:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091f3bdc0 00000100:00100000:0.0:1713507934.319268:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.319345:0:13046:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877330240 00000100:00100000:3.0:1713507934.319373:0:13046:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 10009 00000100:00100000:3.0:1713507934.319376:0:13046:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+144:23735:x1796742877330240:12345-192.168.203.24@tcp:35:lfs.0 00000100:00100000:3.0:1713507934.319516:0:13046:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc71eae4-4dba-4b1f-9a3b-55899db60475+145:23735:x1796742877330240:12345-192.168.203.24@tcp:35:lfs.0 Request processed in 140us (250us total) trans 8589952741 rc 0/0 00000100:00100000:3.0:1713507934.319521:0:13046:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 10009 00000100:00100000:0.0:1713507934.327081:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.327184:0:13683:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877330368 00000100:00100000:3.0:1713507934.327214:0:13683:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 16846 00000100:00100000:3.0:1713507934.327218:0:13683:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+145:23738:x1796742877330368:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.327227:0:13683:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.327237:0:13683:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf840/0x209a6de5bc985c6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b738 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.327294:0:13683:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde1c0/0x209a6de5bc985c71 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.327302:0:13683:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde1c0/0x209a6de5bc985c71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.327307:0:13683:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde1c0/0x209a6de5bc985c71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13683 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1713507934.327314:0:13683:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x4bc:0x0]: returning size 8687392 00010000:00010000:3.0:1713507934.327365:0:13683:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131cdf840/0x209a6de5bc985c6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b738 expref: 148 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.327394:0:13683:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131cde1c0/0x209a6de5bc985c71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4bc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b738 expref: 147 pid: 13683 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.327405:0:13683:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4bc:0x0].0x0 (ffff88009182fa00) 00010000:00010000:3.0:1713507934.327407:0:13683:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1713507934.327408:0:13683:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cde1c0, rc 0) 00000100:00100000:3.0:1713507934.327439:0:13683:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc71eae4-4dba-4b1f-9a3b-55899db60475+147:23738:x1796742877330368:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 217us (358us total) trans 8589952742 rc 0/0 00000100:00100000:3.0:1713507934.327444:0:13683:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 16846 00000100:00100000:0.0:1713507934.330957:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.330981:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.330996:0:19503:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877330496 00000100:00100000:3.0:1713507934.331017:0:8148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877330624 00000100:00100000:2.0:1713507934.331033:0:19503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4070 00000100:00100000:2.0:1713507934.331037:0:19503:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1840:x1796742877330496:12345-192.168.203.24@tcp:3:lfs.0 00000100:00100000:3.0:1713507934.331049:0:8148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4071 00000100:00100000:3.0:1713507934.331052:0:8148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f38e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1840:x1796742877330624:12345-192.168.203.24@tcp:3:lfs.0 00002000:00010000:2.0:1713507934.331065:0:19503:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9ca:0x0] initial LVB size: 2097152, mtime: 0x66220e5b, atime: 0x66220e5a, ctime: 0x66220e5b, blocks: 0x1007 00010000:00010000:2.0:1713507934.331094:0:19503:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 3/1,0 mode: --/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.331104:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.331105:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.331106:0:8148:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 3/1,0 mode: --/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.331108:0:19503:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 3/1,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.331117:0:8148:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.331117:0:19503:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 3/1,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.331118:0:8148:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.331120:0:8148:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 3/1,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.331126:0:8148:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 3/1,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.331882:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.331927:0:19501:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877330752 00000100:00100000:2.0:1713507934.331961:0:19501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4072 00000100:00100000:2.0:1713507934.331966:0:19501:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a1b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+32:1840:x1796742877330752:12345-192.168.203.24@tcp:3:lfs.0 00002000:00010000:2.0:1713507934.332005:0:19501:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9cf:0x0] initial LVB size: 3123616, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1007 00010000:00010000:2.0:1713507934.332009:0:19501:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 3/1,0 mode: --/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.332016:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.332017:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.332019:0:19501:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 3/1,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.332026:0:19501:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 3/1,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.334919:0:8148:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 3/1,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.334928:0:8148:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 2/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.334944:0:8148:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1713507934.334960:0:6517:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713507934.334964:0:6517:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 2/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.334970:0:6517:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cdc240 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:0.0:1713507934.334975:0:6517:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 2/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.334979:0:6517:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 3/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.334985:0:8148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f38e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+32:1840:x1796742877330624:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 3931us (4003us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1713507934.334990:0:8148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4071 00010000:00010000:0.0:1713507934.334990:0:6517:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 1/0,0 mode: --/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.334993:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131cdc240/0x209a6de5bc985c86 lrc: 0/0,0 mode: --/PR res: [0x9ca:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.335007:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.335008:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.335009:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.335905:0:19503:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 3/1,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.335914:0:19503:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 2/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.335933:0:19503:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1713507934.335948:0:8156:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713507934.335952:0:8156:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 2/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.335958:0:8156:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09f840 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:0.0:1713507934.335959:0:8156:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 2/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.335963:0:8156:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 3/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.335970:0:19503:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+30:1840:x1796742877330496:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 4931us (5013us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1713507934.335973:0:8156:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 1/0,0 mode: --/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.335976:0:19503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4070 00010000:00010000:0.0:1713507934.335978:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c7f lrc: 0/0,0 mode: --/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.335996:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.335997:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.335998:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.337198:0:19501:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 3/1,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.337204:0:19501:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 2/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.337208:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00010000:00010000:2.0:1713507934.337219:0:19501:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1713507934.337241:0:19501:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a1b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1840:x1796742877330752:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 5275us (5361us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1713507934.337246:0:19501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4072 00010000:00010000:1.0:1713507934.337248:0:6516:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713507934.337252:0:6516:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 2/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.337260:0:19501:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877330880 00010000:00010000:1.0:1713507934.337260:0:6516:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09f3c0 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:1.0:1713507934.337262:0:6516:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 2/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.337269:0:6516:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 3/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.337281:0:6516:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 1/0,0 mode: --/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.337287:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a09f3c0/0x209a6de5bc985c8d lrc: 0/0,0 mode: --/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.337288:0:19501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4073 00000100:00100000:2.0:1713507934.337293:0:19501:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1839:x1796742877330880:12345-192.168.203.24@tcp:3:lfs.0 00010000:00010000:1.0:1713507934.337303:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.337309:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.337311:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1713507934.337322:0:19501:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9aa:0x0] initial LVB size: 2097152, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x807 00010000:00010000:2.0:1713507934.337327:0:19501:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 3/1,0 mode: --/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.337340:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.337341:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.337344:0:19501:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 3/1,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.337352:0:19501:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 3/1,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.340298:0:19501:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 3/1,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.340306:0:19501:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 2/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.340322:0:19501:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713507934.340342:0:13607:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713507934.340346:0:13607:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 2/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.340350:0:19501:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1839:x1796742877330880:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 3056us (3143us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1713507934.340353:0:13607:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09fa80 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:3.0:1713507934.340354:0:13607:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 2/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.340354:0:19501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4073 00010000:00010000:3.0:1713507934.340358:0:13607:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 3/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.340366:0:13607:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 1/0,0 mode: --/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.340370:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a09fa80/0x209a6de5bc985c94 lrc: 0/0,0 mode: --/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.340386:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.340387:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.340388:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.357109:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:2.0:1713507934.357206:0:19501:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331008 00000100:00100000:2.0:1713507934.357269:0:19501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4074 00000100:00100000:2.0:1713507934.357273:0:19501:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1842:x1796742877331008:12345-192.168.203.24@tcp:3:lfs.0 00002000:00010000:2.0:1713507934.357317:0:19501:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9cf:0x0] initial LVB size: 3123616, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1007 00010000:00010000:2.0:1713507934.357321:0:19501:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 3/1,0 mode: --/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.357327:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00010000:00010000:2.0:1713507934.357329:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.357330:0:19501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.357339:0:19501:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 3/1,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.357346:0:19501:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 3/1,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.357355:0:19503:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331136 00000100:00100000:1.0:1713507934.357384:0:19503:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4075 00000100:00100000:1.0:1713507934.357387:0:19503:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1842:x1796742877331136:12345-192.168.203.24@tcp:3:lfs.0 00002000:00010000:1.0:1713507934.357406:0:19503:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9aa:0x0] initial LVB size: 2097152, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x807 00010000:00010000:1.0:1713507934.357409:0:19503:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 3/1,0 mode: --/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.357415:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.357416:0:19503:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.357417:0:19503:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 3/1,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.357423:0:19503:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 3/1,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.357614:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.357649:0:8148:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331264 00000100:00100000:3.0:1713507934.357677:0:8148:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4076 00000100:00100000:3.0:1713507934.357680:0:8148:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f39300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+21:1842:x1796742877331264:12345-192.168.203.24@tcp:3:lfs.0 00002000:00010000:3.0:1713507934.357698:0:8148:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9ab:0x0] initial LVB size: 3123616, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1 00010000:00010000:3.0:1713507934.357701:0:8148:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 3/1,0 mode: --/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.357710:0:8148:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.357711:0:8148:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.357713:0:8148:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 3/1,0 mode: PR/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.357718:0:8148:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 3/1,0 mode: PR/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.358490:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.358505:0:19502:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331392 00000100:00100000:0.0:1713507934.358537:0:19241:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4077 00000100:00100000:0.0:1713507934.358541:0:19241:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ecbb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+30:1841:x1796742877331392:12345-192.168.203.24@tcp:3:lfs.0 00002000:00010000:0.0:1713507934.358560:0:19241:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9d0:0x0] initial LVB size: 2097152, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1 00010000:00010000:0.0:1713507934.358563:0:19241:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 3/1,0 mode: --/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.358568:0:19241:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.358569:0:19241:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.358571:0:19241:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 3/1,0 mode: PR/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.358576:0:19241:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 3/1,0 mode: PR/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360116:0:19503:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 3/1,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360123:0:19503:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 2/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360134:0:19503:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1713507934.360171:0:19503:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+21:1842:x1796742877331136:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 2782us (2845us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.360176:0:19503:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4075 00010000:00010000:1.0:1713507934.360240:0:6517:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713507934.360243:0:6517:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 2/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360248:0:6517:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d043cc0 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:1.0:1713507934.360250:0:6517:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 2/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360254:0:6517:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 3/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360263:0:6517:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 1/0,0 mode: --/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360266:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d043cc0/0x209a6de5bc985ca2 lrc: 0/0,0 mode: --/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19503 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360284:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.360284:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.360285:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.360566:0:19501:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 3/1,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.360571:0:19501:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 2/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.360584:0:19501:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1713507934.360599:0:8156:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1713507934.360602:0:8156:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 2/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1713507934.360603:0:19501:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1842:x1796742877331008:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 3330us (3499us total) trans 0 rc 1028096/1028096 00010000:00010000:1.0:1713507934.360607:0:8156:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a09f840 already unused, calling callback (ffffffffa080e1b0) 00000100:00100000:2.0:1713507934.360608:0:19501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4074 00010000:00010000:1.0:1713507934.360609:0:8156:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 2/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360612:0:8156:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 3/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360638:0:8156:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 1/0,0 mode: --/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360643:0:8156:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a09f840/0x209a6de5bc985c9b lrc: 0/0,0 mode: --/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.360654:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.360655:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.360656:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.364123:0:8148:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 3/1,0 mode: PR/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.364130:0:8148:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 2/0,0 mode: PR/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.364144:0:8148:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1713507934.364175:0:8148:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f39300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bc71eae4-4dba-4b1f-9a3b-55899db60475+20:1842:x1796742877331264:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 6494us (6562us total) trans 0 rc 0/0 00000100:00100000:3.0:1713507934.364179:0:8148:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4076 00010000:00010000:0.0:1713507934.364201:0:6516:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1713507934.364205:0:6516:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 2/0,0 mode: PR/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.364211:0:6516:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880131cddd40 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:0.0:1713507934.364212:0:6516:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 2/0,0 mode: PR/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.364221:0:6516:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 3/0,0 mode: PR/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.364230:0:6516:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 1/0,0 mode: --/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.364233:0:6516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131cddd40/0x209a6de5bc985ca9 lrc: 0/0,0 mode: --/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8148 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.364254:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.364255:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1713507934.364256:0:6516:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1713507934.365217:0:19241:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 3/1,0 mode: PR/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.365225:0:19241:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 2/0,0 mode: PR/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.365239:0:19241:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1713507934.365259:0:13607:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1713507934.365263:0:13607:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 2/0,0 mode: PR/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1713507934.365263:0:19241:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ecbb440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1841:x1796742877331392:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 6722us (6774us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.365267:0:19241:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4077 00010000:00010000:3.0:1713507934.365269:0:13607:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880092925d40 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:3.0:1713507934.365271:0:13607:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 2/0,0 mode: PR/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.365275:0:13607:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 3/0,0 mode: PR/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.365300:0:13607:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 1/0,0 mode: --/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.365303:0:13607:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092925d40/0x209a6de5bc985cb0 lrc: 0/0,0 mode: --/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.365323:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.365324:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1713507934.365325:0:13607:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.379498:0:2860:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:1.0:1713507934.379537:0:19241:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331520 00000100:00100000:1.0:1713507934.379568:0:19241:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 4078 00000100:00100000:1.0:1713507934.379571:0:19241:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091f3c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1839:x1796742877331520:12345-192.168.203.24@tcp:3:lfs.0 00002000:00010000:1.0:1713507934.379595:0:19241:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9d1:0x0] initial LVB size: 3123616, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1 00010000:00010000:1.0:1713507934.379598:0:19241:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 3/1,0 mode: --/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.379605:0:19241:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.379610:0:19241:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.379613:0:19241:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 3/1,0 mode: PR/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.379619:0:19241:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 3/1,0 mode: PR/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.381409:0:19241:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 3/1,0 mode: PR/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.381415:0:19241:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 2/0,0 mode: PR/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.381430:0:19241:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1713507934.381454:0:19241:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091f3c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+28:1839:x1796742877331520:12345-192.168.203.24@tcp:3:lfs.0 Request processed in 1882us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.381458:0:19241:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 4078 00010000:00010000:2.0:1713507934.381485:0:6517:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1713507934.381489:0:6517:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 2/0,0 mode: PR/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.381495:0:6517:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009d041680 already unused, calling callback (ffffffffa080e1b0) 00010000:00010000:2.0:1713507934.381497:0:6517:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 2/0,0 mode: PR/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.381501:0:6517:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 3/0,0 mode: PR/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.381510:0:6517:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 1/0,0 mode: --/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.381555:0:6517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d041680/0x209a6de5bc985cb7 lrc: 0/0,0 mode: --/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->4493311] (req 4194304->4493311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1713507934.381577:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.381578:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1713507934.381580:0:6517:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1713507934.383491:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.383510:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.383537:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:0.0:1713507934.383544:0:2859:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.383545:0:8142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331584 00000100:00100000:0.0:1713507934.383555:0:6953:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331712 00000100:00100000:1.0:1713507934.383559:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331648 00000100:00100000:3.0:1713507934.383567:0:8142:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331776 00000100:00100000:0.0:1713507934.383571:0:6953:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12158 00000100:00100000:0.0:1713507934.383574:0:6953:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eca3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1839:x1796742877331584:12345-192.168.203.24@tcp:101:lfs.0 00000100:00100000:1.0:1713507934.383577:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12159 00000100:00100000:3.0:1713507934.383581:0:8142:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12160 00000100:00100000:1.0:1713507934.383581:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eca4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+21:1839:x1796742877331712:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:0.0:1713507934.383581:0:6953:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:3.0:1713507934.383584:0:8142:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eca5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+29:1839:x1796742877331648:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:1.0:1713507934.383588:0:14149:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1713507934.383589:0:6953:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800929261c0/0x209a6de5bc985cbe lrc: 2/0,0 mode: --/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b73f expref: -99 pid: 6953 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.383590:0:8142:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.383595:0:8142:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cdfa80/0x209a6de5bc985ccc lrc: 2/0,0 mode: --/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b746 expref: -99 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1713507934.383595:0:14149:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d042ac0/0x209a6de5bc985cc5 lrc: 2/0,0 mode: --/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b74d expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1713507934.383599:0:6953:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9ca:0x0] initial LVB size: 2097152, mtime: 0x66220e5b, atime: 0x66220e5a, ctime: 0x66220e5b, blocks: 0x1007 00000100:00100000:2.0:1713507934.383602:0:15078:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12161 00002000:00010000:3.0:1713507934.383603:0:8142:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9cf:0x0] initial LVB size: 3123616, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1007 00002000:00010000:1.0:1713507934.383605:0:14149:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9aa:0x0] initial LVB size: 2097152, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x807 00000100:00100000:2.0:1713507934.383608:0:15078:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eca2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+22:1839:x1796742877331776:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:0.0:1713507934.383608:0:6953:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.383610:0:8142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.383610:0:8142:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.383612:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.383613:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.383613:0:6953:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1713507934.383626:0:15078:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.383627:0:8142:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdfa80/0x209a6de5bc985ccc lrc: 3/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b746 expref: 31 pid: 8142 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.383627:0:14149:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d042ac0/0x209a6de5bc985cc5 lrc: 3/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b74d expref: 22 pid: 14149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713507934.383627:0:6953:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800929261c0/0x209a6de5bc985cbe lrc: 3/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b73f expref: 31 pid: 6953 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1713507934.383634:0:8142:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131cdfa80/0x209a6de5bc985ccc lrc: 3/0,0 mode: PR/PR res: [0x9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b746 expref: 31 pid: 8142 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713507934.383634:0:6953:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800929261c0/0x209a6de5bc985cbe lrc: 3/0,0 mode: PR/PR res: [0x9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b73f expref: 31 pid: 6953 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.383635:0:15078:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a09f840/0x209a6de5bc985cd3 lrc: 2/0,0 mode: --/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b754 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1713507934.383638:0:8142:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cdfa80, rc 0) 00010000:00010000:0.0:1713507934.383639:0:6953:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800929261c0, rc 0) 00010000:00010000:1.0:1713507934.383643:0:14149:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d042ac0/0x209a6de5bc985cc5 lrc: 3/0,0 mode: PR/PR res: [0x9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b74d expref: 22 pid: 14149 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1713507934.383647:0:15078:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9ab:0x0] initial LVB size: 3123616, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1 00010000:00010000:1.0:1713507934.383648:0:14149:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009d042ac0, rc 0) 00010000:00010000:2.0:1713507934.383656:0:15078:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1713507934.383657:0:8142:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eca5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc71eae4-4dba-4b1f-9a3b-55899db60475+31:1839:x1796742877331648:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 72us (120us total) trans 0 rc 0/0 00010000:00010000:2.0:1713507934.383657:0:15078:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1713507934.383657:0:6953:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eca3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bc71eae4-4dba-4b1f-9a3b-55899db60475+31:1839:x1796742877331584:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1713507934.383661:0:6953:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12158 00000100:00100000:3.0:1713507934.383663:0:8142:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12160 00010000:00010000:2.0:1713507934.383663:0:15078:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a09f840/0x209a6de5bc985cd3 lrc: 3/0,0 mode: PR/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b754 expref: 23 pid: 15078 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713507934.383663:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eca4280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+23:1839:x1796742877331712:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 81us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.383667:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12159 00010000:00010000:2.0:1713507934.383673:0:15078:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a09f840/0x209a6de5bc985cd3 lrc: 3/0,0 mode: PR/PR res: [0x9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b754 expref: 22 pid: 15078 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1713507934.383681:0:15078:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a09f840, rc 0) 00000100:00100000:0.0:1713507934.383684:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.383700:0:15031:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331840 00000100:00100000:2.0:1713507934.383702:0:15078:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eca2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bc71eae4-4dba-4b1f-9a3b-55899db60475+22:1839:x1796742877331776:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1713507934.383708:0:15078:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12161 00000100:00100000:0.0:1713507934.383708:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00000100:00100000:3.0:1713507934.383711:0:15031:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12162 00000100:00100000:3.0:1713507934.383713:0:15031:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eca6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+30:1839:x1796742877331840:12345-192.168.203.24@tcp:101:lfs.0 00000100:00100000:1.0:1713507934.383714:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331904 00010000:00010000:3.0:1713507934.383717:0:15031:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1713507934.383722:0:15031:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131cdc480/0x209a6de5bc985cda lrc: 2/0,0 mode: --/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b75b expref: -99 pid: 15031 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1713507934.383726:0:2858:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.24@tcp (source: 12345-192.168.203.24@tcp) 00002000:00010000:3.0:1713507934.383728:0:15031:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9d0:0x0] initial LVB size: 2097152, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1 00000100:00100000:1.0:1713507934.383731:0:14149:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1796742877331968 00010000:00010000:3.0:1713507934.383734:0:15031:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.383735:0:15031:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1713507934.383737:0:15031:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131cdc480/0x209a6de5bc985cda lrc: 3/0,0 mode: PR/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b75b expref: 32 pid: 15031 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1713507934.383739:0:14149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12163 00000100:00100000:1.0:1713507934.383741:0:14149:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eca04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+32:1839:x1796742877331904:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:3.0:1713507934.383742:0:15031:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131cdc480/0x209a6de5bc985cda lrc: 3/0,0 mode: PR/PR res: [0x9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b75b expref: 32 pid: 15031 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.383745:0:14149:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1713507934.383746:0:19515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.24@tcp, seq: 12164 00010000:00010000:3.0:1713507934.383747:0:15031:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880131cdc480, rc 0) 00000100:00100000:0.0:1713507934.383749:0:19515:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eca4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+22:1840:x1796742877331968:12345-192.168.203.24@tcp:101:lfs.0 00010000:00010000:1.0:1713507934.383750:0:14149:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d043cc0/0x209a6de5bc985ce1 lrc: 2/0,0 mode: --/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b762 expref: -99 pid: 14149 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1713507934.383754:0:19515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:1.0:1713507934.383756:0:14149:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x9d1:0x0] initial LVB size: 3123616, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1 00000100:00100000:3.0:1713507934.383758:0:15031:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eca6d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bc71eae4-4dba-4b1f-9a3b-55899db60475+32:1839:x1796742877331840:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 44us (74us total) trans 0 rc 0/0 00010000:00010000:0.0:1713507934.383759:0:19515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092924b40/0x209a6de5bc985ce8 lrc: 2/0,0 mode: --/PR res: [0x9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf38f62fea158b769 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1713507934.383761:0:15031:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12162 00010000:00010000:1.0:1713507934.383761:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.383762:0:14149:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.383766:0:14149:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d043cc0/0x209a6de5bc985ce1 lrc: 3/0,0 mode: PR/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b762 expref: 32 pid: 14149 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1713507934.383768:0:19515:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x9ac:0x0] initial LVB size: 2097152, mtime: 0x66220e5b, atime: 0x0, ctime: 0x66220e5b, blocks: 0x1 00010000:00010000:0.0:1713507934.383773:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1713507934.383774:0:14149:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d043cc0/0x209a6de5bc985ce1 lrc: 3/0,0 mode: PR/PR res: [0x9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b762 expref: 32 pid: 14149 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713507934.383774:0:19515:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1713507934.383777:0:19515:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092924b40/0x209a6de5bc985ce8 lrc: 3/0,0 mode: PR/PR res: [0x9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b769 expref: 23 pid: 19515 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1713507934.383780:0:14149:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009d043cc0, rc 0) 00010000:00010000:0.0:1713507934.383783:0:19515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092924b40/0x209a6de5bc985ce8 lrc: 3/0,0 mode: PR/PR res: [0x9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->16777215) gid 0 flags: 0x40000000000000 nid: 192.168.203.24@tcp remote: 0xf38f62fea158b769 expref: 23 pid: 19515 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1713507934.383794:0:19515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880092924b40, rc 0) 00000100:00100000:1.0:1713507934.383802:0:14149:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eca04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc71eae4-4dba-4b1f-9a3b-55899db60475+32:1839:x1796742877331904:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 59us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1713507934.383808:0:14149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12163 00000100:00100000:0.0:1713507934.383808:0:19515:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eca4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bc71eae4-4dba-4b1f-9a3b-55899db60475+23:1840:x1796742877331968:12345-192.168.203.24@tcp:101:lfs.0 Request processed in 58us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1713507934.383811:0:19515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.24@tcp, seq: 12164 00000400:00000080:3.0:1713507934.800045:0:19924:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1713507934.800050:0:19924:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200: @@@@@@ FAIL: checksum error for mirror 2 00000001:00100000:3.0:1713507935.068465:0:2495:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ca88ec92-e358-41d9-8ccb-5b2a7c736474 00000001:00080000:3.0:1713507935.068477:0:2495:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 17179874146 is committed 00000001:00080000:3.0:1713507935.068497:0:2495:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 17179874116 is committed 00000001:00080000:3.0:1713507935.068507:0:2495:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 17179874171 is committed 00000001:00080000:3.0:1713507935.068512:0:2495:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 17179874163 is committed 00000001:00080000:3.0:1713507935.068558:0:2495:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 17179874174 is committed 00000001:00080000:3.0:1713507935.068564:0:2495:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 17179874164 is committed 00000001:00100000:3.0:1713507935.068571:0:2495:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8 00000001:00080000:3.0:1713507935.068575:0:2495:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 17179874151 is committed 00000020:00000080:3.0:1713507935.068623:0:2495:0:(genops.c:985:class_export_put()) final put ffff88008fa37000/3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8 00000020:00000080:3.0:1713507935.068640:0:2495:0:(genops.c:985:class_export_put()) final put ffff88008fa35000/ca88ec92-e358-41d9-8ccb-5b2a7c736474 00000020:00000080:3.0:1713507935.068646:0:65:0:(genops.c:944:class_export_destroy()) destroying export ffff88008fa37000/3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8 for lustre-OST0001 00000020:00020000:3.0:1713507935.068665:0:65:0:(tgt_grant.c:257:tgt_grant_sanity_check()) ofd_destroy_export: tot_granted 46465024 != fo_tot_granted 49872896 00000020:00020000:3.0:1713507935.068667:0:65:0:(tgt_grant.c:260:tgt_grant_sanity_check()) ofd_destroy_export: tot_pending 1703936 != fo_tot_pending 5111808 00000020:00000080:3.0:1713507935.068671:0:65:0:(genops.c:944:class_export_destroy()) destroying export ffff88008fa35000/ca88ec92-e358-41d9-8ccb-5b2a7c736474 for lustre-OST0001 00000020:00020000:3.0:1713507935.068682:0:65:0:(tgt_grant.c:257:tgt_grant_sanity_check()) ofd_destroy_export: tot_granted 46465024 != fo_tot_granted 49872896 00000020:00020000:3.0:1713507935.068683:0:65:0:(tgt_grant.c:260:tgt_grant_sanity_check()) ofd_destroy_export: tot_pending 1703936 != fo_tot_pending 5111808 00000020:00000080:3.0:1713507935.068685:0:65:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008fa35800 for lustre-OST0001 00000020:00000080:3.0:1713507935.068688:0:65:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008fa30000 for lustre-OST0001 00000001:00080000:3.0:1713507935.076499:0:516:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 21474841398 is committed 00000001:00080000:3.0:1713507935.076507:0:516:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 21474841391 is committed 00000001:00080000:3.0:1713507935.076516:0:516:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 21474841366 is committed 00000001:00080000:3.0:1713507935.076538:0:516:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 21474841335 is committed 00000001:00080000:3.0:1713507935.076547:0:516:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 21474841403 is committed 00000001:00080000:3.0:1713507935.076551:0:516:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 21474841392 is committed 00000001:00080000:3.0:1713507935.076571:0:516:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 21474841341 is committed 00000001:00080000:3.0:1713507935.076586:0:516:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 21474841393 is committed 00000001:00100000:3.0:1713507935.076590:0:516:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ca88ec92-e358-41d9-8ccb-5b2a7c736474 00000001:00100000:3.0:1713507935.076595:0:516:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8 00000020:00000080:3.0:1713507935.076614:0:516:0:(genops.c:985:class_export_put()) final put ffff88009172d800/3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8 00000001:00080000:3.0:1713507935.076626:0:516:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 21474841343 is committed 00000020:00000080:3.0:1713507935.076658:0:516:0:(genops.c:985:class_export_put()) final put ffff88009172d000/ca88ec92-e358-41d9-8ccb-5b2a7c736474 00000020:00000080:3.0:1713507935.076663:0:65:0:(genops.c:944:class_export_destroy()) destroying export ffff88009172d800/3328f6e7-0e3b-4fc2-8bdc-b3db5d9b22b8 for lustre-OST0000 00000020:00000080:3.0:1713507935.076679:0:65:0:(genops.c:944:class_export_destroy()) destroying export ffff88009172d000/ca88ec92-e358-41d9-8ccb-5b2a7c736474 for lustre-OST0000 00000020:00000080:3.0:1713507935.076691:0:65:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff880091729800 for lustre-OST0000 00000020:00000080:3.0:1713507935.076694:0:65:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff880091728800 for lustre-OST0000 00010000:00010000:1.0:1713507935.219753:0:8156:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 2781 lines, 2781 kept, 0 dropped, 0 bad.