Jobsub ID 302096.139@dunegpschedd01.fnal.gov
| Jobsub ID | 302096.139@dunegpschedd01.fnal.gov |
| Workflow ID | 12511 |
| Stage ID | 1 |
| User name | imawby@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 1048576000 (1000 MiB) |
| Wall seconds limit | 7200 (2 hours) |
| Submitted time | 2026-01-29 10:37:51 |
| Site | UK_Edinburgh |
| Entry | DUNE_UK_SGridECDF_ce1_multicore |
| Last heartbeat | 2026-01-29 10:48:51 |
| From worker node | Hostname | node2b04.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 1048576000 (1000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-29 10:39:41 |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1100_29_20230826T033409Z_gen_g4_detsim_hitreco__20240229T173819Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 8m (530s) |
| CPU time | 5m (309s = 58%) |
| Max RSS bytes | 1234534400 (1177 MiB) |
| Outputting started | 2026-01-29 10:48:33 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/kalmanAlg_CHECK_nu_0/fnal/12511/1/001/ClusterValidation_WithAlg_nu_dune10kt_1x2x6_1100_29_20230826T033409Z_gen_g4_detsim_hitreco__20240229T173819Z_reco2.root
|
| Finished | 2026-01-29 10:48:51 |
| Saved logs | justin-logs:302096.139-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x17b52580.
[2026-01-29 10:48:29.356050 +0000][Debug ][File ][ 1261] [0xb33a670@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/45/ad/nu_dune10kt_1x2x6_1100_29_20230826T033409Z_gen_g4_detsim_hitreco__20240229T173819Z_reco2.root?xrdcl.requuid=57dde3b0-e1b8-4029-b92b-d333856e53c0] Sending a read command for handle 0x0 to ceph-svc31.gridpp.rl.ac.uk:1094
[2026-01-29 10:48:29.356098 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] MsgHandler created: 0x1889ced0 (message: kXR_read (handle: 0x00000000, offset: 166915, size: 132) ).
[2026-01-29 10:48:29.356170 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0x1889ced0 (message: kXR_read (handle: 0x00000000, offset: 166915, size: 132) ) from out-queu to in-queue.
[2026-01-29 10:48:29.398360 +0000][Debug ][ExDbgMsg ][ 1261] [msg: 0x1c1688a0] Assigned MsgHandler: 0x1889ced0.
[2026-01-29 10:48:29.398381 +0000][Debug ][ExDbgMsg ][ 1261] [handler: 0x1889ced0] Removed MsgHandler: 0x1889ced0 from the in-queue.
[2026-01-29 10:48:29.398441 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0x1889ced0 (message: kXR_read (handle: 0x00000000, offset: 166915, size: 132) ) with status: [SUCCESS] .
[2026-01-29 10:48:29.398476 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x1889ced0.
[2026-01-29 10:48:29.398527 +0000][Debug ][File ][ 1261] [0xb33a670@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/45/ad/nu_dune10kt_1x2x6_1100_29_20230826T033409Z_gen_g4_detsim_hitreco__20240229T173819Z_reco2.root?xrdcl.requuid=57dde3b0-e1b8-4029-b92b-d333856e53c0] Sending a read command for handle 0x0 to ceph-svc31.gridpp.rl.ac.uk:1094
[2026-01-29 10:48:29.398552 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] MsgHandler created: 0x1889ced0 (message: kXR_read (handle: 0x00000000, offset: 167047, size: 138) ).
[2026-01-29 10:48:29.398608 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0x1889ced0 (message: kXR_read (handle: 0x00000000, offset: 167047, size: 138) ) from out-queu to in-queue.
[2026-01-29 10:48:29.412600 +0000][Debug ][ExDbgMsg ][ 1261] [msg: 0x1c168910] Assigned MsgHandler: 0x1889ced0.
[2026-01-29 10:48:29.412626 +0000][Debug ][ExDbgMsg ][ 1261] [handler: 0x1889ced0] Removed MsgHandler: 0x1889ced0 from the in-queue.
[2026-01-29 10:48:29.412671 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0x1889ced0 (message: kXR_read (handle: 0x00000000, offset: 167047, size: 138) ) with status: [SUCCESS] .
[2026-01-29 10:48:29.412694 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x1889ced0.
[2026-01-29 10:48:29.412736 +0000][Debug ][File ][ 1261] [0xb33a670@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/45/ad/nu_dune10kt_1x2x6_1100_29_20230826T033409Z_gen_g4_detsim_hitreco__20240229T173819Z_reco2.root?xrdcl.requuid=57dde3b0-e1b8-4029-b92b-d333856e53c0] Sending a read command for handle 0x0 to ceph-svc31.gridpp.rl.ac.uk:1094
[2026-01-29 10:48:29.412760 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] MsgHandler created: 0x1889de80 (message: kXR_read (handle: 0x00000000, offset: 158223, size: 2127) ).
[2026-01-29 10:48:29.412808 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0x1889de80 (message: kXR_read (handle: 0x00000000, offset: 158223, size: 2127) ) from out-queu to in-queue.
[2026-01-29 10:48:29.450343 +0000][Debug ][ExDbgMsg ][ 1261] [msg: 0x1c168910] Assigned MsgHandler: 0x1889de80.
[2026-01-29 10:48:29.450370 +0000][Debug ][ExDbgMsg ][ 1261] [handler: 0x1889de80] Removed MsgHandler: 0x1889de80 from the in-queue.
[2026-01-29 10:48:29.450406 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0x1889de80 (message: kXR_read (handle: 0x00000000, offset: 158223, size: 2127) ) with status: [SUCCESS] .
[2026-01-29 10:48:29.450429 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x1889de80.
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
29-Jan-2026 10:48:31 GMT Closed output file "nu_dune10kt_1x2x6_1100_29_20230826T033409Z_gen_g4_detsim_hitreco__20240229T173819Z_reco2_reco2.root"
[2026-01-29 10:48:31.794692 +0000][Debug ][File ][ 1261] [0xb33a670@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/45/ad/nu_dune10kt_1x2x6_1100_29_20230826T033409Z_gen_g4_detsim_hitreco__20240229T173819Z_reco2.root?xrdcl.requuid=57dde3b0-e1b8-4029-b92b-d333856e53c0] Sending a close command for handle 0x0 to ceph-svc31.gridpp.rl.ac.uk:1094
[2026-01-29 10:48:31.794826 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] MsgHandler created: 0x13506e10 (message: kXR_close (handle: 0x00000000) ).
[2026-01-29 10:48:31.795020 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Moving MsgHandler: 0x13506e10 (message: kXR_close (handle: 0x00000000) ) from out-queu to in-queue.
[2026-01-29 10:48:31.810407 +0000][Debug ][ExDbgMsg ][ 1261] [msg: 0xb034470] Assigned MsgHandler: 0x13506e10.
[2026-01-29 10:48:31.810437 +0000][Debug ][ExDbgMsg ][ 1261] [handler: 0x13506e10] Removed MsgHandler: 0x13506e10 from the in-queue.
[2026-01-29 10:48:31.810487 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Calling MsgHandler: 0x13506e10 (message: kXR_close (handle: 0x00000000) ) with status: [SUCCESS] .
[2026-01-29 10:48:31.810526 +0000][Debug ][File ][ 1261] [0xb33a670@root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/45/ad/nu_dune10kt_1x2x6_1100_29_20230826T033409Z_gen_g4_detsim_hitreco__20240229T173819Z_reco2.root?xrdcl.requuid=57dde3b0-e1b8-4029-b92b-d333856e53c0] Close returned from ceph-svc31.gridpp.rl.ac.uk:1094 with: [SUCCESS]
[2026-01-29 10:48:31.810548 +0000][Debug ][ExDbgMsg ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Destroying MsgHandler: 0x13506e10.
29-Jan-2026 10:48:31 GMT Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/45/ad/nu_dune10kt_1x2x6_1100_29_20230826T033409Z_gen_g4_detsim_hitreco__20240229T173819Z_reco2.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 2.04773 3.13558 23.0929 2.51732 2.43987 100
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0292034 0.152517 0.430489 0.142909 0.0592924 100
reco:pandora:StandardPandora 1.92171 2.97431 22.7091 2.35843 2.40744 100
[art]:TriggerResults:TriggerResultInserter 1.1442e-05 1.94313e-05 5.9172e-05 1.66775e-05 9.09583e-06 100
end_path:out1:RootOutput 2.057e-06 2.58746e-06 1.0013e-05 2.408e-06 8.19333e-07 100
end_path:out1:RootOutput(write) 0.000956193 0.00859656 0.0652119 0.00605179 0.00869132 100
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 2216.97 MB
Peak resident set size usage (VmHWM): 1234.53 MB
====================================================================================================
Art has completed and will exit with status 0.
[2026-01-29 10:48:32.244574 +0000][Debug ][JobMgr ][ 1261] Stopping the job manager...
[2026-01-29 10:48:32.245767 +0000][Debug ][JobMgr ][ 1261] Job manager stopped
[2026-01-29 10:48:32.246567 +0000][Debug ][TaskMgr ][ 1261] Stopping the task manager...
[2026-01-29 10:48:32.246851 +0000][Debug ][TaskMgr ][ 1261] Task manager stopped
[2026-01-29 10:48:32.246959 +0000][Debug ][Poller ][ 1261] Stopping the poller...
[2026-01-29 10:48:32.247216 +0000][Debug ][AsyncSock ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094.0] Closing the socket
[2026-01-29 10:48:32.247240 +0000][Debug ][Poller ][ 1261] <[::ffff:192.41.105.37]:56020><--><[::ffff:130.246.177.50]:1094> Removing socket from the poller
[2026-01-29 10:48:32.247400 +0000][Debug ][PostMaster ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094] Destroying stream
[2026-01-29 10:48:32.247539 +0000][Debug ][AsyncSock ][ 1261] [ceph-svc31.gridpp.rl.ac.uk:1094.0] Closing the socket
[2026-01-29 10:48:32.247599 +0000][Debug ][AsyncSock ][ 1261] [xrootd.echo.stfc.ac.uk:1094.0] Closing the socket
[2026-01-29 10:48:32.247612 +0000][Debug ][Poller ][ 1261] <[::ffff:192.41.105.37]:40504><--><[::ffff:130.246.217.9]:1094> Removing socket from the poller
[2026-01-29 10:48:32.247699 +0000][Debug ][PostMaster ][ 1261] [xrootd.echo.stfc.ac.uk:1094] Destroying stream
[2026-01-29 10:48:32.247723 +0000][Debug ][AsyncSock ][ 1261] [xrootd.echo.stfc.ac.uk:1094.0] Closing the socket
=== End last 100 lines of lar log file ===
