Jobsub ID 292861.5@dunegpschedd02.fnal.gov
| Jobsub ID | 292861.5@dunegpschedd02.fnal.gov |
| Workflow ID | 12170 |
| Stage ID | 1 |
| User name | lwhite86@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 3600 (1 hours) |
| Submitted time | 2026-01-21 15:04:52 |
| Site | UK_QMUL |
| Entry | DUNE_UK_London_QMUL_arcce02 |
| Last heartbeat | 2026-01-21 15:15:03 |
| From worker node | Hostname | cn036.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 15:05:39 |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1412_260_20230826T153305Z_gen_g4_detsim_hitreco__20240112T201958Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 6m (414s) |
| CPU time | 5m (354s = 85%) |
| Max RSS bytes | 1525411840 (1454 MiB) |
| Outputting started | 2026-01-21 15:12:33 |
| Output files | |
| Finished | 2026-01-21 15:15:03 |
| Saved logs | justin-logs:292861.5-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0.000433692
TrackPID: 2212, 0.000117406, 0.00232149, 0.997074, 0.000486918
Begin processing the 75th record. run: 1412 subRun: 1 event: 26075 at 21-Jan-2026 15:10:55 GMT
TrackPID: 13, 0.997438, 0.0020273, 0.000464556, 7.01874e-05
Begin processing the 76th record. run: 1412 subRun: 1 event: 26076 at 21-Jan-2026 15:11:01 GMT
TrackPID: 2212, 0.670581, 0.130061, 0.194748, 0.00461079
TrackPID: 13, 0.817042, 0.131717, 0.0481621, 0.00307893
TrackPID: 211, 0.0601955, 0.554254, 0.379278, 0.00627295
Begin processing the 77th record. run: 1412 subRun: 1 event: 26077 at 21-Jan-2026 15:11:04 GMT
TrackPID: 2212, 0.00180309, 0.0191821, 0.975978, 0.00303688
TrackPID: 211, 0.277467, 0.48149, 0.231364, 0.00967949
TrackPID: 2212, 0.000162815, 0.00267481, 0.996455, 0.000707749
TrackPID: 2212, 7.32283e-05, 0.0030236, 0.996254, 0.000649522
TrackPID: 2212, 0.000178006, 0.0022518, 0.99697, 0.000600152
TrackPID: 211, 0.0713554, 0.655688, 0.259126, 0.01383
TrackPID: 2212, 0.000663131, 0.245755, 0.739621, 0.01396
Begin processing the 78th record. run: 1412 subRun: 1 event: 26078 at 21-Jan-2026 15:11:22 GMT
TrackPID: 2212, 0.000111159, 0.00184274, 0.997377, 0.000668718
TrackPID: 13, 0.998591, 0.00100382, 0.000366423, 3.85573e-05
TrackPID: 211, 0.209177, 0.182935, 0.599346, 0.00854165
Begin processing the 79th record. run: 1412 subRun: 1 event: 26079 at 21-Jan-2026 15:11:26 GMT
TrackPID: 211, 0.222458, 0.456766, 0.31053, 0.0102458
TrackPID: 13, 0.0370361, 0.124707, 0.831106, 0.00715061
Begin processing the 80th record. run: 1412 subRun: 1 event: 26080 at 21-Jan-2026 15:11:28 GMT
TrackPID: 211, 0.0104047, 0.801355, 0.160601, 0.0276388
TrackPID: 2212, 0.00889443, 0.372881, 0.608718, 0.00950698
TrackPID: 2212, 0.0309113, 0.866327, 0.0885613, 0.0142007
TrackPID: 2212, 0.000111084, 0.00119103, 0.998236, 0.000462005
TrackPID: 2212, 0.000173559, 0.00376139, 0.995053, 0.00101253
TrackPID: 2212, 8.96909e-05, 0.00433174, 0.995059, 0.000519787
TrackPID: 13, 0.0812887, 0.888823, 0.0253516, 0.00453625
TrackPID: 2212, 0.000109762, 0.00215558, 0.997242, 0.000493039
Begin processing the 81st record. run: 1412 subRun: 1 event: 26081 at 21-Jan-2026 15:11:31 GMT
TrackPID: 2212, 0.000227088, 0.00220197, 0.996688, 0.000882601
TrackPID: 211, 0.405452, 0.419842, 0.165262, 0.00944399
TrackPID: 2212, 0.000223669, 0.00211071, 0.997119, 0.000546839
TrackPID: 13, 0.999733, 0.000164043, 9.35528e-05, 9.06336e-06
Begin processing the 82nd record. run: 1412 subRun: 1 event: 26082 at 21-Jan-2026 15:11:35 GMT
TrackPID: 13, 0.474981, 0.358139, 0.15594, 0.0109397
TrackPID: 2212, 9.06916e-05, 0.00259761, 0.996847, 0.000464829
TrackPID: -211, 0.089972, 0.731675, 0.166193, 0.0121602
TrackPID: 211, 0.0352236, 0.660412, 0.275476, 0.0288879
TrackPID: 211, 0.0518042, 0.783513, 0.155769, 0.00891391
Begin processing the 83rd record. run: 1412 subRun: 1 event: 26083 at 21-Jan-2026 15:11:39 GMT
TrackPID: -13, 0.996087, 0.00230742, 0.00148825, 0.000117351
Begin processing the 84th record. run: 1412 subRun: 1 event: 26084 at 21-Jan-2026 15:11:41 GMT
TrackPID: -13, 0.0695163, 0.421089, 0.501387, 0.00800699
TrackPID: 2212, 0.00059074, 0.00652413, 0.991584, 0.00130087
TrackPID: 13, 0.0672185, 0.29024, 0.632799, 0.00974242
TrackPID: 2212, 0.000439905, 0.0168755, 0.979652, 0.00303262
Begin processing the 85th record. run: 1412 subRun: 1 event: 26085 at 21-Jan-2026 15:11:44 GMT
TrackPID: 22, 0.0157947, 0.647615, 0.32839, 0.00820052
Begin processing the 86th record. run: 1412 subRun: 1 event: 26086 at 21-Jan-2026 15:11:47 GMT
TrackPID: 22, 0.101835, 0.650238, 0.241405, 0.00652312
TrackPID: 2212, 0.000251452, 0.00287232, 0.995511, 0.0013652
Begin processing the 87th record. run: 1412 subRun: 1 event: 26087 at 21-Jan-2026 15:11:49 GMT
TrackPID: 2212, 0.000424528, 0.0046321, 0.993466, 0.0014774
TrackPID: 211, 0.276069, 0.568391, 0.132464, 0.0230761
TrackPID: -11, 0.10819, 0.604782, 0.281366, 0.00566198
TrackPID: 2212, 0.00370005, 0.0532338, 0.938411, 0.00465484
Begin processing the 88th record. run: 1412 subRun: 1 event: 26088 at 21-Jan-2026 15:11:52 GMT
TrackPID: -211, 0.0209093, 0.387516, 0.577991, 0.0135837
TrackPID: 13, 0.999464, 0.000327882, 0.000183077, 2.53974e-05
TrackPID: 22, 0.0266824, 0.424991, 0.534873, 0.0134535
Begin processing the 89th record. run: 1412 subRun: 1 event: 26089 at 21-Jan-2026 15:11:55 GMT
TrackPID: 22, 0.090283, 0.66702, 0.235938, 0.00675871
TrackPID: 13, 0.200895, 0.592712, 0.202288, 0.00410522
TrackPID: 13, 0.999752, 0.000207822, 2.02255e-05, 1.94927e-05
TrackPID: 211, 0.0459024, 0.743251, 0.195671, 0.015175
TrackPID: 2212, 9.52417e-05, 0.00260135, 0.996494, 0.00080919
Begin processing the 90th record. run: 1412 subRun: 1 event: 26090 at 21-Jan-2026 15:12:00 GMT
TrackPID: 13, 0.184902, 0.62846, 0.178792, 0.00784544
Begin processing the 91st record. run: 1412 subRun: 1 event: 26091 at 21-Jan-2026 15:12:01 GMT
TrackPID: 211, 0.0155957, 0.343238, 0.626887, 0.0142792
TrackPID: 13, 0.209764, 0.664292, 0.119873, 0.00607082
TrackPID: -211, 0.146202, 0.661864, 0.178151, 0.0137823
Begin processing the 92nd record. run: 1412 subRun: 1 event: 26092 at 21-Jan-2026 15:12:03 GMT
TrackPID: 211, 0.0760375, 0.775781, 0.136089, 0.0120925
TrackPID: 2212, 0.0190874, 0.31776, 0.659097, 0.00405588
TrackPID: -211, 0.126069, 0.606474, 0.259678, 0.00777889
TrackPID: 2212, 0.000438908, 0.0124833, 0.986177, 0.000901029
TrackPID: 13, 0.999683, 0.000225699, 8.18955e-05, 9.54972e-06
Begin processing the 93rd record. run: 1412 subRun: 1 event: 26093 at 21-Jan-2026 15:12:07 GMT
TrackPID: 22, 0.176738, 0.583104, 0.234915, 0.00524284
TrackPID: 2212, 0.00105915, 0.0105445, 0.986236, 0.00216027
Begin processing the 94th record. run: 1412 subRun: 1 event: 26094 at 21-Jan-2026 15:12:10 GMT
TrackPID: 2212, 0.0178515, 0.0700979, 0.903336, 0.00871507
TrackPID: 13, 0.901789, 0.0702052, 0.0261232, 0.00188275
TrackPID: -211, 0.280986, 0.477068, 0.231242, 0.0107043
Begin processing the 95th record. run: 1412 subRun: 1 event: 26095 at 21-Jan-2026 15:12:16 GMT
TrackPID: 13, 0.43364, 0.470932, 0.0892022, 0.00622575
Begin processing the 96th record. run: 1412 subRun: 1 event: 26096 at 21-Jan-2026 15:12:19 GMT
TrackPID: 2212, 0.0132187, 0.668287, 0.308909, 0.00958515
TrackPID: 2212, 7.34182e-05, 0.00383222, 0.995547, 0.000547731
TrackPID: 13, 0.150691, 0.664413, 0.178557, 0.00633897
Begin processing the 97th record. run: 1412 subRun: 1 event: 26097 at 21-Jan-2026 15:12:21 GMT
TrackPID: 13, 0.185293, 0.771344, 0.0394185, 0.00394493
Begin processing the 98th record. run: 1412 subRun: 1 event: 26098 at 21-Jan-2026 15:12:25 GMT
Begin processing the 99th record. run: 1412 subRun: 1 event: 26099 at 21-Jan-2026 15:12:27 GMT
PandoraContentApi::GetList(*this, m_trackPfoListName, pTrackPfoList) return STATUS_CODE_NOT_INITIALIZED
in function: GetAllTrackFeatures
in file: /exp/dune/app/users/lwhite86/DUNE-FD/pandoraPID/srcs/larpandoracontent/larpandoradlcontent/LArTrackShowerId/DlTrackCharacterisationAlgorithm.cc line#: 223
Begin processing the 100th record. run: 1412 subRun: 1 event: 26100 at 21-Jan-2026 15:12:28 GMT
TrackPID: 13, 0.999899, 7.20337e-05, 2.56672e-05, 3.77236e-06
TrackPID: 2212, 6.46942e-05, 0.00238578, 0.996918, 0.000631122
TrackPID: 2212, 1.98531e-05, 0.00396848, 0.995051, 0.000960604
21-Jan-2026 15:12:31 GMT Closed output file "nu_dune10kt_1x2x6_1412_260_20230826T153305Z_gen_g4_detsim_hitreco__20240112T201958Z_reco2_reco2.root"
21-Jan-2026 15:12:31 GMT Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/47/04/nu_dune10kt_1x2x6_1412_260_20230826T153305Z_gen_g4_detsim_hitreco__20240112T201958Z_reco2.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 1.44076 3.02981 17.7735 2.23091 2.85149 100
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0277972 0.0488617 0.0597241 0.0514384 0.00727114 100
reco:pandora2:StandardPandora 1.389 2.97894 17.7198 2.18 2.85207 100
[art]:TriggerResults:TriggerResultInserter 1.3522e-05 3.27616e-05 0.000447959 2.27895e-05 4.64732e-05 100
end_path:out1:RootOutput 2.401e-06 3.25438e-06 1.5785e-05 3.042e-06 1.35137e-06 100
end_path:out1:RootOutput(write) 0.000187005 0.00180477 0.0126319 0.000634117 0.00232819 100
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 2508.9 MB
Peak resident set size usage (VmHWM): 1525.41 MB
====================================================================================================
Art has completed and will exit with status 0.
lar exit code 0
total 412
-rw-r--r-- 1 pildune22 pildune 210 Jan 21 15:05 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune 0 Jan 21 15:06 debugprod.log
-rw-r--r-- 1 pildune22 pildune 57223 Jan 21 15:12 jobscript.log
-rw-r--r-- 1 pildune22 pildune 174 Jan 21 15:12 justin-processed-pfns.txt
drwxr-xr-x 4 pildune22 pildune 48 Jan 21 15:05 larpandoracontent
-rw-r--r-- 1 pildune22 pildune 350911 Jan 21 15:12 nu_dune10kt_1x2x6_1412_260_20230826T153305Z_gen_g4_detsim_hitreco__20240112T201958Z_reco2_reco2.root
-rw-r--r-- 1 pildune22 pildune 519 Jan 21 15:12 reco2_hist.root 