justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255292.142@dunegpschedd01.fnal.gov

Jobsub ID255292.142@dunegpschedd01.fnal.gov
Workflow ID10515
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-22 11:31:33
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2025-11-22 14:30:02
From worker nodeHostnamewn1904240.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-22 11:33:31
Input filesvd-protodune:np02vd_raw_run039305_0454_df-s03-d3_dw_0_20250905T102050.hdf5
vd-protodune:np02vd_raw_run039305_0056_df-s03-d0_dw_0_20250904T163315.hdf5
vd-protodune:np02vd_raw_run039305_0235_df-s01-d3_dw_0_20250905T005804.hdf5
vd-protodune:np02vd_raw_run039305_0345_df-s04-d0_dw_0_20250905T044047.hdf5
vd-protodune:np02vd_raw_run039305_0386_df-s01-d3_dw_0_20250905T060544.hdf5
vd-protodune:np02vd_raw_run039305_0209_df-s03-d3_dw_0_20250905T000628.hdf5
vd-protodune:np02vd_raw_run039305_0308_df-s02-d1_dw_0_20250905T032402.hdf5
vd-protodune:np02vd_raw_run039305_0235_df-s04-d2_dw_0_20250905T005832.hdf5
vd-protodune:np02vd_raw_run039305_0050_df-s05-d1_dw_0_20250904T161856.hdf5
vd-protodune:np02vd_raw_run039305_0076_df-s05-d1_dw_0_20250904T174933.hdf5
vd-protodune:np02vd_raw_run039305_0077_df-s04-d0_dw_0_20250904T175253.hdf5
vd-protodune:np02vd_raw_run039305_0226_df-s03-d2_dw_0_20250905T004046.hdf5
vd-protodune:np02vd_raw_run039305_0265_df-s05-d5_dw_0_20250905T015848.hdf5
vd-protodune:np02vd_raw_run039305_0267_df-s01-d3_dw_0_20250905T020305.hdf5
vd-protodune:np02vd_raw_run039305_0071_df-s03-d0_dw_0_20250904T173704.hdf5
vd-protodune:np02vd_raw_run039305_0042_df-s04-d2_dw_0_20250904T160039.hdf5
vd-protodune:np02vd_raw_run039305_0428_df-s05-d1_dw_0_20250905T081903.hdf5
vd-protodune:np02vd_raw_run039305_0327_df-s03-d3_dw_0_20250905T040156.hdf5
vd-protodune:np02vd_raw_run039305_0111_df-s02-d2_dw_0_20250904T191527.hdf5
vd-protodune:np02vd_raw_run039305_0051_df-s02-d2_dw_0_20250904T162058.hdf5
JobscriptExit code0
Real time2h (10564s)
CPU time3m (194s = 1%)
Max RSS bytes1086287872 (1035 MiB)
Outputting started2025-11-22 14:29:37
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39305/fnal/10515/1/001/pdhd_255292_142_1_20251122T113350Z_beam_hist.root
Finished2025-11-22 14:30:02
Saved logsjustin-logs:255292.142-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2570
103 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2570
125 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2572


%MSG
Got 3 Fibers before Fix
After Fix 2
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2594
XBPF021660 has 2 active fibers at time 0

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2596
15 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2596
75 
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2598


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2602
Getting all trio-wise hits

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2603
N1,N2,N3 1 6 2

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 0 0

%MSG
87 9 15
-0.0085000000000000006106 -0.086499999999999993561 -0.080500000000000002109
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 0 1

%MSG
87 9 75
-0.0085000000000000006106 -0.086499999999999993561 -0.02050000000000000086
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 1 0

%MSG
87 59 15
-0.0085000000000000006106 -0.036499999999999997724 -0.080500000000000002109
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 1 1

%MSG
87 59 75
-0.0085000000000000006106 -0.036499999999999997724 -0.02050000000000000086
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 2 0

%MSG
87 70 15
-0.0085000000000000006106 -0.025499999999999998362 -0.080500000000000002109
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 2 1

%MSG
87 70 75
-0.0085000000000000006106 -0.025499999999999998362 -0.02050000000000000086
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 3 0

%MSG
87 74 15
-0.0085000000000000006106 -0.021499999999999998279 -0.080500000000000002109
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 3 1

%MSG
87 74 75
-0.0085000000000000006106 -0.021499999999999998279 -0.02050000000000000086
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 4 0

%MSG
87 103 15
-0.0085000000000000006106 0.0074999999999999997224 -0.080500000000000002109
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 4 1

%MSG
87 103 75
-0.0085000000000000006106 0.0074999999999999997224 -0.02050000000000000086
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 5 0

%MSG
87 125 15
-0.0085000000000000006106 0.029499999999999998446 -0.080500000000000002109
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:2631
	0 5 1

%MSG
87 125 75
-0.0085000000000000006106 0.029499999999999998446 -0.02050000000000000086
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 22-Nov-2025 14:29:34 GMT  run: 39305 subRun: 1 event: 49424 BeamEvent_module.cc:1256
Got NRecoBeamMomenta: 12

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 1
TOF, P: 76.404296875 -1
22-Nov-2025 14:29:36 GMT  Closed output file "pdhd_255292_142_1_20251122T113350Z_beam.root"
22-Nov-2025 14:29:36 GMT  Closed output file "pdhd_255292_142_1_20251122T113350Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.177102       10.3453       1528.44       0.19146       70.0181        950    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.4126e-05    2.62088e-05   0.000201418   2.40455e-05   1.18138e-05      950    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0434499     0.0559114      2.07182       0.04697      0.0774159       950    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0219753     0.0229772     0.0736496     0.0225523     0.0032974       950    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.109011       0.11661      0.493647      0.111503      0.0199888       950    
produce:beamevent:BeamEvent                      0.000337835     10.1487       1528.26     0.00351221      70.0191        950    
[art]:TriggerResults:TriggerResultInserter       1.1021e-05    2.1718e-05    8.5701e-05    2.0118e-05    7.45876e-06      950    
end_path:out1:RootOutput                          2.945e-06    5.13009e-06   3.5026e-05     4.739e-06    2.5713e-06       950    
end_path:out1:RootOutput(write)                  0.000188905   0.000534512   0.00683475    0.000375451   0.000498915      950    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.177102       10.3453       1528.44       0.19146       70.0181        950    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.4126e-05    2.62088e-05   0.000201418   2.40455e-05   1.18138e-05      950    
produce:triggerrawdecoder:PDVDTriggerReader4      0.0434499     0.0559114      2.07182       0.04697      0.0774159       950    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0219753     0.0229772     0.0736496     0.0225523     0.0032974       950    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.109011       0.11661      0.493647      0.111503      0.0199888       950    
produce:beamevent:BeamEvent                      0.000337835     10.1487       1528.26     0.00351221      70.0191        950    
[art]:TriggerResults:TriggerResultInserter       1.1021e-05    2.1718e-05    8.5701e-05    2.0118e-05    7.45876e-06      950    
end_path:out1:RootOutput                          2.945e-06    5.13009e-06   3.5026e-05     4.739e-06    2.5713e-06       950    
end_path:out1:RootOutput(write)                  0.000188905   0.000534512   0.00683475    0.000375451   0.000498915      950    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2094.21 MB
  Peak resident set size usage (VmHWM): 1086.29 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2094.21 MB
  Peak resident set size usage (VmHWM): 1086.29 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 950 passed = 950 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        950        950          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 184.781046 Real = 10539.863512

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2094.21 VmHWM = 1086.29

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 96900
-rw-r--r-- 1 dune01 dune01 44339495 Nov 22 14:29 jobscript.log
-rw-r--r-- 1 dune01 dune01     3100 Nov 22 14:29 justin-processed-pfns.txt
-rw-r--r-- 1 dune01 dune01 10470891 Nov 22 14:29 pdhd_255292_142_1_20251122T113350Z_beam_hist.root
-rw-r--r-- 1 dune01 dune01 43735863 Nov 22 14:29 debug.log
-rw-r--r-- 1 dune01 dune01   645809 Nov 22 14:29 pdhd_255292_142_1_20251122T113350Z_beam.root
-rw-r--r-- 1 dune01 dune01     1500 Nov 22 11:33 all-input-dids.txt
justIN time: 2026-02-08 21:39:44 UTC       justIN version: 01.06.00