justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249432.11@dunegpschedd02.fnal.gov

Jobsub ID249432.11@dunegpschedd02.fnal.gov
Workflow ID10487
Stage ID1
User namecalcuttj@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-21 20:17:52
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp
Last heartbeat2025-11-21 20:21:26
From worker nodeHostnamewn-sate-004.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-21 20:19:13
Input filesvd-protodune:np02vd_raw_run039324_1656_df-s04-d1_dw_0_20250907T021454.hdf5
vd-protodune:np02vd_raw_run039324_1658_df-s02-d0_dw_0_20250907T022055.hdf5
vd-protodune:np02vd_raw_run039324_1658_df-s05-d0_dw_0_20250907T023201.hdf5
vd-protodune:np02vd_raw_run039324_1656_df-s04-d0_dw_0_20250907T022103.hdf5
vd-protodune:np02vd_raw_run039324_1661_df-s01-d3_dw_0_20250907T024357.hdf5
JobscriptExit code0
Real time1m (102s)
CPU time0m (19s = 18%)
Max RSS bytes929132544 (886 MiB)
Outputting started2025-11-21 20:20:56
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/pdvd_beam_39324/fnal/10487/1/001/pdhd_249432_11_1_20251121T201927Z_beam_hist.root
Finished2025-11-21 20:21:26
Saved logsjustin-logs:249432.11-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Event 21-Nov-2025 21:20:51 CET  run: 39324 subRun: 1 event: 870481 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 870501 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870501 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870501 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870501 BeamEvent_module.cc:559
High: 25570821

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870501 BeamEvent_module.cc:560
Low: 353714690

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870501 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109825840280584706

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870501 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109825840280428456
	Candidate: 109825840280584706
	End: 109825840280740956
	Match to Trigger: 1
Found 1 LLT HSI frames.
		LLT -- Timestamp=109825840280584705  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870501 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 870521 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870521 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870521 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870521 BeamEvent_module.cc:559
High: 25570821

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870521 BeamEvent_module.cc:560
Low: 2041214690

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870521 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109825841968084706

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870521 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109825841967928456
	Candidate: 109825841968084706
	End: 109825841968240956
	Match to Trigger: 1
Found 1 LLT HSI frames.
		LLT -- Timestamp=109825841968084705  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 21-Nov-2025 21:20:52 CET  run: 39324 subRun: 1 event: 870521 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 870541 5
%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:53 CET  run: 39324 subRun: 1 event: 870541 BeamEvent_module.cc:535


%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:53 CET  run: 39324 subRun: 1 event: 870541 BeamEvent_module.cc:536
Getting Raw Decoder Info

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:53 CET  run: 39324 subRun: 1 event: 870541 BeamEvent_module.cc:559
High: 25570821

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:53 CET  run: 39324 subRun: 1 event: 870541 BeamEvent_module.cc:560
Low: 3791214690

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:53 CET  run: 39324 subRun: 1 event: 870541 BeamEvent_module.cc:561
Raw Decoder Timestamp: 109825843718084706

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2025 21:20:53 CET  run: 39324 subRun: 1 event: 870541 BeamEvent_module.cc:562
Trigger: -1

%MSG
Have 1 TCs
	Type: kCTBOffSpillSnapshot
	Start: 109825843717928456
	Candidate: 109825843718084706
	End: 109825843718240956
	Match to Trigger: 1
Found 2 LLT HSI frames.
		LLT -- Timestamp=109825843717959551  TriggerBits=4
		LLT -- Timestamp=109825843718084705  TriggerBits=1
		Matching LLT (tdiff=1). LP hit? 0 HP hit? 0
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
21-Nov-2025 21:20:55 CET  Closed output file "pdhd_249432_11_1_20251121T201927Z_beam.root"
21-Nov-2025 21:20:55 CET  Closed output file "pdhd_249432_11_1_20251121T201927Z_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.143296      0.345986       16.2051      0.162102       1.64532        94     
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.8194e-05    2.61287e-05   0.000190877   2.3584e-05    1.74461e-05      94     
produce:triggerrawdecoder:PDVDTriggerReader4      0.0351993     0.0491452     0.115946      0.0451658     0.0147503       94     
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0174777     0.0178191     0.0279458      0.01771     0.00105868       94     
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0866302     0.0994407     0.207355      0.0955091     0.0161319       94     
produce:beamevent:BeamEvent                      0.000428743    0.178677       16.054      0.000548358     1.64688        94     
[art]:TriggerResults:TriggerResultInserter       1.3516e-05    2.4341e-05    9.6792e-05    1.96315e-05   1.20052e-05      94     
end_path:out1:RootOutput                          3.437e-06    4.89305e-06   4.6547e-05     4.263e-06    4.39919e-06      94     
end_path:out1:RootOutput(write)                  0.000218239   0.000448839   0.00749847    0.000316674   0.000753934      94     
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.143296      0.345986       16.2051      0.162102       1.64532        94     
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.8194e-05    2.61287e-05   0.000190877   2.3584e-05    1.74461e-05      94     
produce:triggerrawdecoder:PDVDTriggerReader4      0.0351993     0.0491452     0.115946      0.0451658     0.0147503       94     
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0174777     0.0178191     0.0279458      0.01771     0.00105868       94     
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0866302     0.0994407     0.207355      0.0955091     0.0161319       94     
produce:beamevent:BeamEvent                      0.000428743    0.178677       16.054      0.000548358     1.64688        94     
[art]:TriggerResults:TriggerResultInserter       1.3516e-05    2.4341e-05    9.6792e-05    1.96315e-05   1.20052e-05      94     
end_path:out1:RootOutput                          3.437e-06    4.89305e-06   4.6547e-05     4.263e-06    4.39919e-06      94     
end_path:out1:RootOutput(write)                  0.000218239   0.000448839   0.00749847    0.000316674   0.000753934      94     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1754.38 MB
  Peak resident set size usage (VmHWM): 929.133 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1754.38 MB
  Peak resident set size usage (VmHWM): 929.133 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 94 passed = 94 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         94         94          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 8.748953 Real = 79.499913

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1754.38 VmHWM = 929.133

Art has completed and will exit with status 0.
gen lar returns 0
==== Start *.json ====
cat: *.json: No such file or directory
==== End *.json ====
.:
total 1900
-rw-r--r-- 1 dune090 dune 660954 Nov 21 21:20 jobscript.log
-rw-r--r-- 1 dune090 dune    775 Nov 21 21:20 justin-processed-pfns.txt
-rw-r--r-- 1 dune090 dune 128295 Nov 21 21:20 pdhd_249432_11_1_20251121T201927Z_beam_hist.root
-rw-r--r-- 1 dune090 dune 633629 Nov 21 21:20 debug.log
-rw-r--r-- 1 dune090 dune 119470 Nov 21 21:20 pdhd_249432_11_1_20251121T201927Z_beam.root
-rw-r--r-- 1 dune090 dune    375 Nov 21 21:19 all-input-dids.txt
justIN time: 2026-02-08 22:55:43 UTC       justIN version: 01.06.00