justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 233774.0@dunegpschedd02.fnal.gov

Jobsub ID233774.0@dunegpschedd02.fnal.gov
Workflow ID9413
Stage ID1
User namedrivera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-28 15:32:19
SiteUS_UChicago
EntryEngage_US_MWT2_uiuc_gk02_condce_mcore
Last heartbeat2025-10-28 18:17:23
From worker nodeHostnameiut2-c330.iu.edu
cpuinfoAMD EPYC 7402 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-28 15:33:29
Input fileshd-protodune:np04hd_raw_run032933_0001_dataflow3_datawriter_0_20241203T231032.hdf5
JobscriptExit code0
Real time2h (9812s)
CPU time2h (9015s = 91%)
Max RSS bytes2125565952 (2027 MiB)
Outputting started2025-10-28 18:17:02
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/drivera/lar1010/JustinTest/fnal/09413/1/001/np04hd_raw_run032933_0001_dataflow3_datawriter_0_20241203T231032_1_233774_0_1761665630_deco_reco.root
Finished2025-10-28 18:17:23
Saved logsjustin-logs:233774.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

sFrameSaver: no samples within desired window for channel 9696
wclsFrameSaver: no samples within desired window for channel 9696
wclsFrameSaver: no samples within desired window for channel 9696
wclsFrameSaver: no samples within desired window for channel 9696
wclsFrameSaver: no samples within desired window for channel 9697
wclsFrameSaver: no samples within desired window for channel 9697
wclsFrameSaver: no samples within desired window for channel 9697
wclsFrameSaver: no samples within desired window for channel 9698
wclsFrameSaver: no samples within desired window for channel 9698
wclsFrameSaver: no samples within desired window for channel 9699
wclsFrameSaver: no samples within desired window for channel 9699
wclsFrameSaver: no samples within desired window for channel 9699
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9702
wclsFrameSaver: no samples within desired window for channel 9702
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9704
wclsFrameSaver: no samples within desired window for channel 9705
wclsFrameSaver: no samples within desired window for channel 9705
wclsFrameSaver: no samples within desired window for channel 9706
wclsFrameSaver: no samples within desired window for channel 9706
wclsFrameSaver: no samples within desired window for channel 9707
wclsFrameSaver: no samples within desired window for channel 9707
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9709
wclsFrameSaver: no samples within desired window for channel 9709
wclsFrameSaver: no samples within desired window for channel 9710
wclsFrameSaver: no samples within desired window for channel 9710
wclsFrameSaver: no samples within desired window for channel 9711
wclsFrameSaver: no samples within desired window for channel 9711
wclsFrameSaver: no samples within desired window for channel 9712
wclsFrameSaver: no samples within desired window for channel 9712
wclsFrameSaver: no samples within desired window for channel 9713
wclsFrameSaver: no samples within desired window for channel 9714
wclsFrameSaver: no samples within desired window for channel 9714
wclsFrameSaver: no samples within desired window for channel 9715
wclsFrameSaver: no samples within desired window for channel 9716
wclsFrameSaver: no samples within desired window for channel 9717
wclsFrameSaver: no samples within desired window for channel 9717
wclsFrameSaver: no samples within desired window for channel 9718
wclsFrameSaver: no samples within desired window for channel 9719
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9721
wclsFrameSaver: no samples within desired window for channel 9722
wclsFrameSaver: no samples within desired window for channel 9723
wclsFrameSaver: no samples within desired window for channel 9724
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9728
wclsFrameSaver: no samples within desired window for channel 9729
wclsFrameSaver: no samples within desired window for channel 9730
wclsFrameSaver: no samples within desired window for channel 9731
wclsFrameSaver: no samples within desired window for channel 9732
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9738
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9741
wclsFrameSaver: no samples within desired window for channel 9742
wclsFrameSaver: no samples within desired window for channel 9743
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 9745
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9747
FrameSaver: q=3.24151e+07 n=2323531 tag=wiener
28-Oct-2025 14:16:59 EDT  Closed output file "np04hd_raw_run032933_0001_dataflow3_datawriter_0_20241203T231032_1_233774_0_1761665630_deco_reco.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          134.07        403.123       1613.99       187.976       360.29         24     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        0.000100802   0.000145697   0.000413582   0.000127768   6.10849e-05      24     
produce:tpcrawdecoder:PDHDTPCReader                 23.6232       24.5069       26.779        24.3852      0.530381        24     
produce:fembfilter:PDHDFEMBFilter                 0.000178749   0.000262979   0.000688231   0.000227389   0.000106767      24     
produce:wclsdatahd:WireCellToolkit                  73.339        87.4522       100.782       87.2946       5.64193        24     
produce:gaushit:GausHitFinder                      0.743034       1.2774        2.38364       1.16955      0.417484        24     
produce:nhitsfilter:NumberOfHitsFilter            0.000379017    0.0010331    0.00184458    0.00101128    0.000373078      24     
produce:reco3d:SpacePointSolver                    0.581084       48.1086       142.46        3.23472       59.2472        24     
produce:hitpdune:DisambigFromSpacePoints           0.397238       3.30559       12.839        1.50293       3.39474        24     
produce:pandora:StandardPandora                     15.9368       216.597       1259.43       47.0633       291.392        24     
produce:pandoraWriter:StandardPandora              0.233232      0.451674      0.787129       0.42327      0.145735        24     
produce:pandoraTrack:LArPandoraTrackCreation        1.52286       6.18312       22.7271       4.62657       4.48942        24     
produce:pandoraShower:LArPandoraShowerCreation      2.30342       7.27413       24.972        5.52272       4.72237        24     
produce:pandoracalo:Calorimetry                    0.687155       3.02508       14.7429       2.4936        2.78264        24     
produce:pandoracalonosce:Calorimetry               0.649931       2.94606       14.7131       2.1688        2.76186        24     
[art]:TriggerResults:TriggerResultInserter        7.0695e-05    0.000106133   0.00028325     9.46e-05     4.23666e-05      24     
end_path:out1:RootOutput                          2.0219e-05    3.13057e-05   9.7827e-05    2.70935e-05   1.61434e-05      24     
end_path:out1:RootOutput(write)                    0.925937       1.61486       3.43468       1.42428      0.626249        24     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4013.16 MB
  Peak resident set size usage (VmHWM): 2125.57 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'np04hd_raw_run032933_0001_dataflow3_datawriter_0_20241203T231032_1_233774_0_1761665630_deco_reco.root', 'start_time': 1761665630.0854948, 'end_time': 1761675420.6306527}
lsing
total 567M
-rw-r--r--. 1 dune osgvo 411M Oct 28 14:16 np04hd_raw_run032933_0001_dataflow3_datawriter_0_20241203T231032_1_233774_0_1761665630_deco_reco.root
-rw-r--r--. 1 dune osgvo 148M Oct 28 14:15 Pandora_Events.pndr
-rw-r--r--. 1 dune osgvo 4.0M Oct 28 14:17 jobscript.log
-rw-r--r--. 1 dune osgvo 3.8M Oct 28 14:17 np04hd_raw_run032933_0001_dataflow3_datawriter_0_20241203T231032_1_233774_0_1761665630_deco_reco.err
-rw-r--r--. 1 dune osgvo 188K Oct 28 14:16 mem.db
-rw-r--r--. 1 dune osgvo  40K Oct 28 14:16 time.db
-rw-r--r--. 1 dune osgvo  24K Oct 28 14:17 np04hd_raw_run032933_0001_dataflow3_datawriter_0_20241203T231032_1_233774_0_1761665630_deco_reco.log
-rw-r--r--. 1 dune osgvo  15K Oct 28 14:16 pdhd_keepup_decoder.root
-rw-r--r--. 1 dune osgvo 3.5K Oct 28 14:16 Pandora_Geometry.xml
-rw-r--r--. 1 dune osgvo   83 Oct 28 11:33 all-input-dids.txt
-rw-r--r--. 1 dune osgvo    0 Oct 28 11:34 debugprod.log
disk usage
567M	.
justIN time: 2025-11-05 17:30:05 UTC       justIN version: 01.05.01