justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 233774.14@dunegpschedd02.fnal.gov

Jobsub ID233774.14@dunegpschedd02.fnal.gov
Workflow ID9413
Stage ID1
User namedrivera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-28 15:32:19
SiteUS_UChicago
EntryEngage_US_MWT2_uct2_gk02_condce_mcore
Last heartbeat2025-10-28 20:03:12
From worker nodeHostnamemwt2-c075.campuscluster.illinois.edu
cpuinfoAMD EPYC 7443 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-28 15:41:00
Input fileshd-protodune:np04hd_raw_run032933_0000_dataflow2_datawriter_0_20241203T231000.hdf5
JobscriptExit code0
Real time4h (15711s)
CPU time4h (14418s = 91%)
Max RSS bytes2525446144 (2408 MiB)
Outputting started2025-10-28 20:02:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/drivera/lar1010/JustinTest/fnal/09413/1/001/np04hd_raw_run032933_0000_dataflow2_datawriter_0_20241203T231000_1_233774_14_1761666071_deco_reco.root
Finished2025-10-28 20:03:12
Saved logsjustin-logs:233774.14-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

33
wclsFrameSaver: no samples within desired window for channel 8334
wclsFrameSaver: no samples within desired window for channel 8335
wclsFrameSaver: no samples within desired window for channel 8336
wclsFrameSaver: no samples within desired window for channel 8338
wclsFrameSaver: no samples within desired window for channel 8338
wclsFrameSaver: no samples within desired window for channel 8376
wclsFrameSaver: no samples within desired window for channel 8377
wclsFrameSaver: no samples within desired window for channel 8378
wclsFrameSaver: no samples within desired window for channel 8575
wclsFrameSaver: no samples within desired window for channel 8576
wclsFrameSaver: no samples within desired window for channel 8688
wclsFrameSaver: no samples within desired window for channel 8689
wclsFrameSaver: no samples within desired window for channel 8689
wclsFrameSaver: no samples within desired window for channel 8699
wclsFrameSaver: no samples within desired window for channel 8699
wclsFrameSaver: no samples within desired window for channel 8700
wclsFrameSaver: no samples within desired window for channel 8700
wclsFrameSaver: no samples within desired window for channel 8700
wclsFrameSaver: no samples within desired window for channel 8935
wclsFrameSaver: no samples within desired window for channel 8935
wclsFrameSaver: no samples within desired window for channel 8936
wclsFrameSaver: no samples within desired window for channel 8936
wclsFrameSaver: no samples within desired window for channel 8937
wclsFrameSaver: no samples within desired window for channel 8937
wclsFrameSaver: no samples within desired window for channel 8938
wclsFrameSaver: no samples within desired window for channel 8938
wclsFrameSaver: no samples within desired window for channel 8939
wclsFrameSaver: no samples within desired window for channel 8939
wclsFrameSaver: no samples within desired window for channel 8940
wclsFrameSaver: no samples within desired window for channel 8940
wclsFrameSaver: no samples within desired window for channel 8940
wclsFrameSaver: no samples within desired window for channel 8941
wclsFrameSaver: no samples within desired window for channel 8941
wclsFrameSaver: no samples within desired window for channel 8942
wclsFrameSaver: no samples within desired window for channel 8943
wclsFrameSaver: no samples within desired window for channel 8943
wclsFrameSaver: no samples within desired window for channel 8944
wclsFrameSaver: no samples within desired window for channel 8944
wclsFrameSaver: no samples within desired window for channel 8945
wclsFrameSaver: no samples within desired window for channel 8945
wclsFrameSaver: no samples within desired window for channel 8946
wclsFrameSaver: no samples within desired window for channel 8946
wclsFrameSaver: no samples within desired window for channel 8947
wclsFrameSaver: no samples within desired window for channel 8949
wclsFrameSaver: no samples within desired window for channel 8950
wclsFrameSaver: no samples within desired window for channel 8957
wclsFrameSaver: no samples within desired window for channel 8958
wclsFrameSaver: no samples within desired window for channel 9104
wclsFrameSaver: no samples within desired window for channel 9177
wclsFrameSaver: no samples within desired window for channel 9178
wclsFrameSaver: no samples within desired window for channel 9178
wclsFrameSaver: no samples within desired window for channel 9301
wclsFrameSaver: no samples within desired window for channel 9301
wclsFrameSaver: no samples within desired window for channel 9302
wclsFrameSaver: no samples within desired window for channel 9302
wclsFrameSaver: no samples within desired window for channel 9318
wclsFrameSaver: no samples within desired window for channel 9401
wclsFrameSaver: no samples within desired window for channel 9401
wclsFrameSaver: no samples within desired window for channel 9401
wclsFrameSaver: no samples within desired window for channel 9402
wclsFrameSaver: no samples within desired window for channel 9402
wclsFrameSaver: no samples within desired window for channel 9402
wclsFrameSaver: no samples within desired window for channel 9403
wclsFrameSaver: no samples within desired window for channel 9403
wclsFrameSaver: no samples within desired window for channel 9403
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9405
wclsFrameSaver: no samples within desired window for channel 9405
wclsFrameSaver: no samples within desired window for channel 9406
wclsFrameSaver: no samples within desired window for channel 9406
wclsFrameSaver: no samples within desired window for channel 9407
wclsFrameSaver: no samples within desired window for channel 9527
wclsFrameSaver: no samples within desired window for channel 9567
wclsFrameSaver: no samples within desired window for channel 9706
wclsFrameSaver: no samples within desired window for channel 9707
wclsFrameSaver: no samples within desired window for channel 9715
FrameSaver: q=2.25333e+07 n=1838888 tag=wiener
28-Oct-2025 15:02:49 CDT  Closed output file "np04hd_raw_run032933_0000_dataflow2_datawriter_0_20241203T231000_1_233774_14_1761666071_deco_reco.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          122.708       389.495       2620.02       174.266       473.079        40     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        7.9248e-05    0.000125921   0.000442421   0.000103294   7.37447e-05      40     
produce:tpcrawdecoder:PDHDTPCReader                 23.2096       24.3727       24.9835       24.4163      0.292959        40     
produce:fembfilter:PDHDFEMBFilter                 0.000119915   0.000204349   0.000561886   0.000177979   9.55297e-05      40     
produce:wclsdatahd:WireCellToolkit                  64.7099       79.8811       98.554        79.0665       7.08113        40     
produce:gaushit:GausHitFinder                      0.554791       1.26639       2.10083       1.18088       0.43888        40     
produce:nhitsfilter:NumberOfHitsFilter            0.000294813   0.000616176   0.00117481    0.000576052   0.000230214      40     
produce:reco3d:SpacePointSolver                    0.174221       37.6585       196.29        5.2009        50.9202        40     
produce:hitpdune:DisambigFromSpacePoints           0.172042       3.65012       12.5347       1.77937       3.4594         40     
produce:pandora:StandardPandora                     6.60103       224.749       2376.2        44.7636       433.635        40     
produce:pandoraWriter:StandardPandora              0.176152      0.382182      0.625179      0.334229      0.131388        40     
produce:pandoraTrack:LArPandoraTrackCreation        0.93657       4.88983       12.934        3.65293       2.98059        40     
produce:pandoraShower:LArPandoraShowerCreation     0.854096       6.1157        13.6044       5.0105        3.41877        40     
produce:pandoracalo:Calorimetry                    0.651463       2.41889       7.40834       1.55039       1.65759        40     
produce:pandoracalonosce:Calorimetry               0.341085       2.23592       6.99664       1.49699       1.56556        40     
[art]:TriggerResults:TriggerResultInserter        6.4621e-05    9.08964e-05   0.000140263   8.7018e-05    1.71713e-05      40     
end_path:out1:RootOutput                          1.5469e-05    2.57919e-05   5.8951e-05    2.31835e-05   8.87545e-06      40     
end_path:out1:RootOutput(write)                    0.595538       1.49809       2.62908       1.33997      0.557688        40     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4400.93 MB
  Peak resident set size usage (VmHWM): 2525.45 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'np04hd_raw_run032933_0000_dataflow2_datawriter_0_20241203T231000_1_233774_14_1761666071_deco_reco.root', 'start_time': 1761666071.4611146, 'end_time': 1761681770.3708835}
lsing
total 955M
-rw-r--r-- 1 dune osgvo 688M Oct 28 15:02 np04hd_raw_run032933_0000_dataflow2_datawriter_0_20241203T231000_1_233774_14_1761666071_deco_reco.root
-rw-r--r-- 1 dune osgvo 254M Oct 28 15:02 Pandora_Events.pndr
-rw-r--r-- 1 dune osgvo 6.6M Oct 28 15:02 jobscript.log
-rw-r--r-- 1 dune osgvo 6.5M Oct 28 15:02 np04hd_raw_run032933_0000_dataflow2_datawriter_0_20241203T231000_1_233774_14_1761666071_deco_reco.err
-rw-r--r-- 1 dune osgvo 284K Oct 28 15:02 mem.db
-rw-r--r-- 1 dune osgvo  56K Oct 28 15:02 time.db
-rw-r--r-- 1 dune osgvo  50K Oct 28 15:02 np04hd_raw_run032933_0000_dataflow2_datawriter_0_20241203T231000_1_233774_14_1761666071_deco_reco.log
-rw-r--r-- 1 dune osgvo  20K Oct 28 15:02 pdhd_keepup_decoder.root
-rw-r--r-- 1 dune osgvo 3.5K Oct 28 15:02 Pandora_Geometry.xml
-rw-r--r-- 1 dune osgvo   83 Oct 28 10:41 all-input-dids.txt
-rw-r--r-- 1 dune osgvo    0 Oct 28 10:41 debugprod.log
disk usage
955M	.
justIN time: 2025-11-05 17:30:01 UTC       justIN version: 01.05.01