justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 241573.0@dunegpschedd01.fnal.gov

Jobsub ID241573.0@dunegpschedd01.fnal.gov
Workflow ID9431
Stage ID1
User namedrivera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-01 04:53:50
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2025-11-01 23:27:10
From worker nodeHostnamewn-s04-05-36-04.cr.cnaf.infn.it
cpuinfoAMD EPYC 7313 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-01 05:03:09
Input fileshd-protodune:np04hd_raw_run032940_0003_dataflow5_datawriter_0_20241204T063251.hdf5
JobscriptExit code0
Real time18h (65936s)
CPU time17h (64602s = 97%)
Max RSS bytes2710835200 (2585 MiB)
Outputting started2025-11-01 23:22:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/drivera/lar1010/JustinTest/fnal/09431/1/001/np04hd_raw_run032940_0003_dataflow5_datawriter_0_20241204T063251_1_241573_0_1761973425_deco_reco.root
Finished2025-11-01 23:27:10
Saved logsjustin-logs:241573.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ired window for channel 7600
wclsFrameSaver: no samples within desired window for channel 7601
wclsFrameSaver: no samples within desired window for channel 7601
wclsFrameSaver: no samples within desired window for channel 7601
wclsFrameSaver: no samples within desired window for channel 7601
wclsFrameSaver: no samples within desired window for channel 7601
wclsFrameSaver: no samples within desired window for channel 7602
wclsFrameSaver: no samples within desired window for channel 7602
wclsFrameSaver: no samples within desired window for channel 7602
wclsFrameSaver: no samples within desired window for channel 7603
wclsFrameSaver: no samples within desired window for channel 7603
wclsFrameSaver: no samples within desired window for channel 7603
wclsFrameSaver: no samples within desired window for channel 7603
wclsFrameSaver: no samples within desired window for channel 7603
wclsFrameSaver: no samples within desired window for channel 7604
wclsFrameSaver: no samples within desired window for channel 7604
wclsFrameSaver: no samples within desired window for channel 7604
wclsFrameSaver: no samples within desired window for channel 7604
wclsFrameSaver: no samples within desired window for channel 7604
wclsFrameSaver: no samples within desired window for channel 7604
wclsFrameSaver: no samples within desired window for channel 7605
wclsFrameSaver: no samples within desired window for channel 7605
wclsFrameSaver: no samples within desired window for channel 7605
wclsFrameSaver: no samples within desired window for channel 7605
wclsFrameSaver: no samples within desired window for channel 7605
wclsFrameSaver: no samples within desired window for channel 7605
wclsFrameSaver: no samples within desired window for channel 7606
wclsFrameSaver: no samples within desired window for channel 7606
wclsFrameSaver: no samples within desired window for channel 7606
wclsFrameSaver: no samples within desired window for channel 7606
wclsFrameSaver: no samples within desired window for channel 7606
wclsFrameSaver: no samples within desired window for channel 7607
wclsFrameSaver: no samples within desired window for channel 7607
wclsFrameSaver: no samples within desired window for channel 7607
wclsFrameSaver: no samples within desired window for channel 7607
wclsFrameSaver: no samples within desired window for channel 7607
wclsFrameSaver: no samples within desired window for channel 7607
wclsFrameSaver: no samples within desired window for channel 7608
wclsFrameSaver: no samples within desired window for channel 7608
wclsFrameSaver: no samples within desired window for channel 7609
wclsFrameSaver: no samples within desired window for channel 7609
wclsFrameSaver: no samples within desired window for channel 7610
wclsFrameSaver: no samples within desired window for channel 7610
wclsFrameSaver: no samples within desired window for channel 7610
wclsFrameSaver: no samples within desired window for channel 7610
wclsFrameSaver: no samples within desired window for channel 7611
wclsFrameSaver: no samples within desired window for channel 7612
wclsFrameSaver: no samples within desired window for channel 7612
wclsFrameSaver: no samples within desired window for channel 7613
wclsFrameSaver: no samples within desired window for channel 7613
wclsFrameSaver: no samples within desired window for channel 7614
wclsFrameSaver: no samples within desired window for channel 7615
wclsFrameSaver: no samples within desired window for channel 7615
wclsFrameSaver: no samples within desired window for channel 7652
wclsFrameSaver: no samples within desired window for channel 7652
wclsFrameSaver: no samples within desired window for channel 7653
wclsFrameSaver: no samples within desired window for channel 7659
wclsFrameSaver: no samples within desired window for channel 8237
wclsFrameSaver: no samples within desired window for channel 8238
wclsFrameSaver: no samples within desired window for channel 8251
wclsFrameSaver: no samples within desired window for channel 8349
wclsFrameSaver: no samples within desired window for channel 8358
wclsFrameSaver: no samples within desired window for channel 9040
wclsFrameSaver: no samples within desired window for channel 9067
wclsFrameSaver: no samples within desired window for channel 9104
wclsFrameSaver: no samples within desired window for channel 9105
wclsFrameSaver: no samples within desired window for channel 9105
wclsFrameSaver: no samples within desired window for channel 9134
wclsFrameSaver: no samples within desired window for channel 9181
wclsFrameSaver: no samples within desired window for channel 9182
wclsFrameSaver: no samples within desired window for channel 9182
wclsFrameSaver: no samples within desired window for channel 9183
wclsFrameSaver: no samples within desired window for channel 9268
wclsFrameSaver: no samples within desired window for channel 9354
wclsFrameSaver: no samples within desired window for channel 9380
wclsFrameSaver: no samples within desired window for channel 9598
wclsFrameSaver: no samples within desired window for channel 9606
wclsFrameSaver: no samples within desired window for channel 9628
wclsFrameSaver: no samples within desired window for channel 10238
FrameSaver: q=1.81291e+07 n=2149062 tag=wiener
02-Nov-2025 00:22:04 CET  Closed output file "np04hd_raw_run032940_0003_dataflow5_datawriter_0_20241204T063251_1_241573_0_1761973425_deco_reco.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          84.2144       1680.86       20124.3       780.65        3494.82        39     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        4.8862e-05    8.11225e-05   0.000165601   7.3067e-05    2.52737e-05      39     
produce:tpcrawdecoder:PDHDTPCReader                 2.64107       3.25912       7.2183        3.12819       0.71899        39     
produce:fembfilter:PDHDFEMBFilter                 5.4974e-05    9.52219e-05   0.000414859   7.7466e-05    5.96534e-05      39     
produce:wclsdatahd:WireCellToolkit                  44.2688       56.6064       72.4189       53.0811       9.45596        39     
produce:gaushit:GausHitFinder                      0.567099       1.21162       2.00581       1.24009       0.39681        39     
produce:nhitsfilter:NumberOfHitsFilter            0.000365376   0.00065316    0.00150666    0.000650303   0.000216228      39     
produce:reco3d:SpacePointSolver                    0.206257       69.0751       140.004       72.4585       30.1304        39     
produce:hitpdune:DisambigFromSpacePoints           0.190453       8.15846       16.9858       7.38984       3.75599        39     
produce:pandora:StandardPandora                      9.094        1533.67       19952.6       646.219       3483.95        39     
produce:pandoraWriter:StandardPandora              0.0738117     0.268912      0.467246       0.25827      0.0864909       39     
produce:pandoraTrack:LArPandoraTrackCreation       0.435257       2.34576       8.99979       2.06334       1.44556        39     
produce:pandoraShower:LArPandoraShowerCreation     0.481059       2.26157       7.50908       1.98067       1.2944         39     
produce:pandoracalo:Calorimetry                    0.291318       1.31329       3.47732       1.0608        0.72661        39     
produce:pandoracalonosce:Calorimetry               0.370469       1.22627       3.23711      0.951409      0.657004        39     
[art]:TriggerResults:TriggerResultInserter        1.8735e-05    3.33542e-05   0.000102522   3.0678e-05    1.51578e-05      39     
end_path:out1:RootOutput                           3.426e-06    1.06112e-05   3.9434e-05     9.107e-06    5.95104e-06      39     
end_path:out1:RootOutput(write)                    0.612238       1.29636       2.38556       1.19919      0.425046        39     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4550.16 MB
  Peak resident set size usage (VmHWM): 2710.84 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'np04hd_raw_run032940_0003_dataflow5_datawriter_0_20241204T063251_1_241573_0_1761973425_deco_reco.root', 'start_time': 1761973425.3022416, 'end_time': 1762039325.5202546}
lsing
total 1.3G
-rw-r--r-- 1 neutrino002 neutrino 869M Nov  2 00:22 np04hd_raw_run032940_0003_dataflow5_datawriter_0_20241204T063251_1_241573_0_1761973425_deco_reco.root
-rw-r--r-- 1 neutrino002 neutrino 354M Nov  2 00:21 Pandora_Events.pndr
-rw-r--r-- 1 neutrino002 neutrino 5.5M Nov  2 00:22 jobscript.log
-rw-r--r-- 1 neutrino002 neutrino 5.0M Nov  2 00:22 np04hd_raw_run032940_0003_dataflow5_datawriter_0_20241204T063251_1_241573_0_1761973425_deco_reco.err
-rw-r--r-- 1 neutrino002 neutrino 372K Nov  2 00:22 np04hd_raw_run032940_0003_dataflow5_datawriter_0_20241204T063251_1_241573_0_1761973425_deco_reco.log
-rw-r--r-- 1 neutrino002 neutrino 280K Nov  2 00:22 mem.db
-rw-r--r-- 1 neutrino002 neutrino  56K Nov  2 00:22 time.db
-rw-r--r-- 1 neutrino002 neutrino  19K Nov  2 00:22 pdhd_keepup_decoder.root
-rw-r--r-- 1 neutrino002 neutrino 3.5K Nov  2 00:22 Pandora_Geometry.xml
-rw-r--r-- 1 neutrino002 neutrino   83 Nov  1 06:03 all-input-dids.txt
-rw-r--r-- 1 neutrino002 neutrino    0 Nov  1 06:04 debugprod.log
disk usage
1.3G	.
justIN time: 2025-11-03 18:40:34 UTC       justIN version: 01.05.01