justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 240229.15@dunegpschedd01.fnal.gov

Jobsub ID240229.15@dunegpschedd01.fnal.gov
Workflow ID9431
Stage ID1
User namedrivera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-29 12:46:29
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2025-10-29 23:50:49
From worker nodeHostnamen110.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-29 12:48:07
Input fileshd-protodune:np04hd_raw_run032935_0001_dataflow2_datawriter_0_20241204T003309.hdf5
JobscriptExit code0
Real time11h (39713s)
CPU time10h (38649s = 97%)
Max RSS bytes2597584896 (2477 MiB)
Outputting started2025-10-29 23:50:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/drivera/lar1010/JustinTest/fnal/09431/1/001/np04hd_raw_run032935_0001_dataflow2_datawriter_0_20241204T003309_1_240229_15_1761742096_deco_reco.root
Finished2025-10-29 23:50:49
Saved logsjustin-logs:240229.15-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

thin desired window for channel 9306
wclsFrameSaver: no samples within desired window for channel 9308
wclsFrameSaver: no samples within desired window for channel 9310
wclsFrameSaver: no samples within desired window for channel 9311
wclsFrameSaver: no samples within desired window for channel 9311
wclsFrameSaver: no samples within desired window for channel 9311
wclsFrameSaver: no samples within desired window for channel 9312
wclsFrameSaver: no samples within desired window for channel 9312
wclsFrameSaver: no samples within desired window for channel 9313
wclsFrameSaver: no samples within desired window for channel 9313
wclsFrameSaver: no samples within desired window for channel 9313
wclsFrameSaver: no samples within desired window for channel 9314
wclsFrameSaver: no samples within desired window for channel 9314
wclsFrameSaver: no samples within desired window for channel 9315
wclsFrameSaver: no samples within desired window for channel 9315
wclsFrameSaver: no samples within desired window for channel 9315
wclsFrameSaver: no samples within desired window for channel 9316
wclsFrameSaver: no samples within desired window for channel 9317
wclsFrameSaver: no samples within desired window for channel 9317
wclsFrameSaver: no samples within desired window for channel 9317
wclsFrameSaver: no samples within desired window for channel 9318
wclsFrameSaver: no samples within desired window for channel 9319
wclsFrameSaver: no samples within desired window for channel 9319
wclsFrameSaver: no samples within desired window for channel 9320
wclsFrameSaver: no samples within desired window for channel 9320
wclsFrameSaver: no samples within desired window for channel 9321
wclsFrameSaver: no samples within desired window for channel 9321
wclsFrameSaver: no samples within desired window for channel 9321
wclsFrameSaver: no samples within desired window for channel 9322
wclsFrameSaver: no samples within desired window for channel 9322
wclsFrameSaver: no samples within desired window for channel 9323
wclsFrameSaver: no samples within desired window for channel 9323
wclsFrameSaver: no samples within desired window for channel 9323
wclsFrameSaver: no samples within desired window for channel 9324
wclsFrameSaver: no samples within desired window for channel 9324
wclsFrameSaver: no samples within desired window for channel 9325
wclsFrameSaver: no samples within desired window for channel 9325
wclsFrameSaver: no samples within desired window for channel 9326
wclsFrameSaver: no samples within desired window for channel 9326
wclsFrameSaver: no samples within desired window for channel 9327
wclsFrameSaver: no samples within desired window for channel 9327
wclsFrameSaver: no samples within desired window for channel 9327
wclsFrameSaver: no samples within desired window for channel 9328
wclsFrameSaver: no samples within desired window for channel 9328
wclsFrameSaver: no samples within desired window for channel 9329
wclsFrameSaver: no samples within desired window for channel 9330
wclsFrameSaver: no samples within desired window for channel 9330
wclsFrameSaver: no samples within desired window for channel 9331
wclsFrameSaver: no samples within desired window for channel 9331
wclsFrameSaver: no samples within desired window for channel 9332
wclsFrameSaver: no samples within desired window for channel 9332
wclsFrameSaver: no samples within desired window for channel 9333
wclsFrameSaver: no samples within desired window for channel 9333
wclsFrameSaver: no samples within desired window for channel 9334
wclsFrameSaver: no samples within desired window for channel 9334
wclsFrameSaver: no samples within desired window for channel 9335
wclsFrameSaver: no samples within desired window for channel 9335
wclsFrameSaver: no samples within desired window for channel 9336
wclsFrameSaver: no samples within desired window for channel 9336
wclsFrameSaver: no samples within desired window for channel 9337
wclsFrameSaver: no samples within desired window for channel 9337
wclsFrameSaver: no samples within desired window for channel 9338
wclsFrameSaver: no samples within desired window for channel 9339
wclsFrameSaver: no samples within desired window for channel 9339
wclsFrameSaver: no samples within desired window for channel 9340
wclsFrameSaver: no samples within desired window for channel 9341
wclsFrameSaver: no samples within desired window for channel 9369
wclsFrameSaver: no samples within desired window for channel 9369
wclsFrameSaver: no samples within desired window for channel 9370
wclsFrameSaver: no samples within desired window for channel 9370
wclsFrameSaver: no samples within desired window for channel 9371
wclsFrameSaver: no samples within desired window for channel 9371
wclsFrameSaver: no samples within desired window for channel 9372
wclsFrameSaver: no samples within desired window for channel 9372
wclsFrameSaver: no samples within desired window for channel 9373
wclsFrameSaver: no samples within desired window for channel 9373
wclsFrameSaver: no samples within desired window for channel 9411
wclsFrameSaver: no samples within desired window for channel 9419
wclsFrameSaver: no samples within desired window for channel 9419
wclsFrameSaver: no samples within desired window for channel 9497
FrameSaver: q=2.92049e+07 n=1787019 tag=wiener
29-Oct-2025 23:49:58 GMT  Closed output file "np04hd_raw_run032935_0001_dataflow2_datawriter_0_20241204T003309_1_240229_15_1761742096_deco_reco.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          126.74        1015.18       5150.75       694.885       1053.82        39     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        5.7939e-05    8.12213e-05   0.000184108    7.621e-05    2.32429e-05      39     
produce:tpcrawdecoder:PDHDTPCReader                 22.0458       22.8747       28.7126       22.4473       1.38704        39     
produce:fembfilter:PDHDFEMBFilter                 7.9295e-05    0.000115323   0.000349105   0.000110905   4.0865e-05       39     
produce:wclsdatahd:WireCellToolkit                  88.6657       94.1779       99.7756       94.2147       2.85165        39     
produce:gaushit:GausHitFinder                      0.656211       1.7045        2.74233       1.7178        0.44814        39     
produce:nhitsfilter:NumberOfHitsFilter            0.000263544   0.00083577    0.00156191    0.000850726   0.000227271      39     
produce:reco3d:SpacePointSolver                     0.35036       97.1996       359.396       84.4205       75.8679        39     
produce:hitpdune:DisambigFromSpacePoints            0.30998       10.0137       17.1179       10.8446       4.5781         39     
produce:pandora:StandardPandora                     9.15204       773.974       4715.87       465.25        1000.15        39     
produce:pandoraWriter:StandardPandora              0.124948      0.375633      0.758151      0.372057      0.108959        39     
produce:pandoraTrack:LArPandoraTrackCreation       0.734006       4.32337       19.6838       3.91245       2.98725        39     
produce:pandoraShower:LArPandoraShowerCreation     0.941503       4.28297       15.6396       3.78165       2.45109        39     
produce:pandoracalo:Calorimetry                    0.443974       2.11713       8.0465        1.97114       1.26221        39     
produce:pandoracalonosce:Calorimetry               0.391973       2.02839       7.86204       1.88521       1.23966        39     
[art]:TriggerResults:TriggerResultInserter         2.088e-05    3.24173e-05   0.000107319   2.9291e-05    1.40141e-05      39     
end_path:out1:RootOutput                           3.789e-06     9.03e-06     2.3252e-05     7.81e-06     3.96167e-06      39     
end_path:out1:RootOutput(write)                    0.636434       1.92115       3.39159       1.92838      0.568452        39     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4869.79 MB
  Peak resident set size usage (VmHWM): 2597.58 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'np04hd_raw_run032935_0001_dataflow2_datawriter_0_20241204T003309_1_240229_15_1761742096_deco_reco.root', 'start_time': 1761742096.4972045, 'end_time': 1761781799.976134}
lsing
total 1.2G
-rw-r--r--. 1 dune004 dune 850M Oct 29 23:49 np04hd_raw_run032935_0001_dataflow2_datawriter_0_20241204T003309_1_240229_15_1761742096_deco_reco.root
-rw-r--r--. 1 dune004 dune 313M Oct 29 23:49 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune 6.0M Oct 29 23:50 jobscript.log
-rw-r--r--. 1 dune004 dune 5.6M Oct 29 23:49 np04hd_raw_run032935_0001_dataflow2_datawriter_0_20241204T003309_1_240229_15_1761742096_deco_reco.err
-rw-r--r--. 1 dune004 dune 311K Oct 29 23:49 np04hd_raw_run032935_0001_dataflow2_datawriter_0_20241204T003309_1_240229_15_1761742096_deco_reco.log
-rw-r--r--. 1 dune004 dune 280K Oct 29 23:49 mem.db
-rw-r--r--. 1 dune004 dune  56K Oct 29 23:49 time.db
-rw-r--r--. 1 dune004 dune  19K Oct 29 23:49 pdhd_keepup_decoder.root
-rw-r--r--. 1 dune004 dune 3.5K Oct 29 23:49 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune   83 Oct 29 12:48 all-input-dids.txt
-rw-r--r--. 1 dune004 dune    0 Oct 29 12:48 debugprod.log
disk usage
1.2G	.
justIN time: 2025-11-04 01:56:54 UTC       justIN version: 01.05.01