justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 240229.3@dunegpschedd01.fnal.gov

Jobsub ID240229.3@dunegpschedd01.fnal.gov
Workflow ID9431
Stage ID1
User namedrivera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-29 12:46:29
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2025-10-30 08:18:43
From worker nodeHostnamen140.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5120 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-29 12:47:41
Input fileshd-protodune:np04hd_raw_run032935_0002_dataflow6_datawriter_0_20241204T003350.hdf5
JobscriptExit code0
Real time19h (70207s)
CPU time19h (68702s = 97%)
Max RSS bytes2486734848 (2371 MiB)
Outputting started2025-10-30 08:17:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/drivera/lar1010/JustinTest/fnal/09431/1/001/np04hd_raw_run032935_0002_dataflow6_datawriter_0_20241204T003350_1_240229_3_1761742081_deco_reco.root
Finished2025-10-30 08:18:43
Saved logsjustin-logs:240229.3-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

es within desired window for channel 8629
wclsFrameSaver: no samples within desired window for channel 8880
wclsFrameSaver: no samples within desired window for channel 8880
wclsFrameSaver: no samples within desired window for channel 8880
wclsFrameSaver: no samples within desired window for channel 8880
wclsFrameSaver: no samples within desired window for channel 8880
wclsFrameSaver: no samples within desired window for channel 8880
wclsFrameSaver: no samples within desired window for channel 8880
wclsFrameSaver: no samples within desired window for channel 8881
wclsFrameSaver: no samples within desired window for channel 8881
wclsFrameSaver: no samples within desired window for channel 8881
wclsFrameSaver: no samples within desired window for channel 8881
wclsFrameSaver: no samples within desired window for channel 8881
wclsFrameSaver: no samples within desired window for channel 8881
wclsFrameSaver: no samples within desired window for channel 8881
wclsFrameSaver: no samples within desired window for channel 8881
wclsFrameSaver: no samples within desired window for channel 8881
wclsFrameSaver: no samples within desired window for channel 8882
wclsFrameSaver: no samples within desired window for channel 8882
wclsFrameSaver: no samples within desired window for channel 9105
wclsFrameSaver: no samples within desired window for channel 9105
wclsFrameSaver: no samples within desired window for channel 9106
wclsFrameSaver: no samples within desired window for channel 9106
wclsFrameSaver: no samples within desired window for channel 9106
wclsFrameSaver: no samples within desired window for channel 9218
wclsFrameSaver: no samples within desired window for channel 9221
wclsFrameSaver: no samples within desired window for channel 9304
wclsFrameSaver: no samples within desired window for channel 9436
wclsFrameSaver: no samples within desired window for channel 9437
wclsFrameSaver: no samples within desired window for channel 9437
wclsFrameSaver: no samples within desired window for channel 9438
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9440
wclsFrameSaver: no samples within desired window for channel 9440
wclsFrameSaver: no samples within desired window for channel 9440
wclsFrameSaver: no samples within desired window for channel 9441
wclsFrameSaver: no samples within desired window for channel 9441
wclsFrameSaver: no samples within desired window for channel 9441
wclsFrameSaver: no samples within desired window for channel 9442
wclsFrameSaver: no samples within desired window for channel 9442
wclsFrameSaver: no samples within desired window for channel 9443
wclsFrameSaver: no samples within desired window for channel 9443
wclsFrameSaver: no samples within desired window for channel 9443
wclsFrameSaver: no samples within desired window for channel 9444
wclsFrameSaver: no samples within desired window for channel 9444
wclsFrameSaver: no samples within desired window for channel 9444
wclsFrameSaver: no samples within desired window for channel 9445
wclsFrameSaver: no samples within desired window for channel 9445
wclsFrameSaver: no samples within desired window for channel 9446
wclsFrameSaver: no samples within desired window for channel 9446
wclsFrameSaver: no samples within desired window for channel 9446
wclsFrameSaver: no samples within desired window for channel 9447
wclsFrameSaver: no samples within desired window for channel 9447
wclsFrameSaver: no samples within desired window for channel 9447
wclsFrameSaver: no samples within desired window for channel 9447
wclsFrameSaver: no samples within desired window for channel 9448
wclsFrameSaver: no samples within desired window for channel 9448
wclsFrameSaver: no samples within desired window for channel 9448
wclsFrameSaver: no samples within desired window for channel 9449
wclsFrameSaver: no samples within desired window for channel 9449
wclsFrameSaver: no samples within desired window for channel 9450
wclsFrameSaver: no samples within desired window for channel 9450
wclsFrameSaver: no samples within desired window for channel 9450
wclsFrameSaver: no samples within desired window for channel 9451
wclsFrameSaver: no samples within desired window for channel 9451
wclsFrameSaver: no samples within desired window for channel 9452
wclsFrameSaver: no samples within desired window for channel 9452
wclsFrameSaver: no samples within desired window for channel 9452
wclsFrameSaver: no samples within desired window for channel 9453
wclsFrameSaver: no samples within desired window for channel 9453
wclsFrameSaver: no samples within desired window for channel 9453
wclsFrameSaver: no samples within desired window for channel 9454
wclsFrameSaver: no samples within desired window for channel 9454
wclsFrameSaver: no samples within desired window for channel 9455
wclsFrameSaver: no samples within desired window for channel 9456
wclsFrameSaver: no samples within desired window for channel 9494
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9709
FrameSaver: q=4.46275e+07 n=2595027 tag=wiener
30-Oct-2025 08:17:45 GMT  Closed output file "np04hd_raw_run032935_0002_dataflow6_datawriter_0_20241204T003350_1_240229_3_1761742081_deco_reco.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          152.382       1796.23       19999.1       836.594       3187.57        39     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        6.0621e-05    8.51862e-05   0.000169544   7.7102e-05    2.38132e-05      39     
produce:tpcrawdecoder:PDHDTPCReader                 24.3665       29.8353       66.9586       27.6547       7.61159        39     
produce:fembfilter:PDHDFEMBFilter                 0.00010571    0.000136067   0.000336398   0.000128261   3.69091e-05      39     
produce:wclsdatahd:WireCellToolkit                  85.9391       92.7856       100.833       93.7247       3.47371        39     
produce:gaushit:GausHitFinder                      0.778102       1.89153       3.1191        1.94964       0.51785        39     
produce:nhitsfilter:NumberOfHitsFilter            0.000588003   0.000919742   0.00129907    0.000967472   0.000170497      39     
produce:reco3d:SpacePointSolver                     1.65448       154.995       370.552       139.059       100.917        39     
produce:hitpdune:DisambigFromSpacePoints           0.905618       11.1612       26.938        11.7431       5.52366        39     
produce:pandora:StandardPandora                     22.4942       1476.7        19499.3       553.039       3125.99        39     
produce:pandoraWriter:StandardPandora              0.195321      0.417708       0.65449      0.426902      0.0941931       39     
produce:pandoraTrack:LArPandoraTrackCreation        1.51672       9.32928       24.546        8.96401       5.07788        39     
produce:pandoraShower:LArPandoraShowerCreation      1.52078       9.33345       32.3859       8.40246       5.52431        39     
produce:pandoracalo:Calorimetry                    0.759082       3.71734       9.42573       3.48215       2.01416        39     
produce:pandoracalonosce:Calorimetry               0.694872       3.59777       9.25797        3.415        1.95807        39     
[art]:TriggerResults:TriggerResultInserter        3.9907e-05    5.35212e-05   0.000100043   5.2773e-05    1.03792e-05      39     
end_path:out1:RootOutput                           7.38e-06     1.2537e-05    3.5521e-05     1.158e-05    4.36904e-06      39     
end_path:out1:RootOutput(write)                    0.834164       2.12253       3.63087       2.15222      0.619977        39     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4671.47 MB
  Peak resident set size usage (VmHWM): 2486.73 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'np04hd_raw_run032935_0002_dataflow6_datawriter_0_20241204T003350_1_240229_3_1761742081_deco_reco.root', 'start_time': 1761742081.9244032, 'end_time': 1761812268.104597}
lsing
total 1.3G
-rw-r--r--. 1 dune004 dune 936M Oct 30 08:17 np04hd_raw_run032935_0002_dataflow6_datawriter_0_20241204T003350_1_240229_3_1761742081_deco_reco.root
-rw-r--r--. 1 dune004 dune 343M Oct 30 08:16 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune 6.0M Oct 30 08:17 jobscript.log
-rw-r--r--. 1 dune004 dune 5.7M Oct 30 08:17 np04hd_raw_run032935_0002_dataflow6_datawriter_0_20241204T003350_1_240229_3_1761742081_deco_reco.err
-rw-r--r--. 1 dune004 dune 280K Oct 30 08:17 mem.db
-rw-r--r--. 1 dune004 dune 138K Oct 30 08:17 np04hd_raw_run032935_0002_dataflow6_datawriter_0_20241204T003350_1_240229_3_1761742081_deco_reco.log
-rw-r--r--. 1 dune004 dune  56K Oct 30 08:17 time.db
-rw-r--r--. 1 dune004 dune  19K Oct 30 08:17 pdhd_keepup_decoder.root
-rw-r--r--. 1 dune004 dune 3.5K Oct 30 08:17 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune   83 Oct 29 12:47 all-input-dids.txt
-rw-r--r--. 1 dune004 dune    0 Oct 29 12:48 debugprod.log
disk usage
1.3G	.
justIN time: 2025-11-04 01:53:50 UTC       justIN version: 01.05.01