justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 233774.16@dunegpschedd02.fnal.gov

Jobsub ID233774.16@dunegpschedd02.fnal.gov
Workflow ID9413
Stage ID1
User namedrivera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-28 15:32:19
SiteUS_UChicago
EntryEngage_US_MWT2_iut2_condce_mcore
Last heartbeat2025-10-28 20:29:21
From worker nodeHostnameiut2-c416.iu.edu
cpuinfoAMD EPYC 7443 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-28 15:40:32
Input fileshd-protodune:np04hd_raw_run032933_0000_dataflow4_datawriter_0_20241203T231000.hdf5
JobscriptExit code0
Real time4h (17314s)
CPU time4h (16092s = 92%)
Max RSS bytes2318254080 (2210 MiB)
Outputting started2025-10-28 20:29:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/drivera/lar1010/JustinTest/fnal/09413/1/001/np04hd_raw_run032933_0000_dataflow4_datawriter_0_20241203T231000_1_233774_16_1761666047_deco_reco.root
Finished2025-10-28 20:29:21
Saved logsjustin-logs:233774.16-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

9111
wclsFrameSaver: no samples within desired window for channel 9380
wclsFrameSaver: no samples within desired window for channel 9382
wclsFrameSaver: no samples within desired window for channel 9386
wclsFrameSaver: no samples within desired window for channel 9387
wclsFrameSaver: no samples within desired window for channel 9388
wclsFrameSaver: no samples within desired window for channel 9388
wclsFrameSaver: no samples within desired window for channel 9388
wclsFrameSaver: no samples within desired window for channel 9389
wclsFrameSaver: no samples within desired window for channel 9389
wclsFrameSaver: no samples within desired window for channel 9390
wclsFrameSaver: no samples within desired window for channel 9390
wclsFrameSaver: no samples within desired window for channel 9391
wclsFrameSaver: no samples within desired window for channel 9391
wclsFrameSaver: no samples within desired window for channel 9392
wclsFrameSaver: no samples within desired window for channel 9392
wclsFrameSaver: no samples within desired window for channel 9393
wclsFrameSaver: no samples within desired window for channel 9393
wclsFrameSaver: no samples within desired window for channel 9393
wclsFrameSaver: no samples within desired window for channel 9394
wclsFrameSaver: no samples within desired window for channel 9394
wclsFrameSaver: no samples within desired window for channel 9395
wclsFrameSaver: no samples within desired window for channel 9395
wclsFrameSaver: no samples within desired window for channel 9395
wclsFrameSaver: no samples within desired window for channel 9396
wclsFrameSaver: no samples within desired window for channel 9397
wclsFrameSaver: no samples within desired window for channel 9397
wclsFrameSaver: no samples within desired window for channel 9398
wclsFrameSaver: no samples within desired window for channel 9398
wclsFrameSaver: no samples within desired window for channel 9398
wclsFrameSaver: no samples within desired window for channel 9399
wclsFrameSaver: no samples within desired window for channel 9399
wclsFrameSaver: no samples within desired window for channel 9400
wclsFrameSaver: no samples within desired window for channel 9400
wclsFrameSaver: no samples within desired window for channel 9401
wclsFrameSaver: no samples within desired window for channel 9401
wclsFrameSaver: no samples within desired window for channel 9402
wclsFrameSaver: no samples within desired window for channel 9402
wclsFrameSaver: no samples within desired window for channel 9402
wclsFrameSaver: no samples within desired window for channel 9403
wclsFrameSaver: no samples within desired window for channel 9403
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9405
wclsFrameSaver: no samples within desired window for channel 9405
wclsFrameSaver: no samples within desired window for channel 9406
wclsFrameSaver: no samples within desired window for channel 9406
wclsFrameSaver: no samples within desired window for channel 9406
wclsFrameSaver: no samples within desired window for channel 9407
wclsFrameSaver: no samples within desired window for channel 9407
wclsFrameSaver: no samples within desired window for channel 9408
wclsFrameSaver: no samples within desired window for channel 9409
wclsFrameSaver: no samples within desired window for channel 9410
wclsFrameSaver: no samples within desired window for channel 9410
wclsFrameSaver: no samples within desired window for channel 9411
wclsFrameSaver: no samples within desired window for channel 9412
wclsFrameSaver: no samples within desired window for channel 9413
wclsFrameSaver: no samples within desired window for channel 9413
wclsFrameSaver: no samples within desired window for channel 9414
wclsFrameSaver: no samples within desired window for channel 9415
wclsFrameSaver: no samples within desired window for channel 9416
wclsFrameSaver: no samples within desired window for channel 9417
wclsFrameSaver: no samples within desired window for channel 9417
wclsFrameSaver: no samples within desired window for channel 9418
wclsFrameSaver: no samples within desired window for channel 9418
wclsFrameSaver: no samples within desired window for channel 9419
wclsFrameSaver: no samples within desired window for channel 9419
wclsFrameSaver: no samples within desired window for channel 9420
wclsFrameSaver: no samples within desired window for channel 9420
wclsFrameSaver: no samples within desired window for channel 9421
wclsFrameSaver: no samples within desired window for channel 9422
wclsFrameSaver: no samples within desired window for channel 9423
wclsFrameSaver: no samples within desired window for channel 9424
wclsFrameSaver: no samples within desired window for channel 9424
wclsFrameSaver: no samples within desired window for channel 9425
wclsFrameSaver: no samples within desired window for channel 9426
wclsFrameSaver: no samples within desired window for channel 9427
wclsFrameSaver: no samples within desired window for channel 9428
wclsFrameSaver: no samples within desired window for channel 9599
wclsFrameSaver: no samples within desired window for channel 9729
FrameSaver: q=1.04045e+06 n=788066 tag=wiener
28-Oct-2025 16:29:05 EDT  Closed output file "np04hd_raw_run032933_0000_dataflow4_datawriter_0_20241203T231000_1_233774_16_1761666047_deco_reco.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          104.846       440.889       2509.06       279.335       489.919        39     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        5.8097e-05    0.000105804   0.00028265    0.000102032   3.56528e-05      39     
produce:tpcrawdecoder:PDHDTPCReader                 22.9642       24.1173       26.0529       24.0845       0.51584        39     
produce:fembfilter:PDHDFEMBFilter                 0.000126517   0.000190361   0.000938491   0.000158738   0.000135774      39     
produce:wclsdatahd:WireCellToolkit                  63.5162       73.509        81.9576       72.8245       4.37251        39     
produce:gaushit:GausHitFinder                      0.543631       1.27781       2.36045       1.3169       0.489924        39     
produce:nhitsfilter:NumberOfHitsFilter            0.00022412    0.000787072   0.00495008    0.000653631   0.000736528      39     
produce:reco3d:SpacePointSolver                    0.250451       47.9935       136.814       44.9891       47.0739        39     
produce:hitpdune:DisambigFromSpacePoints           0.244367       4.10578       16.7714       3.91202       3.7436         39     
produce:pandora:StandardPandora                     4.99767       272.229       2205.8        121.491       441.409        39     
produce:pandoraWriter:StandardPandora              0.144035      0.353825       0.59251      0.356239      0.116816        39     
produce:pandoraTrack:LArPandoraTrackCreation       0.638436       4.91048       15.4903       4.81626       3.1455         39     
produce:pandoraShower:LArPandoraShowerCreation     0.678524       5.83296       15.5904       5.03714       3.67826        39     
produce:pandoracalo:Calorimetry                    0.404956       2.42102       8.59763       2.39804       1.64703        39     
produce:pandoracalonosce:Calorimetry                0.37943       2.32555       8.58469       2.15434       1.63948        39     
[art]:TriggerResults:TriggerResultInserter         3.655e-05    9.1243e-05    0.000366861   8.5241e-05    4.89026e-05      39     
end_path:out1:RootOutput                          1.3806e-05    2.29528e-05   5.7207e-05    2.2031e-05    6.89059e-06      39     
end_path:out1:RootOutput(write)                    0.511052       1.4389        3.06361       1.43304       0.56559        39     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4247.43 MB
  Peak resident set size usage (VmHWM): 2318.25 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'np04hd_raw_run032933_0000_dataflow4_datawriter_0_20241203T231000_1_233774_16_1761666047_deco_reco.root', 'start_time': 1761666047.8399954, 'end_time': 1761683346.142588}
lsing
total 993M
-rw-r--r-- 1 dune osgvo 720M Oct 28 16:29 np04hd_raw_run032933_0000_dataflow4_datawriter_0_20241203T231000_1_233774_16_1761666047_deco_reco.root
-rw-r--r-- 1 dune osgvo 263M Oct 28 16:29 Pandora_Events.pndr
-rw-r--r-- 1 dune osgvo 5.3M Oct 28 16:29 jobscript.log
-rw-r--r-- 1 dune osgvo 5.1M Oct 28 16:29 np04hd_raw_run032933_0000_dataflow4_datawriter_0_20241203T231000_1_233774_16_1761666047_deco_reco.err
-rw-r--r-- 1 dune osgvo 276K Oct 28 16:29 mem.db
-rw-r--r-- 1 dune osgvo  56K Oct 28 16:29 time.db
-rw-r--r-- 1 dune osgvo  38K Oct 28 16:29 np04hd_raw_run032933_0000_dataflow4_datawriter_0_20241203T231000_1_233774_16_1761666047_deco_reco.log
-rw-r--r-- 1 dune osgvo  19K Oct 28 16:29 pdhd_keepup_decoder.root
-rw-r--r-- 1 dune osgvo 3.5K Oct 28 16:29 Pandora_Geometry.xml
-rw-r--r-- 1 dune osgvo   83 Oct 28 11:40 all-input-dids.txt
-rw-r--r-- 1 dune osgvo    0 Oct 28 11:41 debugprod.log
disk usage
993M	.
justIN time: 2025-11-05 17:30:02 UTC       justIN version: 01.05.01