justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 233774.15@dunegpschedd02.fnal.gov

Jobsub ID233774.15@dunegpschedd02.fnal.gov
Workflow ID9413
Stage ID1
User namedrivera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-28 15:32:19
SiteUS_UChicago
EntryEngage_US_MWT2_uct2_gk02_condce_mcore
Last heartbeat2025-10-28 19:06:57
From worker nodeHostnamemwt2-c075.campuscluster.illinois.edu
cpuinfoAMD EPYC 7443 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-28 15:40:52
Input fileshd-protodune:np04hd_raw_run032933_0000_dataflow0_datawriter_0_20241203T231000.hdf5
JobscriptExit code0
Real time3h (12338s)
CPU time3h (11110s = 90%)
Max RSS bytes2125295616 (2026 MiB)
Outputting started2025-10-28 19:06:31
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/drivera/lar1010/JustinTest/fnal/09413/1/001/np04hd_raw_run032933_0000_dataflow0_datawriter_0_20241203T231000_1_233774_15_1761666071_deco_reco.root
Finished2025-10-28 19:06:57
Saved logsjustin-logs:233774.15-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

799
wclsFrameSaver: no samples within desired window for channel 8800
wclsFrameSaver: no samples within desired window for channel 8801
wclsFrameSaver: no samples within desired window for channel 8801
wclsFrameSaver: no samples within desired window for channel 8852
wclsFrameSaver: no samples within desired window for channel 8852
wclsFrameSaver: no samples within desired window for channel 8853
wclsFrameSaver: no samples within desired window for channel 8853
wclsFrameSaver: no samples within desired window for channel 9051
wclsFrameSaver: no samples within desired window for channel 9051
wclsFrameSaver: no samples within desired window for channel 9052
wclsFrameSaver: no samples within desired window for channel 9052
wclsFrameSaver: no samples within desired window for channel 9055
wclsFrameSaver: no samples within desired window for channel 9056
wclsFrameSaver: no samples within desired window for channel 9057
wclsFrameSaver: no samples within desired window for channel 9295
wclsFrameSaver: no samples within desired window for channel 9296
wclsFrameSaver: no samples within desired window for channel 9343
wclsFrameSaver: no samples within desired window for channel 9344
wclsFrameSaver: no samples within desired window for channel 9344
wclsFrameSaver: no samples within desired window for channel 9344
wclsFrameSaver: no samples within desired window for channel 9345
wclsFrameSaver: no samples within desired window for channel 9345
wclsFrameSaver: no samples within desired window for channel 9345
wclsFrameSaver: no samples within desired window for channel 9345
wclsFrameSaver: no samples within desired window for channel 9346
wclsFrameSaver: no samples within desired window for channel 9346
wclsFrameSaver: no samples within desired window for channel 9346
wclsFrameSaver: no samples within desired window for channel 9346
wclsFrameSaver: no samples within desired window for channel 9346
wclsFrameSaver: no samples within desired window for channel 9346
wclsFrameSaver: no samples within desired window for channel 9347
wclsFrameSaver: no samples within desired window for channel 9347
wclsFrameSaver: no samples within desired window for channel 9347
wclsFrameSaver: no samples within desired window for channel 9347
wclsFrameSaver: no samples within desired window for channel 9347
wclsFrameSaver: no samples within desired window for channel 9348
wclsFrameSaver: no samples within desired window for channel 9348
wclsFrameSaver: no samples within desired window for channel 9348
wclsFrameSaver: no samples within desired window for channel 9348
wclsFrameSaver: no samples within desired window for channel 9349
wclsFrameSaver: no samples within desired window for channel 9367
wclsFrameSaver: no samples within desired window for channel 9368
wclsFrameSaver: no samples within desired window for channel 9451
wclsFrameSaver: no samples within desired window for channel 9452
wclsFrameSaver: no samples within desired window for channel 9452
wclsFrameSaver: no samples within desired window for channel 9453
wclsFrameSaver: no samples within desired window for channel 9453
wclsFrameSaver: no samples within desired window for channel 9454
wclsFrameSaver: no samples within desired window for channel 9454
wclsFrameSaver: no samples within desired window for channel 9457
wclsFrameSaver: no samples within desired window for channel 9515
wclsFrameSaver: no samples within desired window for channel 9516
wclsFrameSaver: no samples within desired window for channel 9516
wclsFrameSaver: no samples within desired window for channel 9517
wclsFrameSaver: no samples within desired window for channel 9517
wclsFrameSaver: no samples within desired window for channel 9517
wclsFrameSaver: no samples within desired window for channel 9518
wclsFrameSaver: no samples within desired window for channel 9518
wclsFrameSaver: no samples within desired window for channel 9518
wclsFrameSaver: no samples within desired window for channel 9519
wclsFrameSaver: no samples within desired window for channel 9519
wclsFrameSaver: no samples within desired window for channel 9520
wclsFrameSaver: no samples within desired window for channel 9521
wclsFrameSaver: no samples within desired window for channel 9521
wclsFrameSaver: no samples within desired window for channel 9522
wclsFrameSaver: no samples within desired window for channel 9522
wclsFrameSaver: no samples within desired window for channel 9523
wclsFrameSaver: no samples within desired window for channel 9523
wclsFrameSaver: no samples within desired window for channel 9523
wclsFrameSaver: no samples within desired window for channel 9524
wclsFrameSaver: no samples within desired window for channel 9524
wclsFrameSaver: no samples within desired window for channel 9525
wclsFrameSaver: no samples within desired window for channel 9525
wclsFrameSaver: no samples within desired window for channel 9526
wclsFrameSaver: no samples within desired window for channel 9527
wclsFrameSaver: no samples within desired window for channel 9527
wclsFrameSaver: no samples within desired window for channel 9528
wclsFrameSaver: no samples within desired window for channel 9528
wclsFrameSaver: no samples within desired window for channel 9705
wclsFrameSaver: no samples within desired window for channel 9739
FrameSaver: q=1.20883e+06 n=1002399 tag=wiener
28-Oct-2025 14:06:28 CDT  Closed output file "np04hd_raw_run032933_0000_dataflow0_datawriter_0_20241203T231000_1_233774_15_1761666071_deco_reco.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          116.134       304.991       1145.21       150.823       264.434        40     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        7.9559e-05    0.000119082   0.000244981   0.000103014   4.15188e-05      40     
produce:tpcrawdecoder:PDHDTPCReader                 23.3134       24.3238       25.0078       24.3689      0.358678        40     
produce:fembfilter:PDHDFEMBFilter                 0.000110568   0.000178176   0.000548109   0.000163171   7.31364e-05      40     
produce:wclsdatahd:WireCellToolkit                  68.2779       76.977        90.0238       75.9887       4.29445        40     
produce:gaushit:GausHitFinder                       0.61596       1.20616       2.13542       1.00791       0.50651        40     
produce:nhitsfilter:NumberOfHitsFilter            0.000267592   0.000618498   0.00135222    0.000611874    0.000226        40     
produce:reco3d:SpacePointSolver                    0.428661       28.0749       127.668       1.3034        38.6864        40     
produce:hitpdune:DisambigFromSpacePoints           0.319871       3.07667       10.6508       1.25786       3.17211        40     
produce:pandora:StandardPandora                     9.37189       154.673       886.616       33.3962       216.772        40     
produce:pandoraWriter:StandardPandora              0.174782      0.362858      0.606693      0.330863      0.135844        40     
produce:pandoraTrack:LArPandoraTrackCreation        1.09943       4.53987       10.5676       3.37894       2.97095        40     
produce:pandoraShower:LArPandoraShowerCreation      1.00451       5.59024       12.9283       4.80899       3.60473        40     
produce:pandoracalo:Calorimetry                    0.548507       2.25281       5.76971       1.3377        1.59056        40     
produce:pandoracalonosce:Calorimetry               0.519514       2.17231       5.19972       1.36451       1.54837        40     
[art]:TriggerResults:TriggerResultInserter        4.1638e-05    8.2262e-05    0.000163327   8.42185e-05   2.14894e-05      40     
end_path:out1:RootOutput                          1.1121e-05    2.35232e-05   5.3029e-05    2.20815e-05   7.54165e-06      40     
end_path:out1:RootOutput(write)                     0.70029       1.39999       2.6022        1.1679       0.560937        40     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4121.01 MB
  Peak resident set size usage (VmHWM): 2125.3 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'np04hd_raw_run032933_0000_dataflow0_datawriter_0_20241203T231000_1_233774_15_1761666071_deco_reco.root', 'start_time': 1761666071.4465342, 'end_time': 1761678389.8159611}
lsing
total 920M
-rw-r--r-- 1 dune osgvo 665M Oct 28 14:06 np04hd_raw_run032933_0000_dataflow0_datawriter_0_20241203T231000_1_233774_15_1761666071_deco_reco.root
-rw-r--r-- 1 dune osgvo 243M Oct 28 14:06 Pandora_Events.pndr
-rw-r--r-- 1 dune osgvo 6.6M Oct 28 14:06 jobscript.log
-rw-r--r-- 1 dune osgvo 6.4M Oct 28 14:06 np04hd_raw_run032933_0000_dataflow0_datawriter_0_20241203T231000_1_233774_15_1761666071_deco_reco.err
-rw-r--r-- 1 dune osgvo 284K Oct 28 14:06 mem.db
-rw-r--r-- 1 dune osgvo  56K Oct 28 14:06 time.db
-rw-r--r-- 1 dune osgvo  44K Oct 28 14:06 np04hd_raw_run032933_0000_dataflow0_datawriter_0_20241203T231000_1_233774_15_1761666071_deco_reco.log
-rw-r--r-- 1 dune osgvo  20K Oct 28 14:06 pdhd_keepup_decoder.root
-rw-r--r-- 1 dune osgvo 3.5K Oct 28 14:06 Pandora_Geometry.xml
-rw-r--r-- 1 dune osgvo   83 Oct 28 10:41 all-input-dids.txt
-rw-r--r-- 1 dune osgvo    0 Oct 28 10:41 debugprod.log
disk usage
920M	.
justIN time: 2025-11-05 17:30:01 UTC       justIN version: 01.05.01