justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 298724.10@dunegpschedd01.fnal.gov

Jobsub ID298724.10@dunegpschedd01.fnal.gov
Workflow ID12195
Stage ID1
User namemsiden@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2096103424 (1999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-21 19:54:08
SiteUS_UChicago
EntryEngage_US_MWT2_iut2_gk02_condce_mcore
Last heartbeat2026-01-21 21:30:41
From worker nodeHostnameuct2-c539.mwt2.org
cpuinfoAMD EPYC 7402 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-21 19:55:31
Input fileshd-protodune:np04hd_raw_run027306_0002_dataflow2_datawriter_0_20240619T175558.hdf5
JobscriptExit code0
Real time1h (5694s)
CPU time1h (5144s = 90%)
Max RSS bytes2025029632 (1931 MiB)
Outputting started2026-01-21 21:30:25
Output files
Finished2026-01-21 21:30:41
Saved logsjustin-logs:298724.10-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

o samples within desired window for channel 9360
wclsFrameSaver: no samples within desired window for channel 9361
wclsFrameSaver: no samples within desired window for channel 9362
wclsFrameSaver: no samples within desired window for channel 9362
wclsFrameSaver: no samples within desired window for channel 9362
wclsFrameSaver: no samples within desired window for channel 9363
wclsFrameSaver: no samples within desired window for channel 9363
wclsFrameSaver: no samples within desired window for channel 9364
wclsFrameSaver: no samples within desired window for channel 9364
wclsFrameSaver: no samples within desired window for channel 9364
wclsFrameSaver: no samples within desired window for channel 9365
wclsFrameSaver: no samples within desired window for channel 9366
wclsFrameSaver: no samples within desired window for channel 9367
wclsFrameSaver: no samples within desired window for channel 9367
wclsFrameSaver: no samples within desired window for channel 9368
wclsFrameSaver: no samples within desired window for channel 9369
wclsFrameSaver: no samples within desired window for channel 9369
wclsFrameSaver: no samples within desired window for channel 9370
wclsFrameSaver: no samples within desired window for channel 9370
wclsFrameSaver: no samples within desired window for channel 9371
wclsFrameSaver: no samples within desired window for channel 9372
wclsFrameSaver: no samples within desired window for channel 9373
wclsFrameSaver: no samples within desired window for channel 9374
wclsFrameSaver: no samples within desired window for channel 9375
wclsFrameSaver: no samples within desired window for channel 9376
wclsFrameSaver: no samples within desired window for channel 9377
wclsFrameSaver: no samples within desired window for channel 9377
wclsFrameSaver: no samples within desired window for channel 9378
wclsFrameSaver: no samples within desired window for channel 9378
wclsFrameSaver: no samples within desired window for channel 9379
wclsFrameSaver: no samples within desired window for channel 9379
wclsFrameSaver: no samples within desired window for channel 9380
wclsFrameSaver: no samples within desired window for channel 9381
wclsFrameSaver: no samples within desired window for channel 9381
wclsFrameSaver: no samples within desired window for channel 9382
wclsFrameSaver: no samples within desired window for channel 9382
wclsFrameSaver: no samples within desired window for channel 9382
wclsFrameSaver: no samples within desired window for channel 9383
wclsFrameSaver: no samples within desired window for channel 9384
wclsFrameSaver: no samples within desired window for channel 9385
wclsFrameSaver: no samples within desired window for channel 9385
wclsFrameSaver: no samples within desired window for channel 9386
wclsFrameSaver: no samples within desired window for channel 9394
wclsFrameSaver: no samples within desired window for channel 9395
wclsFrameSaver: no samples within desired window for channel 9395
wclsFrameSaver: no samples within desired window for channel 9396
wclsFrameSaver: no samples within desired window for channel 9397
wclsFrameSaver: no samples within desired window for channel 9398
wclsFrameSaver: no samples within desired window for channel 9399
wclsFrameSaver: no samples within desired window for channel 9400
wclsFrameSaver: no samples within desired window for channel 9401
wclsFrameSaver: no samples within desired window for channel 9401
wclsFrameSaver: no samples within desired window for channel 9402
wclsFrameSaver: no samples within desired window for channel 9403
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9405
wclsFrameSaver: no samples within desired window for channel 9426
wclsFrameSaver: no samples within desired window for channel 9466
wclsFrameSaver: no samples within desired window for channel 9497
wclsFrameSaver: no samples within desired window for channel 9564
wclsFrameSaver: no samples within desired window for channel 9571
wclsFrameSaver: no samples within desired window for channel 9630
wclsFrameSaver: no samples within desired window for channel 9631
wclsFrameSaver: no samples within desired window for channel 9654
wclsFrameSaver: no samples within desired window for channel 9667
wclsFrameSaver: no samples within desired window for channel 9668
wclsFrameSaver: no samples within desired window for channel 9669
wclsFrameSaver: no samples within desired window for channel 9670
wclsFrameSaver: no samples within desired window for channel 9671
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9746
wclsFrameSaver: no samples within desired window for channel 9747
wclsFrameSaver: no samples within desired window for channel 9748
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9749
wclsFrameSaver: no samples within desired window for channel 9753
wclsFrameSaver: no samples within desired window for channel 9763
wclsFrameSaver: no samples within desired window for channel 9763
wclsFrameSaver: no samples within desired window for channel 9764
FrameSaver: q=1.25559e+08 n=1902169 tag=wiener
106 116 122
0.0105 0.0205 0.02505
126 118 121
0.0305 0.0225 0.02405
119 120 124
0.0235 0.0245 0.02705
84 109 114
-0.0115 0.0135 0.01705
21-Jan-2026 15:30:23 CST  Closed output file "np04hd_raw_run027306_0002_dataflow2_datawriter_0_20240619T175558_20260121T213023_keepup.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          10.6236       155.645       718.652       155.445       132.573        36     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        7.6925e-05    0.000128547   0.000324551   0.000121183   3.95796e-05      36     
produce:tpcrawdecoder:PDHDTPCReader                 10.3773       12.8564       26.1885       12.754        2.7099         36     
produce:triggerrawdecoder:PDHDTriggerReader3       0.0451041     0.0488354     0.121702      0.0457153     0.0126911       36     
produce:timingrawdecoder:PDHDTimingRawDecoder      0.0228378     0.0243435     0.0604934     0.0230502    0.00619451       36     
produce:ctbrawdecoder:PDHDCTBRawDecoder            0.112774      0.117667      0.256677      0.113582      0.0235133       36     
produce:beamevent:BeamEvent                       0.00502288      0.10175       3.15725     0.00922886     0.517228        36     
produce:fembfilter:PDHDFEMBFilter                 5.9542e-05    0.000164522   0.000683227   0.000148053   0.000106587      36     
produce:wclsdatahd:WireCellToolkit                  85.4031       96.3196       100.938       97.0412       3.6181         26     
produce:gaushit:GausHitFinder                      0.549926       1.06801       1.89548       1.01299      0.277053        26     
produce:nhitsfilter:NumberOfHitsFilter            0.000363134   0.000617663   0.000982731   0.000563496   0.000168487      26     
produce:reco3d:SpacePointSolver                    0.674548       2.06559       4.84695       1.91289       1.13309        25     
produce:hitpdune:DisambigFromSpacePoints           0.448332       1.07812       2.22497       1.01129      0.440575        25     
produce:pandora:StandardPandora                     12.5235       89.523        592.833       50.5639       113.589        25     
produce:pandoraWriter:StandardPandora              0.217445      0.315709      0.456502       0.31455      0.0630223       25     
produce:pandoraTrack:LArPandoraTrackCreation        1.54214       4.58788       9.10155       4.27281       2.0768         25     
produce:pandoraShower:LArPandoraShowerCreation      1.26579       4.79961       10.2844       4.63677       2.3938         25     
[art]:TriggerResults:TriggerResultInserter        4.0125e-05    9.62025e-05   0.000477029   8.11225e-05   7.02508e-05      36     
end_path:out1:RootOutput                           4.779e-06    2.01271e-05   6.2739e-05    2.0649e-05    1.02697e-05      36     
end_path:out1:RootOutput(write)                    0.0099595     0.861702       1.75638       1.02806      0.558681        36     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 16654.7 MB
  Peak resident set size usage (VmHWM): 2025.03 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 487M
-rw-r--r--. 1 dune osgvo 352M Jan 21 15:30 np04hd_raw_run027306_0002_dataflow2_datawriter_0_20240619T175558_20260121T213023_keepup.root
-rw-r--r--. 1 dune osgvo 130M Jan 21 15:27 Pandora_Events.pndr
-rw-r--r--. 1 dune osgvo 5.2M Jan 21 15:30 jobscript.log
-rw-r--r--. 1 dune osgvo 244K Jan 21 15:30 mem.db
-rw-r--r--. 1 dune osgvo  48K Jan 21 15:30 time.db
-rw-r--r--. 1 dune osgvo  18K Jan 21 15:30 np04hd_raw_run027306_0002_dataflow2_datawriter_0_20240619T175558.hdf5_calibana.root
-rw-r--r--. 1 dune osgvo 3.5K Jan 21 15:30 Pandora_Geometry.xml
-rw-r--r--. 1 dune osgvo   83 Jan 21 13:55 all-input-dids.txt
-rw-r--r--. 1 dune osgvo    0 Jan 21 13:55 debugprod.log
disk usage
487M	.
justIN time: 2026-02-05 11:22:06 UTC       justIN version: 01.06.00