justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 295531.11@dunegpschedd02.fnal.gov

Jobsub ID295531.11@dunegpschedd02.fnal.gov
Workflow ID12400
Stage ID1
User namemsiden@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2096103424 (1999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-26 12:06:05
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-26 12:08:27
From worker nodeHostnamedunegli-8435670-0-fnpc22001.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-26 12:06:16
Input fileshd-protodune:np04hd_raw_run027308_0001_dataflow0_datawriter_0_20240619T182104.hdf5
JobscriptExit code0
Real time2m (124s)
CPU time1m (108s = 87%)
Max RSS bytes1607487488 (1533 MiB)
Outputting started2026-01-26 12:08:20
Output files
Finished2026-01-26 12:08:27
Saved logsjustin-logs:295531.11-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: no samples within desired window for channel 9266
wclsFrameSaver: no samples within desired window for channel 9267
wclsFrameSaver: no samples within desired window for channel 9267
wclsFrameSaver: no samples within desired window for channel 9267
wclsFrameSaver: no samples within desired window for channel 9268
wclsFrameSaver: no samples within desired window for channel 9268
wclsFrameSaver: no samples within desired window for channel 9268
wclsFrameSaver: no samples within desired window for channel 9272
wclsFrameSaver: no samples within desired window for channel 9280
wclsFrameSaver: no samples within desired window for channel 9282
wclsFrameSaver: no samples within desired window for channel 9282
wclsFrameSaver: no samples within desired window for channel 9294
wclsFrameSaver: no samples within desired window for channel 9300
wclsFrameSaver: no samples within desired window for channel 9307
wclsFrameSaver: no samples within desired window for channel 9307
wclsFrameSaver: no samples within desired window for channel 9406
wclsFrameSaver: no samples within desired window for channel 9406
wclsFrameSaver: no samples within desired window for channel 9434
wclsFrameSaver: no samples within desired window for channel 9435
wclsFrameSaver: no samples within desired window for channel 9436
wclsFrameSaver: no samples within desired window for channel 9436
wclsFrameSaver: no samples within desired window for channel 9437
wclsFrameSaver: no samples within desired window for channel 9438
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9440
wclsFrameSaver: no samples within desired window for channel 9441
wclsFrameSaver: no samples within desired window for channel 9442
wclsFrameSaver: no samples within desired window for channel 9443
wclsFrameSaver: no samples within desired window for channel 9444
wclsFrameSaver: no samples within desired window for channel 9445
wclsFrameSaver: no samples within desired window for channel 9446
wclsFrameSaver: no samples within desired window for channel 9447
wclsFrameSaver: no samples within desired window for channel 9448
wclsFrameSaver: no samples within desired window for channel 9449
wclsFrameSaver: no samples within desired window for channel 9450
wclsFrameSaver: no samples within desired window for channel 9450
wclsFrameSaver: no samples within desired window for channel 9451
wclsFrameSaver: no samples within desired window for channel 9452
wclsFrameSaver: no samples within desired window for channel 9453
wclsFrameSaver: no samples within desired window for channel 9454
wclsFrameSaver: no samples within desired window for channel 9454
wclsFrameSaver: no samples within desired window for channel 9455
wclsFrameSaver: no samples within desired window for channel 9456
wclsFrameSaver: no samples within desired window for channel 9457
wclsFrameSaver: no samples within desired window for channel 9458
wclsFrameSaver: no samples within desired window for channel 9458
wclsFrameSaver: no samples within desired window for channel 9459
wclsFrameSaver: no samples within desired window for channel 9460
wclsFrameSaver: no samples within desired window for channel 9461
wclsFrameSaver: no samples within desired window for channel 9462
wclsFrameSaver: no samples within desired window for channel 9462
wclsFrameSaver: no samples within desired window for channel 9463
wclsFrameSaver: no samples within desired window for channel 9464
wclsFrameSaver: no samples within desired window for channel 9465
wclsFrameSaver: no samples within desired window for channel 9466
wclsFrameSaver: no samples within desired window for channel 9466
wclsFrameSaver: no samples within desired window for channel 9467
wclsFrameSaver: no samples within desired window for channel 9468
wclsFrameSaver: no samples within desired window for channel 9468
wclsFrameSaver: no samples within desired window for channel 9478
wclsFrameSaver: no samples within desired window for channel 9479
wclsFrameSaver: no samples within desired window for channel 9480
wclsFrameSaver: no samples within desired window for channel 9481
wclsFrameSaver: no samples within desired window for channel 9487
wclsFrameSaver: no samples within desired window for channel 9491
wclsFrameSaver: no samples within desired window for channel 9508
wclsFrameSaver: no samples within desired window for channel 9509
wclsFrameSaver: no samples within desired window for channel 9513
wclsFrameSaver: no samples within desired window for channel 9531
wclsFrameSaver: no samples within desired window for channel 9532
wclsFrameSaver: no samples within desired window for channel 9715
FrameSaver: q=2.19472e+06 n=1054941 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 6570 XUs and 5013 XVs -> 75 XUVs
C:0 T:1 100668 XUs and 80682 XVs -> 2896 XUVs
C:0 T:2 51037 XUs and 54098 XVs -> 846 XUVs
C:0 T:3 37 XUs and 35 XVs -> 1 XUVs
C:0 T:4 217 XUs and 179 XVs -> 2 XUVs
C:0 T:5 33796 XUs and 36374 XVs -> 658 XUVs
C:0 T:6 36333 XUs and 42048 XVs -> 939 XUVs
C:0 T:7 86 XUs and 108 XVs -> 0 XUVs
5417 XUVs total
2819 collection wire objects
5417 potential space points
Neighbour search...
130411 tests to find 67596 neighbours
Iterating with no regularization...
Begin: 4.95452e+07
0 4.62527e+07
1 4.60578e+07
2 4.60456e+07
Now with regularization...
Begin: 4.44212e+07
0 4.44171e+07
26-Jan-2026 12:08:17 UTC  Opened output file with pattern "%ifb_%tc_keepup.root"
26-Jan-2026 12:08:20 UTC  Closed output file "np04hd_raw_run027308_0001_dataflow0_datawriter_0_20240619T182104_20260126T120820_keepup.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          85.6535       85.6535       85.6535       85.6535          0            1     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        0.000204538   0.000204538   0.000204538   0.000204538        0            1     
produce:tpcrawdecoder:PDHDTPCReader                 10.7963       10.7963       10.7963       10.7963          0            1     
produce:triggerrawdecoder:PDHDTriggerReader3       0.0550411     0.0550411     0.0550411     0.0550411         0            1     
produce:timingrawdecoder:PDHDTimingRawDecoder      0.0271881     0.0271881     0.0271881     0.0271881         0            1     
produce:ctbrawdecoder:PDHDCTBRawDecoder            0.133556      0.133556      0.133556      0.133556          0            1     
produce:beamevent:BeamEvent                        0.288558      0.288558      0.288558      0.288558          0            1     
produce:fembfilter:PDHDFEMBFilter                 0.000750256   0.000750256   0.000750256   0.000750256        0            1     
produce:wclsdatahd:WireCellToolkit                  49.6177       49.6177       49.6177       49.6177          0            1     
produce:gaushit:GausHitFinder                      0.533709      0.533709      0.533709      0.533709          0            1     
produce:nhitsfilter:NumberOfHitsFilter            0.00115391    0.00115391    0.00115391    0.00115391         0            1     
produce:reco3d:SpacePointSolver                    0.933875      0.933875      0.933875      0.933875          0            1     
produce:hitpdune:DisambigFromSpacePoints           0.449018      0.449018      0.449018      0.449018          0            1     
produce:pandora:StandardPandora                     19.2888       19.2888       19.2888       19.2888          0            1     
produce:pandoraWriter:StandardPandora              0.136073      0.136073      0.136073      0.136073          0            1     
produce:pandoraTrack:LArPandoraTrackCreation        1.32523       1.32523       1.32523       1.32523          0            1     
produce:pandoraShower:LArPandoraShowerCreation      1.35108       1.35108       1.35108       1.35108          0            1     
[art]:TriggerResults:TriggerResultInserter         7.89e-05      7.89e-05      7.89e-05      7.89e-05          0            1     
end_path:out1:RootOutput                          2.4837e-05    2.4837e-05    2.4837e-05    2.4837e-05         0            1     
end_path:out1:RootOutput(write)                    0.654886      0.654886      0.654886      0.654886          0            1     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 20612.8 MB
  Peak resident set size usage (VmHWM): 1607.49 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 19M
-rw-r--r-- 1 dunegli fnalgrid  13M Jan 26 12:08 np04hd_raw_run027308_0001_dataflow0_datawriter_0_20240619T182104_20260126T120820_keepup.root
-rw-r--r-- 1 dunegli fnalgrid 4.9M Jan 26 12:08 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 684K Jan 26 12:08 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid  44K Jan 26 12:08 mem.db
-rw-r--r-- 1 dunegli fnalgrid  16K Jan 26 12:08 time.db
-rw-r--r-- 1 dunegli fnalgrid 7.2K Jan 26 12:08 calibana.root
-rw-r--r-- 1 dunegli fnalgrid 3.5K Jan 26 12:08 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid   83 Jan 26 12:06 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid    0 Jan 26 12:06 debugprod.log
disk usage
19M	.
justIN time: 2026-02-04 20:42:30 UTC       justIN version: 01.06.00