justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 235594.15@dunegpschedd02.fnal.gov

Jobsub ID235594.15@dunegpschedd02.fnal.gov
Workflow ID9431
Stage ID1
User namedrivera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-30 23:48:18
SiteIT_CNAF
EntryCMSHTPC_T1_IT_CNAF_condor_ce02
Last heartbeat2025-10-31 21:49:07
From worker nodeHostnamecn-leo-028.cr.cnaf.infn.it
cpuinfoIntel(R) Xeon(R) Platinum 8480+
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-30 23:49:16
Input fileshd-protodune:np04hd_raw_run032940_0004_dataflow4_datawriter_0_20241204T063322.hdf5
JobscriptExit code0
Real time21h (79148s)
CPU time21h (76001s = 96%)
Max RSS bytes2857254912 (2724 MiB)
Outputting started2025-10-31 21:48:25
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/drivera/lar1010/JustinTest/fnal/09431/1/001/np04hd_raw_run032940_0004_dataflow4_datawriter_0_20241204T063322_1_235594_15_1761868165_deco_reco.root
Finished2025-10-31 21:49:07
Saved logsjustin-logs:235594.15-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

window for channel 9346
wclsFrameSaver: no samples within desired window for channel 9347
wclsFrameSaver: no samples within desired window for channel 9347
wclsFrameSaver: no samples within desired window for channel 9348
wclsFrameSaver: no samples within desired window for channel 9349
wclsFrameSaver: no samples within desired window for channel 9350
wclsFrameSaver: no samples within desired window for channel 9351
wclsFrameSaver: no samples within desired window for channel 9352
wclsFrameSaver: no samples within desired window for channel 9353
wclsFrameSaver: no samples within desired window for channel 9354
wclsFrameSaver: no samples within desired window for channel 9355
wclsFrameSaver: no samples within desired window for channel 9356
wclsFrameSaver: no samples within desired window for channel 9356
wclsFrameSaver: no samples within desired window for channel 9357
wclsFrameSaver: no samples within desired window for channel 9358
wclsFrameSaver: no samples within desired window for channel 9358
wclsFrameSaver: no samples within desired window for channel 9359
wclsFrameSaver: no samples within desired window for channel 9360
wclsFrameSaver: no samples within desired window for channel 9360
wclsFrameSaver: no samples within desired window for channel 9361
wclsFrameSaver: no samples within desired window for channel 9362
wclsFrameSaver: no samples within desired window for channel 9363
wclsFrameSaver: no samples within desired window for channel 9363
wclsFrameSaver: no samples within desired window for channel 9364
wclsFrameSaver: no samples within desired window for channel 9365
wclsFrameSaver: no samples within desired window for channel 9365
wclsFrameSaver: no samples within desired window for channel 9366
wclsFrameSaver: no samples within desired window for channel 9366
wclsFrameSaver: no samples within desired window for channel 9367
wclsFrameSaver: no samples within desired window for channel 9368
wclsFrameSaver: no samples within desired window for channel 9368
wclsFrameSaver: no samples within desired window for channel 9369
wclsFrameSaver: no samples within desired window for channel 9370
wclsFrameSaver: no samples within desired window for channel 9371
wclsFrameSaver: no samples within desired window for channel 9372
wclsFrameSaver: no samples within desired window for channel 9373
wclsFrameSaver: no samples within desired window for channel 9374
wclsFrameSaver: no samples within desired window for channel 9375
wclsFrameSaver: no samples within desired window for channel 9376
wclsFrameSaver: no samples within desired window for channel 9376
wclsFrameSaver: no samples within desired window for channel 9377
wclsFrameSaver: no samples within desired window for channel 9378
wclsFrameSaver: no samples within desired window for channel 9379
wclsFrameSaver: no samples within desired window for channel 9380
wclsFrameSaver: no samples within desired window for channel 9381
wclsFrameSaver: no samples within desired window for channel 9382
wclsFrameSaver: no samples within desired window for channel 9383
wclsFrameSaver: no samples within desired window for channel 9383
wclsFrameSaver: no samples within desired window for channel 9384
wclsFrameSaver: no samples within desired window for channel 9385
wclsFrameSaver: no samples within desired window for channel 9386
wclsFrameSaver: no samples within desired window for channel 9386
wclsFrameSaver: no samples within desired window for channel 9386
wclsFrameSaver: no samples within desired window for channel 9387
wclsFrameSaver: no samples within desired window for channel 9388
wclsFrameSaver: no samples within desired window for channel 9389
wclsFrameSaver: no samples within desired window for channel 9390
wclsFrameSaver: no samples within desired window for channel 9391
wclsFrameSaver: no samples within desired window for channel 9392
wclsFrameSaver: no samples within desired window for channel 9392
wclsFrameSaver: no samples within desired window for channel 9393
wclsFrameSaver: no samples within desired window for channel 9394
wclsFrameSaver: no samples within desired window for channel 9395
wclsFrameSaver: no samples within desired window for channel 9395
wclsFrameSaver: no samples within desired window for channel 9396
wclsFrameSaver: no samples within desired window for channel 9396
wclsFrameSaver: no samples within desired window for channel 9396
wclsFrameSaver: no samples within desired window for channel 9397
wclsFrameSaver: no samples within desired window for channel 9398
wclsFrameSaver: no samples within desired window for channel 9399
wclsFrameSaver: no samples within desired window for channel 9400
wclsFrameSaver: no samples within desired window for channel 9401
wclsFrameSaver: no samples within desired window for channel 9402
wclsFrameSaver: no samples within desired window for channel 9403
wclsFrameSaver: no samples within desired window for channel 9404
wclsFrameSaver: no samples within desired window for channel 9405
wclsFrameSaver: no samples within desired window for channel 9406
wclsFrameSaver: no samples within desired window for channel 9407
wclsFrameSaver: no samples within desired window for channel 9689
FrameSaver: q=1.77951e+07 n=1880490 tag=wiener
31-Oct-2025 22:27:19 CET  Closed output file "np04hd_raw_run032940_0004_dataflow4_datawriter_0_20241204T063322_1_235594_15_1761868165_deco_reco.root"

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          266.557       1983.28       10386.8       1202.98       2046.2         39     
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        5.6918e-05    7.67176e-05   0.000165607    7.326e-05    1.74678e-05      39     
produce:tpcrawdecoder:PDHDTPCReader                 7.89146       19.646        46.0872       15.8676       10.2524        39     
produce:fembfilter:PDHDFEMBFilter                 0.00015308    0.000196728   0.000676492   0.000175067   8.52137e-05      39     
produce:wclsdatahd:WireCellToolkit                  66.4545       75.4587       175.659       73.3499       16.6268        39     
produce:gaushit:GausHitFinder                      0.685958       1.1373        1.70486       1.10447      0.184281        39     
produce:nhitsfilter:NumberOfHitsFilter            0.000591581   0.00118804    0.00198302    0.00110489    0.000353561      39     
produce:reco3d:SpacePointSolver                     18.3428       111.527       197.823       111.478       34.3281        39     
produce:hitpdune:DisambigFromSpacePoints            1.90685       10.5073       27.3992       10.0851       5.22743        39     
produce:pandora:StandardPandora                     132.521       1744.29       10032.5       991.478       2009.98        39     
produce:pandoraWriter:StandardPandora              0.244434      0.396267      0.603915      0.393821      0.0647249       39     
produce:pandoraTrack:LArPandoraTrackCreation        2.2848        6.6461        19.3669       5.77521       3.35704        39     
produce:pandoraShower:LArPandoraShowerCreation      2.39594       6.61479       18.4941       6.01757       3.16851        39     
produce:pandoracalo:Calorimetry                    0.997912       2.64423       7.56418       2.32859       1.25414        39     
produce:pandoracalonosce:Calorimetry               0.968543       2.56537       7.69465       2.28738       1.25229        39     
[art]:TriggerResults:TriggerResultInserter        7.1933e-05    9.65279e-05   0.000218401   9.2771e-05    2.27815e-05      39     
end_path:out1:RootOutput                          1.6803e-05    2.37099e-05   6.0948e-05    2.1483e-05    7.13066e-06      39     
end_path:out1:RootOutput(write)                    0.845673       1.3548        2.07452       1.33863      0.244107        39     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4926.83 MB
  Peak resident set size usage (VmHWM): 2857.25 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'np04hd_raw_run032940_0004_dataflow4_datawriter_0_20241204T063322_1_235594_15_1761868165_deco_reco.root', 'start_time': 1761868165.2344449, 'end_time': 1761946040.2129521}
lsing
total 1.3G
-rw-r--r-- 1 neutrino002 neutrino 910M Oct 31 22:27 np04hd_raw_run032940_0004_dataflow4_datawriter_0_20241204T063322_1_235594_15_1761868165_deco_reco.root
-rw-r--r-- 1 neutrino002 neutrino 370M Oct 31 22:26 Pandora_Events.pndr
-rw-r--r-- 1 neutrino002 neutrino 6.8M Oct 31 22:27 jobscript.log
-rw-r--r-- 1 neutrino002 neutrino 5.9M Oct 31 22:27 np04hd_raw_run032940_0004_dataflow4_datawriter_0_20241204T063322_1_235594_15_1761868165_deco_reco.err
-rw-r--r-- 1 neutrino002 neutrino 718K Oct 31 22:27 np04hd_raw_run032940_0004_dataflow4_datawriter_0_20241204T063322_1_235594_15_1761868165_deco_reco.log
-rw-r--r-- 1 neutrino002 neutrino 280K Oct 31 22:27 mem.db
-rw-r--r-- 1 neutrino002 neutrino  56K Oct 31 22:27 time.db
-rw-r--r-- 1 neutrino002 neutrino  19K Oct 31 22:27 pdhd_keepup_decoder.root
-rw-r--r-- 1 neutrino002 neutrino 3.5K Oct 31 22:27 Pandora_Geometry.xml
-rw-r--r-- 1 neutrino002 neutrino   83 Oct 31 00:49 all-input-dids.txt
-rw-r--r-- 1 neutrino002 neutrino    0 Oct 31 00:49 debugprod.log
disk usage
1.3G	.
justIN time: 2025-11-03 18:40:50 UTC       justIN version: 01.05.01