Jobsub ID 238301.0@dunegpschedd01.fnal.gov
| Jobsub ID | 238301.0@dunegpschedd01.fnal.gov | 
| Workflow ID | 9322 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-24 18:49:24 | 
| Site | ES_PIC | 
| Entry | DUNE_T1_ES_PIC_ce15-multicore | 
| Last heartbeat | 2025-10-24 22:10:37 | 
| From worker node | Hostname | hnode66.pic.es | 
| cpuinfo | AMD EPYC 7402P 24-Core Processor | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 216000 (60 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-24 18:50:03 | 
| Input files | monte-carlo-009322-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 3h (11962s) | 
| CPU time | 3h (10916s = 91%) | 
| Max RSS bytes | 4275765248 (4077 MiB) | 
| Outputting started | 2025-10-24 22:09:26 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09322/1/001/reco_stage1.root
  | 
| Finished | 2025-10-24 22:10:37 | 
| Saved logs | justin-logs:238301.0-dunegpschedd01.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
dcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 143527 traces, 0 summary
Retagger: tagging trace set: gauss with 107484 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 107484 traces tagged "gauss"
FrameSaver: q=3.6687e+06 n=1844514 tag=gauss
wclsFrameSaver: saving 143527 traces tagged "wiener"
FrameSaver: q=3.91857e+06 n=1623845 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 18623 XUs and 18947 XVs -> 190 XUVs
C:0 T:1 26800 XUs and 26552 XVs -> 1796 XUVs
C:0 T:2 162457 XUs and 123378 XVs -> 8718 XUVs
C:0 T:3 54315 XUs and 51423 XVs -> 614 XUVs
C:0 T:4 7543 XUs and 8666 XVs -> 116 XUVs
C:0 T:5 22783 XUs and 21670 XVs -> 2795 XUVs
C:0 T:6 146713 XUs and 175026 XVs -> 11168 XUVs
C:0 T:7 49937 XUs and 55373 XVs -> 767 XUVs
C:0 T:8 6836 XUs and 6416 XVs -> 64 XUVs
C:0 T:9 41621 XUs and 53805 XVs -> 3471 XUVs
C:0 T:10 124886 XUs and 165138 XVs -> 27035 XUVs
C:0 T:11 566 XUs and 462 XVs -> 46 XUVs
56780 XUVs total
12443 collection wire objects
52999 potential space points
Neighbour search...
10459367 tests to find 4349980 neighbours
Iterating with no regularization...
Begin: 6.58248e+07
0 5.1405e+07
1 5.04289e+07
2 5.02622e+07
3 5.02115e+07
4 5.01887e+07
Now with regularization...
Begin: 4.00629e+07
0 4.00371e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410091927
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410091927
fLifetime: 30000 [us]
25-Oct-2025 00:09:24 CEST  Closed output file "reco_stage1.root"
25-Oct-2025 00:09:24 CEST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          318.391       373.363       481.309       357.811       50.8501        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000781608   0.00329613    0.00598495    0.00340296    0.00149754       10     
reco:ophit:OpHitFinder                             0.225088      0.261396      0.320042      0.250317      0.0285165       10     
reco:opflash:OpFlashFinder                         0.130586      0.174996      0.220959      0.171255      0.0312923       10     
reco:opslicer:OpSlicer                              0.54477      0.653747      0.806328      0.634911      0.0864628       10     
reco:caldata:DataPrepModule                         4.25255       4.52549       5.01562       4.44421      0.235477        10     
reco:wclsdatasp:WireCellToolkit                     28.559        33.6224       38.1129       34.2052       2.64268        10     
reco:gaushit:GausHitFinder                          1.03727       1.22062       1.51029       1.17821      0.157573        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000479687   0.000563593   0.000710955   0.000541209   7.33206e-05      10     
reco:reco3d:SpacePointSolver                        7.01906       14.9045       30.6167       14.5135       6.19621        10     
reco:hitpdune:DisambigFromSpacePoints               1.28315       1.58476       2.58719       1.45993      0.362125        10     
reco:pandora:StandardPandora                        25.4854       35.6714       65.7349       32.7253       10.9152        10     
reco:pandoraWriter:StandardPandora                  0.31816      0.401796      0.549227      0.388465      0.0576936       10     
reco:pandoraTrack:LArPandoraTrackCreation           2.61766       3.75746       6.38792       3.53783       1.07414        10     
reco:pandoraShower:LArPandoraShowerCreation         3.35049       4.37495       6.4157        4.37115       0.83592        10     
reco:pandoracalo:Calorimetry                        1.40967       1.85429       2.39869       1.81294      0.304101        10     
reco:pandoracalonosce:Calorimetry                   1.29011       1.70011       2.31619       1.63641      0.298694        10     
reco:pandorapid:Chi2ParticleID                     0.0046371    0.00522917    0.00633915     0.0051294    0.000558373      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0363708     0.0452572     0.0615023     0.0435452    0.00645059       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00439546    0.00502887    0.00633893    0.00484136    0.00055948       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.71907       4.02929       5.77242       4.02598      0.732371        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.67104       3.91187       6.24098       3.75874      0.924936        10     
reco:emtrkmichelid:EmTrackMichelId                  183.632       217.871       323.937       208.08        40.8402        10     
reco:crttag:SingleCRTMatchingProducer             0.00767165     0.0136154     0.0249381     0.0118657    0.00533288       10     
reco:crtreco:TwoCRTMatchingProducer               0.00682832     0.0104245     0.0238458     0.0094709    0.00476792       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.765553      0.936788       1.29916      0.899713      0.144975        10     
reco:pandora2Track:LArPandoraTrackCreation          10.0768       13.4099       19.4687       12.7387       2.61476        10     
reco:pandora2calo:Calorimetry                       4.18665       5.76495       8.19209       5.61632       1.38262        10     
reco:pandora2calonosce:Calorimetry                  3.78609       5.63849       8.92768       5.19476       1.56381        10     
reco:pandora2pid:Chi2ParticleID                    0.0119488     0.0144384     0.0243539     0.0130869    0.00360139       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0478623     0.067823      0.130772      0.0582567     0.0244786       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0116728     0.014664      0.0252686     0.0133401    0.00383391       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.67151       4.63387       7.07351       4.26961       1.00801        10     
reco:pandora2Showercalo:ShowerCalorimetry           3.91857       4.81755       7.20424       4.37804      0.957913        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.67177       4.46664       5.74268       4.32383      0.697456        10     
[art]:TriggerResults:TriggerResultInserter        2.3271e-05    3.34482e-05   8.8563e-05    2.6361e-05    1.88027e-05      10     
end_path:out1:RootOutput                           4.68e-06     5.8252e-06     9.24e-06      5.315e-06    1.29669e-06      10     
end_path:out1:RootOutput(write)                     2.50799       2.87151       3.73019       2.78735      0.343768        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5086.34 MB
  Peak resident set size usage (VmHWM): 4275.77 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.85 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10591168
-rw-r--r-- 1 dune001 dune 2468995724 Oct 24 23:04 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2342947639 Oct 24 23:02 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2170455479 Oct 25 00:09 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1929033094 Oct 24 21:18 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1854568410 Oct 24 20:57 g4_stage1.root
-rw-r--r-- 1 dune001 dune   78723500 Oct 25 00:04 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune     243553 Oct 25 00:09 jobscript.log
-rw-r--r-- 1 dune001 dune     217088 Oct 25 00:09 mem.db
-rw-r--r-- 1 dune001 dune      62376 Oct 25 00:09 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune      36864 Oct 25 00:09 time.db
-rw-r--r-- 1 dune001 dune        519 Oct 24 23:05 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune        519 Oct 24 21:18 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune        519 Oct 25 00:09 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune         52 Oct 24 20:50 all-input-dids.txt
-rw-r--r-- 1 dune001 dune          7 Oct 25 00:09 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune          0 Oct 24 23:11 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune          0 Oct 24 23:05 debugprod.log