Jobsub ID 236449.1@dunegpschedd02.fnal.gov
| Jobsub ID | 236449.1@dunegpschedd02.fnal.gov | 
| Workflow ID | 9534 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-11-02 23:14:06 | 
| Site | ES_PIC | 
| Entry | DUNE_T1_ES_PIC_ce15-multicore | 
| Last heartbeat | 2025-11-03 03:30:10 | 
| From worker node | Hostname | hnode52.pic.es | 
| cpuinfo | AMD EPYC 7402P 24-Core Processor | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 216000 (60 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-11-02 23:14:59 | 
| Input files | monte-carlo-009534-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 4h (15236s) | 
| CPU time | 4h (14639s = 96%) | 
| Max RSS bytes | 4437413888 (4231 MiB) | 
| Outputting started | 2025-11-03 03:28:56 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09534/1/001/reco_stage1.root
  | 
| Finished | 2025-11-03 03:30:10 | 
| Saved logs | justin-logs:236449.1-dunegpschedd02.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
DigitPrepService:prepare:   Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 108539 traces, 0 summary
Retagger: tagging trace set: gauss with 87192 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 87192 traces tagged "gauss"
FrameSaver: q=3.02751e+06 n=1620739 tag=gauss
wclsFrameSaver: saving 108539 traces tagged "wiener"
FrameSaver: q=3.18367e+06 n=1469480 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 32190 XUs and 35903 XVs -> 334 XUVs
C:0 T:1 56979 XUs and 57031 XVs -> 2672 XUVs
C:0 T:2 68639 XUs and 96171 XVs -> 2883 XUVs
C:0 T:3 38113 XUs and 44028 XVs -> 248 XUVs
C:0 T:4 8729 XUs and 10194 XVs -> 81 XUVs
C:0 T:5 30829 XUs and 28770 XVs -> 2976 XUVs
C:0 T:6 76702 XUs and 86005 XVs -> 3768 XUVs
C:0 T:7 33049 XUs and 35015 XVs -> 301 XUVs
C:0 T:8 9414 XUs and 9253 XVs -> 89 XUVs
C:0 T:9 54310 XUs and 71208 XVs -> 3749 XUVs
C:0 T:10 22305 XUs and 27770 XVs -> 4403 XUVs
C:0 T:11 546 XUs and 275 XVs -> 61 XUVs
21565 XUVs total
9823 collection wire objects
20075 potential space points
Neighbour search...
849965 tests to find 453170 neighbours
Iterating with no regularization...
Begin: 8.57933e+07
0 7.81749e+07
1 7.76298e+07
2 7.75642e+07
Now with regularization...
Begin: 6.84728e+07
0 6.84597e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410276672
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410276672
fLifetime: 30000 [us]
03-Nov-2025 04:28:54 CET  Closed output file "reco_stage1.root"
03-Nov-2025 04:28:54 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          443.799       531.381       765.274       514.698       93.1281        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000946305   0.00401646    0.00663578    0.00394935     0.0019258       10     
reco:ophit:OpHitFinder                             0.267209      0.372191      0.445357      0.368417      0.0499983       10     
reco:opflash:OpFlashFinder                         0.194227      0.233031      0.295723      0.231947      0.0344797       10     
reco:opslicer:OpSlicer                             0.641953      0.935801       1.14408      0.928003      0.140692        10     
reco:caldata:DataPrepModule                         4.49928       6.52979       7.37185       6.69576      0.719459        10     
reco:wclsdatasp:WireCellToolkit                     36.5776       44.2656       50.3876       44.2863       3.99217        10     
reco:gaushit:GausHitFinder                          1.07887       1.64755       2.27527       1.63844      0.313465        10     
reco:nhitsfilter:NumberOfHitsFilter               0.00053667    0.000717799   0.000896275   0.000715612   0.000100779      10     
reco:reco3d:SpacePointSolver                        9.19839       17.4808       28.0715       15.3892       5.87844        10     
reco:hitpdune:DisambigFromSpacePoints               1.40345       2.04783       3.25166       1.92043      0.482325        10     
reco:pandora:StandardPandora                        40.0066       57.0785       115.827       49.4211       21.1985        10     
reco:pandoraWriter:StandardPandora                 0.440179      0.561885      0.818266       0.55426       0.10387        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.75391       6.46148       10.4702       5.38699       2.29311        10     
reco:pandoraShower:LArPandoraShowerCreation         4.11725       6.51196       12.4612       5.2873        2.69472        10     
reco:pandoracalo:Calorimetry                        2.12954       3.26453       5.39946       2.91363      0.954928        10     
reco:pandoracalonosce:Calorimetry                   1.9307        2.99723       4.98833       2.61365      0.896497        10     
reco:pandorapid:Chi2ParticleID                    0.00536717    0.00878376     0.0105164    0.00902261    0.00141124       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0523318     0.0772377     0.092387      0.0768243     0.0110782       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00513958    0.00796785    0.00999809     0.0081841    0.00152011       10     
reco:pandoraShowercalo:ShowerCalorimetry            3.67399       6.22327       11.2288       5.46276       2.28667        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       3.57745       6.31444       12.236        5.49723       2.51378        10     
reco:emtrkmichelid:EmTrackMichelId                  259.777       302.157       407.091       298.295       44.0987        10     
reco:crttag:SingleCRTMatchingProducer              0.0102413     0.0151272     0.0213483     0.0147465    0.00386355       10     
reco:crtreco:TwoCRTMatchingProducer               0.00889495     0.0117275     0.0155226     0.0112426    0.00225322       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.983176       1.17136       1.42359       1.10671      0.161996        10     
reco:pandora2Track:LArPandoraTrackCreation          13.3792       20.7298       33.0941       19.3922       5.73837        10     
reco:pandora2calo:Calorimetry                       6.15017       9.07045       13.8848       8.23915       2.22125        10     
reco:pandora2calonosce:Calorimetry                  6.04588       8.91145       13.8561       8.71558       2.34517        10     
reco:pandora2pid:Chi2ParticleID                    0.0133573     0.0204411     0.0302572     0.0196146    0.00464804       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0604015     0.0960921     0.145818      0.0941331     0.0239555       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0135658     0.0204725     0.0310807     0.0197816     0.0048536       10     
reco:pandora2Shower:LArPandoraShowerCreation        5.03608       7.30282       10.9879       7.0216        1.80175        10     
reco:pandora2Showercalo:ShowerCalorimetry           4.56386       7.78396       10.8003       7.70292       1.91356        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      4.10996       7.19365       9.98337       7.60841       1.70731        10     
[art]:TriggerResults:TriggerResultInserter        2.4061e-05    4.18676e-05   0.000128385   3.36165e-05   2.90081e-05      10     
end_path:out1:RootOutput                           5.18e-06     6.3012e-06    1.2131e-05     5.695e-06    1.9766e-06       10     
end_path:out1:RootOutput(write)                     2.66066       3.74192       5.20995       3.62131       0.69623        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5249.84 MB
  Peak resident set size usage (VmHWM): 4437.41 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.29 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.18 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.17 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10944576
-rw-r--r-- 1 dune001 dune 2544400482 Nov  3 02:57 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2413383835 Nov  3 02:54 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2249410371 Nov  3 04:28 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1998085267 Nov  3 00:41 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1921797333 Nov  3 00:24 g4_stage1.root
-rw-r--r-- 1 dune001 dune   79538380 Nov  3 04:23 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune     242784 Nov  3 04:28 jobscript.log
-rw-r--r-- 1 dune001 dune     217088 Nov  3 04:28 mem.db
-rw-r--r-- 1 dune001 dune      62376 Nov  3 04:28 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune      36864 Nov  3 04:28 time.db
-rw-r--r-- 1 dune001 dune        519 Nov  3 02:57 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune        519 Nov  3 00:41 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune        519 Nov  3 04:28 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune         52 Nov  3 00:15 all-input-dids.txt
-rw-r--r-- 1 dune001 dune          7 Nov  3 04:28 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune          0 Nov  3 03:06 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune          0 Nov  3 02:57 debugprod.log