Jobsub ID 232382.1@dunegpschedd02.fnal.gov
| Jobsub ID | 232382.1@dunegpschedd02.fnal.gov | 
| Workflow ID | 9291 | 
| Stage ID | 1 | 
| User name | pmelas@fnal.gov | 
| HTCondor Group | group_dune | 
| Requested | Processors | 1 | 
| GPU | No | 
| RSS bytes | 8388608000 (8000 MiB) | 
| Wall seconds limit | 86400 (24 hours) | 
| Submitted time | 2025-10-23 18:01:59 | 
| Site | ES_PIC | 
| Entry | DUNE_T1_ES_PIC_ce16-multicore | 
| Last heartbeat | 2025-10-24 00:59:59 | 
| From worker node | Hostname | td828.pic.es | 
| cpuinfo | AMD EPYC 7452 32-Core Processor | 
| OS release | Scientific Linux release 7.9 (Nitrogen) | 
| Processors | 1 | 
| RSS bytes | 10485760000 (10000 MiB) | 
| Wall seconds limit | 216000 (60 hours) | 
| GPU |  | 
| Inner Apptainer? | True | 
| Job state | finished | 
| Started | 2025-10-23 18:02:41 | 
| Input files | monte-carlo-009291-000001
  | 
| Jobscript | Exit code | 0 | 
| Real time | 6h (24529s) | 
| CPU time | 6h (23458s = 95%) | 
| Max RSS bytes | 4552445952 (4341 MiB) | 
| Outputting started | 2025-10-24 00:51:32 | 
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09291/1/001/reco_stage1.root
  | 
| Finished | 2025-10-24 00:59:59 | 
| Saved logs | justin-logs:232382.1-dunegpschedd02.fnal.gov.logs.tgz | 
| List job events     Cached HTCondor job logs | 
Jobscript log (last 10,000 characters)
:   Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 139033 traces, 0 summary
Retagger: tagging trace set: gauss with 103958 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 103958 traces tagged "gauss"
FrameSaver: q=3.74684e+06 n=1788075 tag=gauss
wclsFrameSaver: saving 139033 traces tagged "wiener"
FrameSaver: q=3.98034e+06 n=1575853 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 45770 XUs and 41036 XVs -> 498 XUVs
C:0 T:1 79829 XUs and 78969 XVs -> 6906 XUVs
C:0 T:2 91575 XUs and 139961 XVs -> 5520 XUVs
C:0 T:3 48144 XUs and 60924 XVs -> 405 XUVs
C:0 T:4 12734 XUs and 10718 XVs -> 106 XUVs
C:0 T:5 59161 XUs and 50855 XVs -> 7124 XUVs
C:0 T:6 49290 XUs and 66403 XVs -> 4238 XUVs
C:0 T:7 21893 XUs and 27832 XVs -> 166 XUVs
C:0 T:8 6856 XUs and 6687 XVs -> 47 XUVs
C:0 T:9 47684 XUs and 51744 XVs -> 4179 XUVs
C:0 T:10 52745 XUs and 36485 XVs -> 4070 XUVs
C:0 T:11 237 XUs and 214 XVs -> 25 XUVs
33284 XUVs total
11519 collection wire objects
30720 potential space points
Neighbour search...
2329304 tests to find 1211756 neighbours
Iterating with no regularization...
Begin: 1.11364e+08
0 9.78964e+07
1 9.70509e+07
2 9.69269e+07
3 9.68911e+07
Now with regularization...
Begin: 8.45923e+07
0 8.45571e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410071134
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410071134
fLifetime: 30000 [us]
24-Oct-2025 02:51:28 CEST  Closed output file "reco_stage1.root"
24-Oct-2025 02:51:28 CEST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          649.61        956.11        1497.81       891.305       249.625        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00188065    0.00541027    0.00884882    0.00553104     0.0020239       10     
reco:ophit:OpHitFinder                             0.408353      0.499366      0.640539      0.483649      0.0681304       10     
reco:opflash:OpFlashFinder                          0.21115      0.302594      0.487927      0.279757      0.074857        10     
reco:opslicer:OpSlicer                             0.969393       1.41659       2.0395        1.3208       0.273228        10     
reco:caldata:DataPrepModule                         7.76552       9.11223       9.85097       9.20075      0.552624        10     
reco:wclsdatasp:WireCellToolkit                     51.6859       60.213        70.2361       61.1305       6.05855        10     
reco:gaushit:GausHitFinder                          1.83242       2.57955       3.4264        2.64406       0.46665        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000902394   0.00117034     0.0019136    0.00109914    0.000272115      10     
reco:reco3d:SpacePointSolver                        22.4596       39.0354       81.4349       32.2904       19.0519        10     
reco:hitpdune:DisambigFromSpacePoints               2.5218        3.82052       6.17557       3.65094      0.979867        10     
reco:pandora:StandardPandora                        55.1582       158.475       688.053       95.5258       181.679        10     
reco:pandoraWriter:StandardPandora                 0.792493       1.0063        1.25418       1.02398      0.128309        10     
reco:pandoraTrack:LArPandoraTrackCreation           9.53838       13.4092       25.0574       12.5769       4.36868        10     
reco:pandoraShower:LArPandoraShowerCreation         9.79102       15.3011       27.5174       13.3759       4.82689        10     
reco:pandoracalo:Calorimetry                        5.67611        7.936        12.6726       7.6359        2.03654        10     
reco:pandoracalonosce:Calorimetry                   4.39477       7.07051       11.8701       6.7712        2.03894        10     
reco:pandorapid:Chi2ParticleID                    0.00761687     0.0124008     0.0223935     0.0113143    0.00404902       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0721238     0.118257      0.163453       0.11811      0.0246318       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00776888     0.0127623     0.0207458     0.0121193    0.00371097       10     
reco:pandoraShowercalo:ShowerCalorimetry            9.61126       16.3203       29.0117       14.9811       5.00305        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       9.21436       16.0359       29.6012       15.4353       5.36873        10     
reco:emtrkmichelid:EmTrackMichelId                  350.634       462.605       600.641       448.481       68.3804        10     
reco:crttag:SingleCRTMatchingProducer              0.0240502     0.0327094     0.0415191     0.032903     0.00573259       10     
reco:crtreco:TwoCRTMatchingProducer                0.0173327     0.0230118     0.0285219     0.0241079    0.00348855       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.20885       1.62453       2.18254       1.63667      0.348457        10     
reco:pandora2Track:LArPandoraTrackCreation          28.9456       40.9767       67.5991       38.8573       10.1452        10     
reco:pandora2calo:Calorimetry                       14.6339       23.0609        38.75        22.4956       5.90241        10     
reco:pandora2calonosce:Calorimetry                  14.0339       21.1651       34.3829       20.9384       5.16194        10     
reco:pandora2pid:Chi2ParticleID                    0.018917      0.0302459      0.04678      0.0283357    0.00719858       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0873849     0.152644      0.224598      0.149656      0.0359144       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0185826     0.0295346     0.0459261     0.0272416    0.00713958       10     
reco:pandora2Shower:LArPandoraShowerCreation        9.82434       13.8192       20.9264       14.0793       2.95358        10     
reco:pandora2Showercalo:ShowerCalorimetry           11.9544       17.9217       27.7449       18.0567       4.16517        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      10.5852       15.862        24.9588       15.6451       3.66826        10     
[art]:TriggerResults:TriggerResultInserter        7.8481e-05    0.000112519   0.000242204   9.0236e-05    4.75716e-05      10     
end_path:out1:RootOutput                           1.198e-05    1.3948e-05     2.044e-05     1.36e-05     2.35318e-06      10     
end_path:out1:RootOutput(write)                     4.49702       5.85891       8.11125       5.78053       0.90035        10     
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
  Peak virtual memory usage (VmPeak)  : 5401.74 MB
  Peak resident set size usage (VmHWM): 4552.45 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.38 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   5.72 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.22 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11365864
-rw-r--r-- 1 dune001 dune 2632728068 Oct 24 00:07 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2500083999 Oct 24 00:03 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2374243700 Oct 24 02:51 reco_stage1.root
-rw-r--r-- 1 dune001 dune 2064310607 Oct 23 20:41 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1977852026 Oct 23 20:15 g4_stage1.root
-rw-r--r-- 1 dune001 dune   88790370 Oct 24 02:41 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune     243702 Oct 24 02:51 jobscript.log
-rw-r--r-- 1 dune001 dune     217088 Oct 24 02:51 mem.db
-rw-r--r-- 1 dune001 dune      62376 Oct 24 02:51 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune      36864 Oct 24 02:51 time.db
-rw-r--r-- 1 dune001 dune        519 Oct 24 00:07 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune        519 Oct 23 20:41 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune        519 Oct 24 02:51 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune         52 Oct 23 20:02 all-input-dids.txt
-rw-r--r-- 1 dune001 dune          7 Oct 24 02:51 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune          0 Oct 24 00:23 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune          0 Oct 24 00:07 debugprod.log