Jobsub ID 299745.1@dunegpschedd01.fnal.gov
| Jobsub ID | 299745.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12289 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-23 06:43:56 |
| Site | UK_Edinburgh |
| Entry | DUNE_UK_SGridECDF_ce1_multicore |
| Last heartbeat | 2026-01-23 09:11:21 |
| From worker node | Hostname | node2b04.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2026-01-23 06:45:14 |
| Input files | monte-carlo-012289-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8731s) |
| CPU time | 2h (8578s = 98%) |
| Max RSS bytes | 4010590208 (3824 MiB) |
| Outputting started | 2026-01-23 09:10:46 |
| Output files | |
| Finished | 2026-01-23 09:11:21 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 130505 traces, 0 summary
Retagger: tagging trace set: gauss with 100519 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100519 traces tagged "gauss"
FrameSaver: q=3.6e+06 n=1818362 tag=gauss
wclsFrameSaver: saving 130505 traces tagged "wiener"
FrameSaver: q=3.80855e+06 n=1620719 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38362 XUs and 35896 XVs -> 459 XUVs
C:0 T:1 67034 XUs and 69906 XVs -> 5280 XUVs
C:0 T:2 174223 XUs and 206946 XVs -> 8366 XUVs
C:0 T:3 84677 XUs and 84122 XVs -> 839 XUVs
C:0 T:4 20512 XUs and 19627 XVs -> 212 XUVs
C:0 T:5 94553 XUs and 67560 XVs -> 8973 XUVs
C:0 T:6 37853 XUs and 41764 XVs -> 1810 XUVs
C:0 T:8 5736 XUs and 7390 XVs -> 209 XUVs
C:0 T:9 54326 XUs and 56521 XVs -> 8272 XUVs
C:0 T:10 9732 XUs and 3594 XVs -> 1286 XUVs
C:0 T:11 140 XUs and 57 XVs -> 11 XUVs
35717 XUVs total
10802 collection wire objects
32340 potential space points
Neighbour search...
2194836 tests to find 1132532 neighbours
Iterating with no regularization...
Begin: 7.09865e+07
0 5.89734e+07
1 5.80427e+07
2 5.79243e+07
3 5.78938e+07
Now with regularization...
Begin: 4.75839e+07
0 4.75728e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411912448
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411912448
fLifetime: 30000 [us]
23-Jan-2026 09:10:43 GMT Closed output file "reco_stage1.root"
23-Jan-2026 09:10:43 GMT Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 241.397 307.756 392.632 300.382 44.2403 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000723423 0.00302337 0.00466355 0.00333084 0.00113831 10
reco:ophit:OpHitFinder 0.260768 0.288286 0.332429 0.290512 0.0201602 10
reco:opflash:OpFlashFinder 0.171584 0.215289 0.268756 0.213872 0.0269482 10
reco:opslicer:OpSlicer 0.473384 0.603789 0.74899 0.619092 0.0749246 10
reco:caldata:DataPrepModule 5.30724 5.46123 5.65414 5.45176 0.111208 10
reco:wclsdatasp:WireCellToolkit 41.3855 43.2104 44.7787 42.8782 0.957112 10
reco:gaushit:GausHitFinder 1.00363 1.33473 1.65811 1.33743 0.222568 10
reco:nhitsfilter:NumberOfHitsFilter 0.000497267 0.000605944 0.000787399 0.000594446 8.89555e-05 10
reco:reco3d:SpacePointSolver 8.03848 12.2922 18.1194 11.5368 2.83636 10
reco:hitpdune:DisambigFromSpacePoints 0.97706 1.37688 1.85624 1.32643 0.278203 10
reco:pandora:StandardPandora 16.5201 30.1661 46.357 27.7081 9.44799 10
reco:pandoraWriter:StandardPandora 0.333706 0.402072 0.48905 0.396629 0.0490904 10
reco:pandoraTrack:LArPandoraTrackCreation 2.65786 3.78952 5.77123 3.96425 0.86535 10
reco:pandoraShower:LArPandoraShowerCreation 2.71521 4.30118 6.20741 4.01216 1.06283 10
reco:pandoracalo:Calorimetry 1.3863 2.02041 2.94646 2.15372 0.445621 10
reco:pandoracalonosce:Calorimetry 1.2402 1.81604 2.71253 1.9348 0.419134 10
reco:pandorapid:Chi2ParticleID 0.00411266 0.00492116 0.00598504 0.00499188 0.000608052 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0416598 0.0463527 0.0552876 0.0454198 0.00406356 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00420399 0.00485538 0.00592337 0.00480832 0.000528022 10
reco:pandoraShowercalo:ShowerCalorimetry 2.47307 4.23566 6.38554 4.05006 1.2234 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.37279 4.11867 6.25241 3.94376 1.20636 10
reco:emtrkmichelid:EmTrackMichelId 125.12 149.948 181.91 148.95 17.3051 10
reco:crttag:SingleCRTMatchingProducer 0.013547 0.0166761 0.021556 0.0156521 0.00264387 10
reco:crtreco:TwoCRTMatchingProducer 0.00793386 0.00974649 0.0125973 0.0095594 0.00142795 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.812873 1.00575 1.33491 1.00453 0.145093 10
reco:pandora2Track:LArPandoraTrackCreation 8.07976 12.5001 19.5259 12.2892 3.16175 10
reco:pandora2calo:Calorimetry 3.63195 5.89022 9.07027 5.91096 1.54106 10
reco:pandora2calonosce:Calorimetry 3.4087 5.59448 8.67585 5.63273 1.48626 10
reco:pandora2pid:Chi2ParticleID 0.0103924 0.012513 0.0161187 0.0118679 0.0017779 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0520859 0.0583963 0.0726838 0.057469 0.00618371 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0106807 0.0127324 0.0162174 0.0119875 0.00180547 10
reco:pandora2Shower:LArPandoraShowerCreation 3.04861 4.56488 6.88602 4.4842 1.05747 10
reco:pandora2Showercalo:ShowerCalorimetry 3.18515 5.16174 7.87007 5.20134 1.34613 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.93782 4.76345 7.37412 4.81692 1.28116 10
[art]:TriggerResults:TriggerResultInserter 3.6753e-05 4.68387e-05 8.9081e-05 4.1266e-05 1.47137e-05 10
end_path:out1:RootOutput 6.979e-06 8.2545e-06 1.1286e-05 8.1215e-06 1.1111e-06 10
end_path:out1:RootOutput(write) 1.96791 2.41821 3.07517 2.40202 0.303975 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4815.75 MB
Peak resident set size usage (VmHWM): 4010.59 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.48 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9805488
-rw-r--r-- 1 gl05pi8 eddie_users 2313096915 Jan 23 08:17 detsim_stage2.root
-rw-r--r-- 1 gl05pi8 eddie_users 2192425692 Jan 23 08:15 detsim_stage1.root
-rw-r--r-- 1 gl05pi8 eddie_users 1987852162 Jan 23 09:10 reco_stage1.root
-rw-r--r-- 1 gl05pi8 eddie_users 1773308208 Jan 23 07:01 g4_stage2.root
-rw-r--r-- 1 gl05pi8 eddie_users 1701100689 Jan 23 06:50 g4_stage1.root
-rw-r--r-- 1 gl05pi8 eddie_users 72162220 Jan 23 09:06 Pandora_Events.pndr
-rw-r--r-- 1 gl05pi8 eddie_users 491633 Jan 23 09:10 jobscript.log
-rw-r--r-- 1 gl05pi8 eddie_users 217088 Jan 23 09:10 mem.db
-rw-r--r-- 1 gl05pi8 eddie_users 62376 Jan 23 09:10 Pandora_Geometry.xml
-rw-r--r-- 1 gl05pi8 eddie_users 36864 Jan 23 09:10 time.db
-rw-r--r-- 1 gl05pi8 eddie_users 519 Jan 23 08:17 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi8 eddie_users 519 Jan 23 07:01 g4_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi8 eddie_users 519 Jan 23 09:10 protoDUNE_reco1_hist.root
-rw-r--r-- 1 gl05pi8 eddie_users 52 Jan 23 06:45 all-input-dids.txt
-rw-r--r-- 1 gl05pi8 eddie_users 7 Jan 23 09:10 justin-processed-pfns.txt
-rw-r--r-- 1 gl05pi8 eddie_users 0 Jan 23 08:22 ProtoDUNE.log
-rw-r--r-- 1 gl05pi8 eddie_users 0 Jan 23 08:17 debugprod.log
