Jobsub ID 248643.1@dunegpschedd01.fnal.gov
| Jobsub ID | 248643.1@dunegpschedd01.fnal.gov |
| Workflow ID | 10094 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-13 09:39:18 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-13 11:54:45 |
| From worker node | Hostname | dunegli-7728651-0-fnpc23038.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-13 09:39:53 |
| Input files | monte-carlo-010094-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8079s) |
| CPU time | 2h (7734s = 95%) |
| Max RSS bytes | 4181856256 (3988 MiB) |
| Outputting started | 2025-11-13 11:54:32 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10094/1/001/reco_stage1.root
|
| Finished | 2025-11-13 11:54:45 |
| Saved logs | justin-logs:248643.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ce:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 124485 traces, 0 summary
Retagger: tagging trace set: gauss with 100371 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 100371 traces tagged "gauss"
FrameSaver: q=3.56118e+06 n=1815851 tag=gauss
wclsFrameSaver: saving 124485 traces tagged "wiener"
FrameSaver: q=3.73135e+06 n=1631538 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 30563 XUs and 26247 XVs -> 433 XUVs
C:0 T:1 61700 XUs and 49329 XVs -> 7336 XUVs
C:0 T:2 51290 XUs and 74300 XVs -> 2831 XUVs
C:0 T:3 29375 XUs and 35110 XVs -> 288 XUVs
C:0 T:4 13281 XUs and 8593 XVs -> 181 XUVs
C:0 T:5 43317 XUs and 22781 XVs -> 4407 XUVs
C:0 T:6 108975 XUs and 115447 XVs -> 5418 XUVs
C:0 T:7 41433 XUs and 46321 XVs -> 368 XUVs
C:0 T:8 8720 XUs and 8943 XVs -> 57 XUVs
C:0 T:9 60286 XUs and 75459 XVs -> 4237 XUVs
C:0 T:10 40523 XUs and 27799 XVs -> 3841 XUVs
C:0 T:11 448 XUs and 578 XVs -> 109 XUVs
29506 XUVs total
10413 collection wire objects
27576 potential space points
Neighbour search...
3217420 tests to find 1428536 neighbours
Iterating with no regularization...
Begin: 8.77337e+07
0 8.01463e+07
1 7.95589e+07
2 7.94765e+07
3 7.94533e+07
Now with regularization...
Begin: 6.89542e+07
0 6.89422e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410486529
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410486529
fLifetime: 30000 [us]
13-Nov-2025 11:54:31 UTC Closed output file "reco_stage1.root"
13-Nov-2025 11:54:31 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 146.945 227.253 330.307 224.943 51.7129 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000885865 0.00428064 0.00655057 0.00462173 0.00195616 10
reco:ophit:OpHitFinder 0.192472 0.223607 0.27155 0.215521 0.02389 10
reco:opflash:OpFlashFinder 0.107834 0.127269 0.167808 0.128054 0.0169648 10
reco:opslicer:OpSlicer 0.318267 0.43564 0.555402 0.435598 0.0634319 10
reco:caldata:DataPrepModule 3.78041 4.05834 4.42818 4.09047 0.184795 10
reco:wclsdatasp:WireCellToolkit 27.3935 30.841 34.1781 30.2601 2.26455 10
reco:gaushit:GausHitFinder 0.512543 0.750944 1.03858 0.76551 0.15085 10
reco:nhitsfilter:NumberOfHitsFilter 0.000275835 0.000508725 0.000886075 0.000451544 0.000168947 10
reco:reco3d:SpacePointSolver 3.26693 10.2441 17.9391 9.93322 3.88828 10
reco:hitpdune:DisambigFromSpacePoints 0.449478 1.01273 1.85814 0.981721 0.381598 10
reco:pandora:StandardPandora 7.2707 19.6371 37.4065 18.7988 8.39411 10
reco:pandoraWriter:StandardPandora 0.189505 0.299833 0.455085 0.281629 0.076447 10
reco:pandoraTrack:LArPandoraTrackCreation 0.943366 2.16145 3.67291 2.11862 0.752896 10
reco:pandoraShower:LArPandoraShowerCreation 0.946768 2.36117 4.27391 2.27716 1.056 10
reco:pandoracalo:Calorimetry 0.581976 1.28978 2.07616 1.31748 0.42219 10
reco:pandoracalonosce:Calorimetry 0.514597 1.18879 1.92843 1.21832 0.399871 10
reco:pandorapid:Chi2ParticleID 0.00242877 0.00368527 0.00563924 0.00357464 0.000869492 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.022024 0.0337849 0.0464995 0.0333157 0.00654258 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00231652 0.0031579 0.00401523 0.00316148 0.000495452 10
reco:pandoraShowercalo:ShowerCalorimetry 0.976808 2.67037 4.81234 2.66458 1.20623 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.942416 2.61523 4.71306 2.59132 1.19622 10
reco:emtrkmichelid:EmTrackMichelId 85.8322 121.002 170.94 120.161 23.8059 10
reco:crttag:SingleCRTMatchingProducer 0.00636422 0.0201397 0.10272 0.0118232 0.0276796 10
reco:crtreco:TwoCRTMatchingProducer 0.00332755 0.00518069 0.00755135 0.00516657 0.00127824 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.409093 0.550231 0.683314 0.568873 0.0781395 10
reco:pandora2Track:LArPandoraTrackCreation 2.78566 7.24847 14.6232 6.74325 3.51119 10
reco:pandora2calo:Calorimetry 1.47584 3.7811 6.53837 3.76797 1.58942 10
reco:pandora2calonosce:Calorimetry 1.39585 3.58528 6.21885 3.60051 1.48015 10
reco:pandora2pid:Chi2ParticleID 0.00557167 0.0085267 0.0120688 0.00842219 0.00189086 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.027661 0.0441027 0.0618373 0.0423458 0.010779 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00515548 0.00783535 0.0107759 0.00777126 0.00169419 10
reco:pandora2Shower:LArPandoraShowerCreation 1.11206 2.55113 4.44908 2.52529 0.987126 10
reco:pandora2Showercalo:ShowerCalorimetry 1.29744 3.33131 5.71613 3.36741 1.35199 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.21369 3.07592 5.34178 3.11816 1.23993 10
[art]:TriggerResults:TriggerResultInserter 4.1158e-05 5.64703e-05 0.000124426 4.8833e-05 2.33393e-05 10
end_path:out1:RootOutput 1.1312e-05 1.31192e-05 1.6482e-05 1.2639e-05 1.46676e-06 10
end_path:out1:RootOutput(write) 1.24803 2.00425 2.88019 1.98284 0.459953 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5001.69 MB
Peak resident set size usage (VmHWM): 4181.86 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9961632
-rw-r--r-- 1 dunegli fnalgrid 2348137520 Nov 13 11:14 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2231424406 Nov 13 11:13 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2029365311 Nov 13 11:54 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1789597380 Nov 13 09:51 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1728004164 Nov 13 09:43 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 73497730 Nov 13 11:51 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243808 Nov 13 11:54 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 13 11:54 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 13 11:54 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 13 11:54 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 11:14 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 09:51 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 11:54 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 13 09:39 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 13 11:54 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 13 11:18 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 13 11:14 debugprod.log
