Jobsub ID 244869.0@dunegpschedd02.fnal.gov
| Jobsub ID | 244869.0@dunegpschedd02.fnal.gov |
| Workflow ID | 10197 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-14 18:39:16 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 20:39:44 |
| From worker node | Hostname | dunegli-7755023-0-fnpc23040.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 18:40:11 |
| Input files | monte-carlo-010197-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (7155s) |
| CPU time | 1h (7050s = 98%) |
| Max RSS bytes | 4084957184 (3895 MiB) |
| Outputting started | 2025-11-14 20:39:26 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10197/1/001/reco_stage1.root
|
| Finished | 2025-11-14 20:39:44 |
| Saved logs | justin-logs:244869.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 157665 traces, 0 summary
Retagger: tagging trace set: gauss with 117178 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 117178 traces tagged "gauss"
FrameSaver: q=4.03836e+06 n=2020196 tag=gauss
wclsFrameSaver: saving 157665 traces tagged "wiener"
FrameSaver: q=4.31442e+06 n=1774718 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33616 XUs and 44373 XVs -> 468 XUVs
C:0 T:1 68933 XUs and 79139 XVs -> 4788 XUVs
C:0 T:2 110221 XUs and 143805 XVs -> 8674 XUVs
C:0 T:3 45511 XUs and 51826 XVs -> 396 XUVs
C:0 T:4 11875 XUs and 15075 XVs -> 142 XUVs
C:0 T:5 47028 XUs and 47413 XVs -> 4441 XUVs
C:0 T:6 111404 XUs and 107853 XVs -> 5318 XUVs
C:0 T:7 46726 XUs and 37940 XVs -> 437 XUVs
C:0 T:8 4975 XUs and 7135 XVs -> 35 XUVs
C:0 T:9 36497 XUs and 64852 XVs -> 3183 XUVs
C:0 T:10 92710 XUs and 81813 XVs -> 13155 XUVs
C:0 T:11 195 XUs and 256 XVs -> 62 XUVs
41099 XUVs total
14276 collection wire objects
37710 potential space points
Neighbour search...
2735810 tests to find 1339466 neighbours
Iterating with no regularization...
Begin: 7.82883e+07
0 6.67099e+07
1 6.57932e+07
2 6.56437e+07
3 6.5599e+07
Now with regularization...
Begin: 5.35455e+07
0 5.34985e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410511944
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410511944
fLifetime: 30000 [us]
14-Nov-2025 20:39:26 UTC Closed output file "reco_stage1.root"
14-Nov-2025 20:39:26 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 133.759 206.435 287.438 213.959 45.1861 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000920201 0.00448929 0.021914 0.00298602 0.00590497 10
reco:ophit:OpHitFinder 0.19434 0.24509 0.463306 0.226873 0.0749083 10
reco:opflash:OpFlashFinder 0.0849 0.126983 0.176384 0.121282 0.0283186 10
reco:opslicer:OpSlicer 0.302134 0.43293 0.54238 0.45727 0.0783518 10
reco:caldata:DataPrepModule 3.47713 3.66291 4.09496 3.64053 0.157758 10
reco:wclsdatasp:WireCellToolkit 22.4491 23.0072 24.4707 22.9127 0.544025 10
reco:gaushit:GausHitFinder 0.520007 0.76613 1.02811 0.781557 0.14799 10
reco:nhitsfilter:NumberOfHitsFilter 0.00024046 0.000365663 0.000559771 0.000343457 9.79526e-05 10
reco:reco3d:SpacePointSolver 4.35618 10.8133 24.4731 9.37657 6.12274 10
reco:hitpdune:DisambigFromSpacePoints 0.509077 0.999776 1.68174 0.989087 0.34623 10
reco:pandora:StandardPandora 7.05946 18.3736 32.4551 17.851 7.39768 10
reco:pandoraWriter:StandardPandora 0.167964 0.272246 0.334576 0.300018 0.0588142 10
reco:pandoraTrack:LArPandoraTrackCreation 1.14386 1.92176 2.78695 1.94111 0.504989 10
reco:pandoraShower:LArPandoraShowerCreation 0.950652 2.2232 4.06991 2.23112 0.892357 10
reco:pandoracalo:Calorimetry 0.682519 1.18673 1.78628 1.23128 0.33136 10
reco:pandoracalonosce:Calorimetry 0.616164 1.09439 1.72015 1.11429 0.328898 10
reco:pandorapid:Chi2ParticleID 0.00261899 0.00344934 0.00518347 0.00336818 0.000678817 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0234484 0.0453044 0.133136 0.035436 0.0313709 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00241515 0.00310284 0.00381259 0.00308603 0.000338483 10
reco:pandoraShowercalo:ShowerCalorimetry 0.981621 2.56145 4.79471 2.57401 1.11577 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.954585 2.49557 4.58198 2.50712 1.07381 10
reco:emtrkmichelid:EmTrackMichelId 77.0959 111.607 147.813 113.7 21.001 10
reco:crttag:SingleCRTMatchingProducer 0.00479791 0.0115229 0.0393757 0.00883425 0.00955722 10
reco:crtreco:TwoCRTMatchingProducer 0.00327185 0.0048805 0.00599198 0.00502306 0.000920093 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.385602 0.5723 0.71783 0.590976 0.0993963 10
reco:pandora2Track:LArPandoraTrackCreation 3.1086 6.50885 11.0482 6.56688 2.31051 10
reco:pandora2calo:Calorimetry 1.62534 3.57445 6.10124 3.66121 1.34124 10
reco:pandora2calonosce:Calorimetry 1.51532 3.39616 5.84686 3.45721 1.29138 10
reco:pandora2pid:Chi2ParticleID 0.00565588 0.00798457 0.0110268 0.00793934 0.00136772 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0270113 0.040849 0.0509468 0.0425213 0.00742959 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00543728 0.00772886 0.0113909 0.0075905 0.00157698 10
reco:pandora2Shower:LArPandoraShowerCreation 1.15376 2.38995 3.77318 2.46647 0.779691 10
reco:pandora2Showercalo:ShowerCalorimetry 1.39554 3.1328 5.20331 3.28059 1.16223 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.26431 2.8934 4.67534 3.00952 1.06776 10
[art]:TriggerResults:TriggerResultInserter 2.5379e-05 4.5422e-05 0.000161549 3.3965e-05 3.89372e-05 10
end_path:out1:RootOutput 7.244e-06 1.12404e-05 1.8305e-05 1.1076e-05 2.75686e-06 10
end_path:out1:RootOutput(write) 1.29553 1.98871 3.31061 1.94969 0.549597 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4892.76 MB
Peak resident set size usage (VmHWM): 4084.96 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9865104
-rw-r--r-- 1 dunegli fnalgrid 2324408355 Nov 14 20:03 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2207047236 Nov 14 20:02 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2008759780 Nov 14 20:39 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1780402925 Nov 14 18:50 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1706363286 Nov 14 18:43 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 74269490 Nov 14 20:36 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243108 Nov 14 20:39 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 20:39 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 20:39 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 20:39 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 20:03 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 18:50 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 20:39 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 18:40 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 20:39 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 20:07 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 20:03 debugprod.log
