Jobsub ID 254796.0@dunegpschedd01.fnal.gov
| Jobsub ID | 254796.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10450 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-21 10:40:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-21 15:40:17 |
| From worker node | Hostname | dunegli-7677245-0-fnpc18005.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-21 10:40:59 |
| Input files | monte-carlo-010450-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (17909s) |
| CPU time | 4h (17532s = 97%) |
| Max RSS bytes | 4125192192 (3934 MiB) |
| Outputting started | 2025-11-21 15:39:29 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10450/1/001/reco_stage1.root
|
| Finished | 2025-11-21 15:40:17 |
| Saved logs | justin-logs:254796.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 94536 traces, 0 summary
Retagger: tagging trace set: gauss with 69557 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 69557 traces tagged "gauss"
FrameSaver: q=2.53045e+06 n=1194551 tag=gauss
wclsFrameSaver: saving 94536 traces tagged "wiener"
FrameSaver: q=2.68476e+06 n=1044626 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:1 35842 XUs and 30801 XVs -> 3001 XUVs
C:0 T:2 87751 XUs and 124222 XVs -> 6524 XUVs
C:0 T:3 39055 XUs and 50348 XVs -> 212 XUVs
C:0 T:4 11632 XUs and 11441 XVs -> 45 XUVs
C:0 T:5 34847 XUs and 31020 XVs -> 5513 XUVs
C:0 T:6 42925 XUs and 38644 XVs -> 3524 XUVs
C:0 T:7 19696 XUs and 16906 XVs -> 137 XUVs
C:0 T:8 5628 XUs and 4355 XVs -> 29 XUVs
C:0 T:9 26164 XUs and 30416 XVs -> 2293 XUVs
C:0 T:10 14265 XUs and 6796 XVs -> 2136 XUVs
C:0 T:11 83 XUs and 48 XVs -> 10 XUVs
23424 XUVs total
7428 collection wire objects
21870 potential space points
Neighbour search...
1832472 tests to find 922920 neighbours
Iterating with no regularization...
Begin: 4.49706e+07
0 3.78919e+07
1 3.73609e+07
2 3.72818e+07
3 3.72579e+07
Now with regularization...
Begin: 2.94766e+07
0 2.94584e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410648350
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410648350
fLifetime: 30000 [us]
21-Nov-2025 15:39:26 UTC Closed output file "reco_stage1.root"
21-Nov-2025 15:39:26 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 343.451 538.698 817.954 515.118 116.124 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00183637 0.005832 0.0126453 0.00503524 0.00286889 10
reco:ophit:OpHitFinder 0.284507 0.418689 0.521277 0.41126 0.0604348 10
reco:opflash:OpFlashFinder 0.166388 0.238047 0.322708 0.236174 0.0457549 10
reco:opslicer:OpSlicer 0.710121 1.10127 1.51604 1.07018 0.216093 10
reco:caldata:DataPrepModule 7.04808 9.39401 10.5061 9.4512 0.966074 10
reco:wclsdatasp:WireCellToolkit 50.0168 60.9491 66.9763 61.4181 4.61879 10
reco:gaushit:GausHitFinder 1.11274 1.81532 2.31626 1.72818 0.340842 10
reco:nhitsfilter:NumberOfHitsFilter 0.000496636 0.000881181 0.00157959 0.000859014 0.000281706 10
reco:reco3d:SpacePointSolver 8.99133 19.8942 40.4495 17.2573 9.56447 10
reco:hitpdune:DisambigFromSpacePoints 1.10563 2.15455 3.63178 2.07604 0.655342 10
reco:pandora:StandardPandora 24.1486 44.4468 98.5069 37.6158 21.0032 10
reco:pandoraWriter:StandardPandora 0.411295 0.63675 0.939842 0.602152 0.148482 10
reco:pandoraTrack:LArPandoraTrackCreation 5.76036 7.54515 12.8616 6.48456 2.36682 10
reco:pandoraShower:LArPandoraShowerCreation 4.2078 7.87811 13.8375 6.9 2.862 10
reco:pandoracalo:Calorimetry 2.32344 4.1438 7.72812 3.50972 1.55734 10
reco:pandoracalonosce:Calorimetry 2.19213 3.68644 5.63953 3.33404 1.04935 10
reco:pandorapid:Chi2ParticleID 0.00694342 0.0117195 0.0299712 0.0100404 0.00620308 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0497795 0.0862255 0.117417 0.0876604 0.0161039 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00664603 0.00935158 0.0113665 0.00911355 0.00124754 10
reco:pandoraShowercalo:ShowerCalorimetry 3.3443 7.58722 13.715 6.6393 2.9626 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.4679 7.24222 12.676 6.39606 2.75612 10
reco:emtrkmichelid:EmTrackMichelId 173.706 285.393 409.622 279.982 59.3923 10
reco:crttag:SingleCRTMatchingProducer 0.0184919 0.0334826 0.06259 0.032574 0.0116094 10
reco:crtreco:TwoCRTMatchingProducer 0.0147962 0.0216091 0.0328695 0.0201749 0.00546539 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.964062 1.29911 1.79338 1.29971 0.245762 10
reco:pandora2Track:LArPandoraTrackCreation 14.0573 21.6833 36.6299 20.0989 6.35636 10
reco:pandora2calo:Calorimetry 7.97632 10.8731 20.5396 9.72096 3.52235 10
reco:pandora2calonosce:Calorimetry 7.05015 10.1005 18.2728 9.37391 3.14364 10
reco:pandora2pid:Chi2ParticleID 0.017147 0.0237564 0.0291859 0.0235626 0.00325137 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0979757 0.11575 0.157394 0.114437 0.0163615 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0203176 0.0234941 0.0292103 0.0217904 0.00313775 10
reco:pandora2Shower:LArPandoraShowerCreation 6.21458 8.24337 12.3974 7.60861 1.87209 10
reco:pandora2Showercalo:ShowerCalorimetry 5.1533 8.94134 16.6264 8.06331 2.98841 10
reco:pandora2Showercalonosce:ShowerCalorimetry 6.3065 8.28917 14.5484 7.40359 2.37884 10
[art]:TriggerResults:TriggerResultInserter 8.508e-05 0.000146779 0.000321696 0.00013001 6.35106e-05 10
end_path:out1:RootOutput 1.594e-05 2.42477e-05 4.755e-05 2.2337e-05 8.16872e-06 10
end_path:out1:RootOutput(write) 3.70076 4.20515 6.02547 4.01796 0.676009 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4932.42 MB
Peak resident set size usage (VmHWM): 4125.19 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.39 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.86 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.26 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9492640
-rw-r--r-- 1 dunegli fnalgrid 2250945162 Nov 21 14:05 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2143764480 Nov 21 14:01 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1876628379 Nov 21 15:39 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1728536724 Nov 21 11:11 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1659645555 Nov 21 10:50 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 60327870 Nov 21 15:35 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242897 Nov 21 15:39 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 21 15:39 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 21 15:39 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 21 15:39 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 14:05 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 11:11 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 15:39 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 21 10:41 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 21 15:39 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 14:18 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 14:05 debugprod.log
