Jobsub ID 14221.1@dunegpschedd02.fnal.gov
| Jobsub ID | 14221.1@dunegpschedd02.fnal.gov |
| Workflow ID | 275 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-08-03 20:18:57 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-08-03 22:27:12 |
| From worker node | Hostname | dunegli-6302047-0-fnpc22036.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-08-03 20:19:25 |
| Input files | monte-carlo-000275-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7654s) |
| CPU time | 2h (7564s = 98%) |
| Max RSS bytes | 4245135360 (4048 MiB) |
| Outputting started | 2025-08-03 22:27:00 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00275/1/001/reco_stage1.root
|
| Finished | 2025-08-03 22:27:12 |
| Saved logs | justin-logs:14221.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
epAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120520 traces, 0 summary
Retagger: tagging trace set: gauss with 92332 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 92332 traces tagged "gauss"
FrameSaver: q=3.04136e+06 n=1596541 tag=gauss
wclsFrameSaver: saving 120520 traces tagged "wiener"
FrameSaver: q=3.20956e+06 n=1399882 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 24298 XUs and 24113 XVs -> 187 XUVs
C:0 T:1 43087 XUs and 40456 XVs -> 2813 XUVs
C:0 T:2 86623 XUs and 123410 XVs -> 4970 XUVs
C:0 T:3 42689 XUs and 50373 XVs -> 331 XUVs
C:0 T:4 16661 XUs and 12814 XVs -> 152 XUVs
C:0 T:5 81566 XUs and 59967 XVs -> 6783 XUVs
C:0 T:6 104584 XUs and 101011 XVs -> 4022 XUVs
C:0 T:7 42584 XUs and 39733 XVs -> 241 XUVs
C:0 T:8 7730 XUs and 9243 XVs -> 91 XUVs
C:0 T:9 52417 XUs and 68750 XVs -> 4275 XUVs
C:0 T:10 5110 XUs and 2748 XVs -> 780 XUVs
24645 XUVs total
10889 collection wire objects
22587 potential space points
Neighbour search...
1136761 tests to find 553442 neighbours
Iterating with no regularization...
Begin: 5.44295e+07
0 4.72625e+07
1 4.67576e+07
2 4.66971e+07
3 4.66804e+07
Now with regularization...
Begin: 3.81748e+07
0 3.81724e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 408442985
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 408442985
fLifetime: 30000 [us]
03-Aug-2025 22:26:59 UTC Closed output file "reco_stage1.root"
03-Aug-2025 22:26:59 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 150.402 216.245 278.421 212.102 34.4643 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000772189 0.00275689 0.00402527 0.00306306 0.00105 10
reco:ophit:OpHitFinder 0.174719 0.208274 0.250826 0.213048 0.0228899 10
reco:opflash:OpFlashFinder 0.103099 0.13786 0.19015 0.136913 0.0273736 10
reco:opslicer:OpSlicer 0.350414 0.451564 0.54918 0.455301 0.0724906 10
reco:caldata:DataPrepModule 3.36668 3.47396 3.692 3.45654 0.0866917 10
reco:wclsdatasp:WireCellToolkit 23.6423 24.6394 25.8444 24.7509 0.642206 10
reco:gaushit:GausHitFinder 0.521966 0.786491 1.1206 0.765029 0.167893 10
reco:nhitsfilter:NumberOfHitsFilter 0.000270151 0.000408178 0.000525374 0.000420455 8.062e-05 10
reco:reco3d:SpacePointSolver 5.4785 10.9702 16.0404 11.309 2.97964 10
reco:hitpdune:DisambigFromSpacePoints 0.550915 1.07318 1.71963 1.01288 0.292461 10
reco:pandora:StandardPandora 11.6979 19.6287 31.1229 17.0407 6.85144 10
reco:pandoraWriter:StandardPandora 0.214212 0.284873 0.349768 0.285873 0.0421487 10
reco:pandoraTrack:LArPandoraTrackCreation 1.46917 2.20115 2.83028 2.2147 0.410744 10
reco:pandoraShower:LArPandoraShowerCreation 1.11075 2.50144 3.7193 2.5604 0.67374 10
reco:pandoracalo:Calorimetry 0.836238 1.36997 1.73157 1.41912 0.269127 10
reco:pandoracalonosce:Calorimetry 0.758815 1.24494 1.60305 1.27642 0.249053 10
reco:pandorapid:Chi2ParticleID 0.00296368 0.0034395 0.00475741 0.00331163 0.000515691 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0253543 0.0338444 0.041495 0.0352746 0.00518377 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00270723 0.00330209 0.00377328 0.00332405 0.000342978 10
reco:pandoraShowercalo:ShowerCalorimetry 1.09583 2.87709 4.26991 2.93246 0.830264 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.06279 2.78505 4.19079 2.82605 0.811313 10
reco:emtrkmichelid:EmTrackMichelId 82.674 113.886 144.295 111.311 15.7343 10
reco:crttag:SingleCRTMatchingProducer 0.00591278 0.00882474 0.0174199 0.00774333 0.00311675 10
reco:crtreco:TwoCRTMatchingProducer 0.00362711 0.00547592 0.00674064 0.00573032 0.000841307 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.513251 0.658308 0.873034 0.670874 0.0974456 10
reco:pandora2Track:LArPandoraTrackCreation 3.61924 7.59957 10.696 7.53237 1.97799 10
reco:pandora2calo:Calorimetry 1.81994 4.05817 5.71727 4.13348 1.04601 10
reco:pandora2calonosce:Calorimetry 1.70912 3.8531 5.46624 3.92268 0.996867 10
reco:pandora2pid:Chi2ParticleID 0.0059725 0.00796687 0.0097937 0.00823423 0.00103581 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0308959 0.0418209 0.0507826 0.0431168 0.00560047 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00607748 0.00795214 0.00955291 0.00799864 0.000969084 10
reco:pandora2Shower:LArPandoraShowerCreation 1.32889 2.68179 3.76298 2.73374 0.630335 10
reco:pandora2Showercalo:ShowerCalorimetry 1.54042 3.4957 4.97881 3.57048 0.8966 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.42171 3.19632 4.56336 3.35161 0.804453 10
[art]:TriggerResults:TriggerResultInserter 3.4135e-05 4.711e-05 9.6202e-05 3.961e-05 1.83397e-05 10
end_path:out1:RootOutput 4.238e-06 8.8368e-06 1.3466e-05 8.6965e-06 2.84536e-06 10
end_path:out1:RootOutput(write) 1.44697 1.9781 2.52033 1.94968 0.294862 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5051.88 MB
Peak resident set size usage (VmHWM): 4245.14 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10416144
-rw-r--r-- 1 dunegli fnalgrid 2420913304 Aug 3 21:49 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2297006687 Aug 3 21:48 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2120163697 Aug 3 22:26 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1925275444 Aug 3 20:31 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1824691178 Aug 3 20:22 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 77464770 Aug 3 22:24 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242858 Aug 3 22:27 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Aug 3 22:26 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Aug 3 22:26 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Aug 3 22:26 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Aug 3 21:49 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Aug 3 20:31 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Aug 3 22:26 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Aug 3 20:19 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Aug 3 22:27 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Aug 3 21:53 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Aug 3 21:49 debugprod.log
