Jobsub ID 249109.0@dunegpschedd01.fnal.gov
| Jobsub ID | 249109.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10158 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-13 19:32:50 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 02:57:14 |
| From worker node | Hostname | dunegli-7585892-0-fnpc23011.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 00:53:14 |
| Input files | monte-carlo-010158-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7426s) |
| CPU time | 2h (7330s = 98%) |
| Max RSS bytes | 4277710848 (4079 MiB) |
| Outputting started | 2025-11-14 02:57:00 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10158/1/001/reco_stage1.root
|
| Finished | 2025-11-14 02:57:14 |
| Saved logs | justin-logs:249109.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
DigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 99950 traces, 0 summary
Retagger: tagging trace set: gauss with 77389 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 77389 traces tagged "gauss"
FrameSaver: q=2.74676e+06 n=1403875 tag=gauss
wclsFrameSaver: saving 99950 traces tagged "wiener"
FrameSaver: q=2.90845e+06 n=1258956 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 25086 XUs and 19412 XVs -> 247 XUVs
C:0 T:1 41021 XUs and 34672 XVs -> 1888 XUVs
C:0 T:2 58285 XUs and 85689 XVs -> 3349 XUVs
C:0 T:3 28342 XUs and 37059 XVs -> 161 XUVs
C:0 T:4 9314 XUs and 6927 XVs -> 45 XUVs
C:0 T:5 27734 XUs and 16115 XVs -> 2515 XUVs
C:0 T:6 61396 XUs and 81772 XVs -> 2057 XUVs
C:0 T:7 26836 XUs and 33589 XVs -> 187 XUVs
C:0 T:8 6624 XUs and 8285 XVs -> 102 XUVs
C:0 T:9 41124 XUs and 56789 XVs -> 3302 XUVs
C:0 T:10 32849 XUs and 27468 XVs -> 5983 XUVs
C:0 T:11 67 XUs and 47 XVs -> 7 XUVs
19843 XUVs total
8051 collection wire objects
18657 potential space points
Neighbour search...
762623 tests to find 408856 neighbours
Iterating with no regularization...
Begin: 7.3939e+07
0 6.18829e+07
1 6.12326e+07
2 6.11469e+07
3 6.11235e+07
Now with regularization...
Begin: 5.29922e+07
0 5.29574e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410494853
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410494853
fLifetime: 30000 [us]
14-Nov-2025 02:56:59 UTC Closed output file "reco_stage1.root"
14-Nov-2025 02:56:59 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 163.625 219.968 317.86 212.541 44.7306 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000609057 0.00275968 0.00441562 0.00286504 0.00126341 10
reco:ophit:OpHitFinder 0.187379 0.205529 0.240978 0.203425 0.0137321 10
reco:opflash:OpFlashFinder 0.101561 0.122913 0.158216 0.12427 0.0147412 10
reco:opslicer:OpSlicer 0.388766 0.459274 0.624561 0.451567 0.0616157 10
reco:caldata:DataPrepModule 3.46291 3.55564 3.76657 3.56155 0.083505 10
reco:wclsdatasp:WireCellToolkit 22.4255 23.3755 24.4595 23.3385 0.538195 10
reco:gaushit:GausHitFinder 0.657774 0.806648 1.06997 0.818181 0.121547 10
reco:nhitsfilter:NumberOfHitsFilter 0.000245797 0.00033223 0.000447951 0.000331039 6.36026e-05 10
reco:reco3d:SpacePointSolver 4.63614 10.6619 24.7675 9.22238 5.84489 10
reco:hitpdune:DisambigFromSpacePoints 0.678107 1.14194 2.02054 1.07701 0.368189 10
reco:pandora:StandardPandora 14.4496 22.7283 46.1481 18.4855 9.69299 10
reco:pandoraWriter:StandardPandora 0.187784 0.265348 0.351004 0.267145 0.0508526 10
reco:pandoraTrack:LArPandoraTrackCreation 1.70427 2.1617 2.866 2.09213 0.408789 10
reco:pandoraShower:LArPandoraShowerCreation 1.51591 2.50967 4.26508 2.61436 0.820669 10
reco:pandoracalo:Calorimetry 0.943581 1.3105 1.749 1.31262 0.263449 10
reco:pandoracalonosce:Calorimetry 0.868961 1.21258 1.61187 1.21003 0.245959 10
reco:pandorapid:Chi2ParticleID 0.00306855 0.00361125 0.00437663 0.00355071 0.000377109 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.026011 0.0335757 0.0442002 0.0329123 0.00529213 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00283795 0.00327656 0.00378605 0.00331926 0.000302488 10
reco:pandoraShowercalo:ShowerCalorimetry 1.55435 2.83454 4.83882 2.99896 0.981233 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.51379 2.77014 4.70033 2.92965 0.960815 10
reco:emtrkmichelid:EmTrackMichelId 91.2169 116.588 151.32 114.729 18.1085 10
reco:crttag:SingleCRTMatchingProducer 0.00536996 0.009035 0.0164273 0.00883349 0.00287042 10
reco:crtreco:TwoCRTMatchingProducer 0.00378088 0.00512221 0.00682416 0.00519378 0.000871659 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.487751 0.626096 0.737115 0.626821 0.0740684 10
reco:pandora2Track:LArPandoraTrackCreation 4.64751 7.30056 11.9102 7.57886 2.17976 10
reco:pandora2calo:Calorimetry 2.35498 3.94746 6.24303 4.16566 1.17598 10
reco:pandora2calonosce:Calorimetry 2.25462 3.77793 6.00144 3.99817 1.13469 10
reco:pandora2pid:Chi2ParticleID 0.00680887 0.00843187 0.0105162 0.00846782 0.00112009 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0320789 0.0414444 0.0568585 0.0394088 0.00726358 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00676037 0.00827009 0.0104051 0.00828164 0.00115468 10
reco:pandora2Shower:LArPandoraShowerCreation 1.74891 2.71868 4.39256 2.79489 0.765831 10
reco:pandora2Showercalo:ShowerCalorimetry 2.04824 3.49434 5.6011 3.68459 1.05094 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.85652 3.2494 5.31718 3.43793 0.996202 10
[art]:TriggerResults:TriggerResultInserter 3.2532e-05 4.39996e-05 0.000105831 3.62445e-05 2.09975e-05 10
end_path:out1:RootOutput 7.415e-06 9.0682e-06 1.4929e-05 8.26e-06 2.19078e-06 10
end_path:out1:RootOutput(write) 1.46372 1.97491 2.68118 1.94989 0.349145 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5087.97 MB
Peak resident set size usage (VmHWM): 4277.71 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10074124
-rw-r--r-- 1 dunegli fnalgrid 2373199080 Nov 14 02:19 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2256490240 Nov 14 02:17 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2071564622 Nov 14 02:56 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1797269603 Nov 14 01:03 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1739178344 Nov 14 00:56 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 77517680 Nov 14 02:55 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242981 Nov 14 02:57 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 02:56 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 02:56 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 02:56 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 02:19 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 01:03 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 02:56 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 00:53 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 02:57 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 02:22 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 02:19 debugprod.log
