Jobsub ID 248640.1@dunegpschedd01.fnal.gov
| Jobsub ID | 248640.1@dunegpschedd01.fnal.gov |
| Workflow ID | 10089 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-13 09:39:16 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-13 11:31:45 |
| From worker node | Hostname | dunegli-7572304-0-fnpc22028.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-13 09:39:46 |
| Input files | monte-carlo-010089-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6702s) |
| CPU time | 1h (6593s = 98%) |
| Max RSS bytes | 4508372992 (4299 MiB) |
| Outputting started | 2025-11-13 11:31:29 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10089/1/001/reco_stage1.root
|
| Finished | 2025-11-13 11:31:45 |
| Saved logs | justin-logs:248640.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
re: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 92530 traces, 0 summary
Retagger: tagging trace set: gauss with 67878 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 67878 traces tagged "gauss"
FrameSaver: q=2.2941e+06 n=1174369 tag=gauss
wclsFrameSaver: saving 92530 traces tagged "wiener"
FrameSaver: q=2.45064e+06 n=1031699 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 30434 XUs and 19488 XVs -> 531 XUVs
C:0 T:1 57895 XUs and 39433 XVs -> 7813 XUVs
C:0 T:2 30267 XUs and 51163 XVs -> 2045 XUVs
C:0 T:3 14317 XUs and 20345 XVs -> 53 XUVs
C:0 T:4 11609 XUs and 12801 XVs -> 346 XUVs
C:0 T:5 32974 XUs and 26284 XVs -> 5353 XUVs
C:0 T:6 168670 XUs and 134329 XVs -> 45569 XUVs
C:0 T:7 45281 XUs and 36044 XVs -> 1781 XUVs
C:0 T:8 4065 XUs and 3837 XVs -> 40 XUVs
C:0 T:9 22321 XUs and 31014 XVs -> 2190 XUVs
C:0 T:10 13675 XUs and 14681 XVs -> 2448 XUVs
C:0 T:11 205 XUs and 145 XVs -> 30 XUVs
68199 XUVs total
8239 collection wire objects
61600 potential space points
Neighbour search...
20473270 tests to find 7970312 neighbours
Iterating with no regularization...
Begin: 4.15216e+07
0 3.40438e+07
1 3.34438e+07
2 3.33709e+07
3 3.33499e+07
Now with regularization...
Begin: 2.64342e+07
0 2.63566e+07
1 2.63065e+07
2 2.6265e+07
3 2.62292e+07
4 2.6198e+07
5 2.61701e+07
6 2.61449e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410486583
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410486583
fLifetime: 30000 [us]
13-Nov-2025 11:31:28 UTC Closed output file "reco_stage1.root"
13-Nov-2025 11:31:28 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 107.788 176.792 243.79 165.414 40.6522 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00069998 0.00247889 0.00417049 0.00255867 0.00114681 10
reco:ophit:OpHitFinder 0.164838 0.191958 0.223037 0.187238 0.0190078 10
reco:opflash:OpFlashFinder 0.0834101 0.106165 0.143155 0.103905 0.018891 10
reco:opslicer:OpSlicer 0.321957 0.386401 0.50063 0.352117 0.062704 10
reco:caldata:DataPrepModule 3.43819 3.55898 3.81788 3.54049 0.102413 10
reco:wclsdatasp:WireCellToolkit 21.5697 23.2469 24.1749 23.2489 0.825348 10
reco:gaushit:GausHitFinder 0.413366 0.621817 0.87418 0.58368 0.143545 10
reco:nhitsfilter:NumberOfHitsFilter 0.000160082 0.000285483 0.00039768 0.000276406 6.91598e-05 10
reco:reco3d:SpacePointSolver 3.5254 9.46111 25.7473 7.0034 6.13166 10
reco:hitpdune:DisambigFromSpacePoints 0.37543 0.799494 1.27796 0.699225 0.307937 10
reco:pandora:StandardPandora 7.66658 14.0837 23.872 11.8404 5.8354 10
reco:pandoraWriter:StandardPandora 0.130566 0.22391 0.30996 0.206633 0.0541822 10
reco:pandoraTrack:LArPandoraTrackCreation 0.64079 1.53231 2.44587 1.38336 0.583179 10
reco:pandoraShower:LArPandoraShowerCreation 0.63729 1.7248 3.12854 1.46825 0.780689 10
reco:pandoracalo:Calorimetry 0.401355 0.970156 1.51228 0.846871 0.370226 10
reco:pandoracalonosce:Calorimetry 0.356227 0.860605 1.39189 0.77512 0.342404 10
reco:pandorapid:Chi2ParticleID 0.00193278 0.00286543 0.00369194 0.00280025 0.000573487 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0168057 0.0278345 0.0365717 0.0265669 0.00598095 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00183738 0.00266621 0.00352786 0.00259976 0.000512585 10
reco:pandoraShowercalo:ShowerCalorimetry 0.693979 1.93873 3.65733 1.62329 0.96753 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.675518 1.88465 3.51542 1.57597 0.946089 10
reco:emtrkmichelid:EmTrackMichelId 58.765 95.8591 126.846 92.4593 20.4667 10
reco:crttag:SingleCRTMatchingProducer 0.0040538 0.00985298 0.0256466 0.00761044 0.00595864 10
reco:crtreco:TwoCRTMatchingProducer 0.00274553 0.00437501 0.00620889 0.00404931 0.000996758 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.317484 0.548417 0.790803 0.554884 0.151833 10
reco:pandora2Track:LArPandoraTrackCreation 1.88433 4.98196 8.67596 4.3393 2.18732 10
reco:pandora2calo:Calorimetry 1.06235 2.74967 4.84126 2.3744 1.27603 10
reco:pandora2calonosce:Calorimetry 0.99211 2.61607 4.67711 2.26364 1.22951 10
reco:pandora2pid:Chi2ParticleID 0.00436542 0.00670335 0.00890709 0.00636071 0.00148622 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0204352 0.0341533 0.0443547 0.0326154 0.0076918 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00423686 0.006381 0.00867386 0.00605111 0.00137674 10
reco:pandora2Shower:LArPandoraShowerCreation 0.757287 1.90207 3.25432 1.6905 0.783173 10
reco:pandora2Showercalo:ShowerCalorimetry 0.930952 2.47745 4.83024 2.1195 1.21841 10
reco:pandora2Showercalonosce:ShowerCalorimetry 0.870872 2.26421 4.12399 2.00435 1.04878 10
[art]:TriggerResults:TriggerResultInserter 2.9947e-05 4.30025e-05 0.00010076 3.91895e-05 1.9801e-05 10
end_path:out1:RootOutput 7.664e-06 9.3416e-06 1.2995e-05 8.6165e-06 1.59445e-06 10
end_path:out1:RootOutput(write) 0.957288 1.64969 2.22774 1.60831 0.370471 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4966.9 MB
Peak resident set size usage (VmHWM): 4155.22 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9587964
-rw-r--r-- 1 dunegli fnalgrid 2242835140 Nov 13 11:00 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2136827241 Nov 13 10:59 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1889897471 Nov 13 11:31 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1764081252 Nov 13 09:49 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1718590472 Nov 13 09:42 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 65215830 Nov 13 11:29 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242840 Nov 13 11:31 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 13 11:31 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 13 11:31 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 13 11:31 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 11:00 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 09:49 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 13 11:31 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 13 09:39 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 13 11:31 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 13 11:03 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 13 11:00 debugprod.log
