Jobsub ID 244082.0@dunegpschedd02.fnal.gov
| Jobsub ID | 244082.0@dunegpschedd02.fnal.gov |
| Workflow ID | 10183 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-14 10:12:23 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 13:58:49 |
| From worker node | Hostname | dunegli-7595771-0-fnpc23023.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 11:56:33 |
| Input files | monte-carlo-010183-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7286s) |
| CPU time | 1h (7167s = 98%) |
| Max RSS bytes | 4162121728 (3969 MiB) |
| Outputting started | 2025-11-14 13:58:00 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10183/1/001/reco_stage1.root
|
| Finished | 2025-11-14 13:58:49 |
| Saved logs | justin-logs:244082.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
vice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 140044 traces, 0 summary
Retagger: tagging trace set: gauss with 109785 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109785 traces tagged "gauss"
FrameSaver: q=3.66845e+06 n=1964711 tag=gauss
wclsFrameSaver: saving 140044 traces tagged "wiener"
FrameSaver: q=3.87223e+06 n=1744104 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 32660 XUs and 35423 XVs -> 316 XUVs
C:0 T:1 73124 XUs and 124104 XVs -> 6200 XUVs
C:0 T:2 114694 XUs and 108655 XVs -> 7084 XUVs
C:0 T:3 52200 XUs and 43745 XVs -> 477 XUVs
C:0 T:4 16190 XUs and 19151 XVs -> 159 XUVs
C:0 T:5 78837 XUs and 70664 XVs -> 5545 XUVs
C:0 T:6 101953 XUs and 103993 XVs -> 3943 XUVs
C:0 T:7 40795 XUs and 43544 XVs -> 400 XUVs
C:0 T:8 9098 XUs and 8330 XVs -> 87 XUVs
C:0 T:9 97720 XUs and 86855 XVs -> 7190 XUVs
C:0 T:10 23329 XUs and 13123 XVs -> 3178 XUVs
C:0 T:11 65 XUs and 32 XVs -> 3 XUVs
34582 XUVs total
14059 collection wire objects
31053 potential space points
Neighbour search...
1696671 tests to find 867448 neighbours
Iterating with no regularization...
Begin: 8.75249e+07
0 7.03123e+07
1 6.94345e+07
2 6.92992e+07
3 6.92554e+07
Now with regularization...
Begin: 5.8764e+07
0 5.87313e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410507104
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410507104
fLifetime: 30000 [us]
14-Nov-2025 13:57:58 UTC Closed output file "reco_stage1.root"
14-Nov-2025 13:57:58 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 160.802 213.484 278.643 207.655 43.9341 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000897127 0.00262067 0.00448615 0.0025786 0.00112249 10
reco:ophit:OpHitFinder 0.171455 0.216685 0.278462 0.192949 0.0417076 10
reco:opflash:OpFlashFinder 0.100711 0.117878 0.148357 0.113946 0.0157805 10
reco:opslicer:OpSlicer 0.353723 0.437048 0.575038 0.416031 0.0752888 10
reco:caldata:DataPrepModule 3.44177 3.64913 3.8335 3.6701 0.152015 10
reco:wclsdatasp:WireCellToolkit 21.8767 23.6273 24.6171 23.6941 0.684478 10
reco:gaushit:GausHitFinder 0.638471 0.791361 1.00032 0.775615 0.133503 10
reco:nhitsfilter:NumberOfHitsFilter 0.000279625 0.000368824 0.000545745 0.000369107 7.58894e-05 10
reco:reco3d:SpacePointSolver 6.16171 9.34898 18.322 8.38452 3.41357 10
reco:hitpdune:DisambigFromSpacePoints 0.736419 1.07735 1.48264 0.999056 0.280355 10
reco:pandora:StandardPandora 11.9704 21.5186 39.2119 19.071 8.81323 10
reco:pandoraWriter:StandardPandora 0.200884 0.357968 0.800089 0.299465 0.188686 10
reco:pandoraTrack:LArPandoraTrackCreation 1.39311 2.02127 2.60816 2.04075 0.44474 10
reco:pandoraShower:LArPandoraShowerCreation 1.35686 2.39183 3.80333 2.22458 0.886662 10
reco:pandoracalo:Calorimetry 0.827309 1.22534 1.58073 1.22234 0.275623 10
reco:pandoracalonosce:Calorimetry 0.744681 1.12684 1.49613 1.13738 0.261214 10
reco:pandorapid:Chi2ParticleID 0.00281343 0.00347701 0.0050393 0.00334415 0.000610671 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0253457 0.0322488 0.042036 0.0308597 0.00513753 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00256088 0.00313342 0.00395197 0.00305258 0.000402915 10
reco:pandoraShowercalo:ShowerCalorimetry 1.43129 2.67202 4.18392 2.54189 1.04291 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.39129 2.58966 4.00233 2.46702 0.995866 10
reco:emtrkmichelid:EmTrackMichelId 91.2673 114.317 143.181 110.238 20.2044 10
reco:crttag:SingleCRTMatchingProducer 0.00609525 0.00956777 0.0170004 0.00923343 0.00323087 10
reco:crtreco:TwoCRTMatchingProducer 0.00399627 0.00497658 0.00699838 0.00496527 0.000932672 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.479736 0.606595 0.815504 0.584115 0.105904 10
reco:pandora2Track:LArPandoraTrackCreation 4.02864 6.92088 10.093 6.65309 2.3415 10
reco:pandora2calo:Calorimetry 2.09852 3.71614 5.34049 3.5592 1.26358 10
reco:pandora2calonosce:Calorimetry 1.97781 3.53767 5.09198 3.3683 1.21221 10
reco:pandora2pid:Chi2ParticleID 0.00613457 0.00802758 0.0101808 0.00833479 0.00145497 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0318614 0.0402433 0.0533607 0.0384317 0.00711369 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00590794 0.00780842 0.00992749 0.00816957 0.00140571 10
reco:pandora2Shower:LArPandoraShowerCreation 1.53054 2.56464 3.81498 2.44679 0.802102 10
reco:pandora2Showercalo:ShowerCalorimetry 1.8319 3.25741 4.71835 3.10235 1.0872 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.69816 3.03367 4.46323 2.83429 1.02313 10
[art]:TriggerResults:TriggerResultInserter 3.1921e-05 5.2808e-05 0.000171708 3.7447e-05 4.0297e-05 10
end_path:out1:RootOutput 8.306e-06 1.17467e-05 1.9127e-05 1.1637e-05 2.98944e-06 10
end_path:out1:RootOutput(write) 1.4874 2.18422 4.73781 1.88181 0.918732 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4973.37 MB
Peak resident set size usage (VmHWM): 4162.12 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9910736
-rw-r--r-- 1 dunegli fnalgrid 2338917231 Nov 14 13:21 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2226625913 Nov 14 13:19 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2025897414 Nov 14 13:57 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1772067517 Nov 14 12:06 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1708992457 Nov 14 11:59 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 75479710 Nov 14 13:55 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243108 Nov 14 13:58 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 13:57 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 13:57 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 13:57 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 13:21 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 12:06 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 13:57 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 11:56 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 13:58 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 13:23 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 13:21 debugprod.log
