Jobsub ID 13676.0@dunegpschedd02.fnal.gov
| Jobsub ID | 13676.0@dunegpschedd02.fnal.gov |
| Workflow ID | 207 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-08-01 11:28:02 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-08-01 13:17:04 |
| From worker node | Hostname | dunegli-6274056-0-fnpc22003.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-08-01 11:29:13 |
| Input files | monte-carlo-000207-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6457s) |
| CPU time | 1h (6380s = 98%) |
| Max RSS bytes | 4067991552 (3879 MiB) |
| Outputting started | 2025-08-01 13:16:51 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00207/1/001/reco_stage1.root
|
| Finished | 2025-08-01 13:17:04 |
| Saved logs | justin-logs:13676.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 108965 traces, 0 summary
Retagger: tagging trace set: gauss with 85575 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 85575 traces tagged "gauss"
FrameSaver: q=3.0183e+06 n=1585196 tag=gauss
wclsFrameSaver: saving 108965 traces tagged "wiener"
FrameSaver: q=3.1918e+06 n=1426169 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 48173 XUs and 40483 XVs -> 551 XUVs
C:0 T:1 90392 XUs and 74277 XVs -> 3640 XUVs
C:0 T:2 80083 XUs and 128318 XVs -> 4688 XUVs
C:0 T:3 40892 XUs and 56972 XVs -> 487 XUVs
C:0 T:4 10381 XUs and 11444 XVs -> 83 XUVs
C:0 T:5 34238 XUs and 33308 XVs -> 3440 XUVs
C:0 T:6 111849 XUs and 103127 XVs -> 7984 XUVs
C:0 T:7 39052 XUs and 36234 XVs -> 359 XUVs
C:0 T:8 4909 XUs and 5234 XVs -> 41 XUVs
C:0 T:9 25175 XUs and 42554 XVs -> 2555 XUVs
C:0 T:10 28945 XUs and 20669 XVs -> 3955 XUVs
C:0 T:11 23 XUs and 16 XVs -> 5 XUVs
27788 XUVs total
10042 collection wire objects
25114 potential space points
Neighbour search...
1553056 tests to find 821372 neighbours
Iterating with no regularization...
Begin: 4.92547e+07
0 4.06467e+07
1 3.99694e+07
2 3.98699e+07
3 3.9844e+07
Now with regularization...
Begin: 3.11558e+07
0 3.11351e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 408381200
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 408381200
fLifetime: 30000 [us]
01-Aug-2025 13:16:50 UTC Closed output file "reco_stage1.root"
01-Aug-2025 13:16:50 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 132.551 177.145 232.889 186.931 30.9821 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000684317 0.00236798 0.00341377 0.0025265 0.00089815 10
reco:ophit:OpHitFinder 0.171381 0.19177 0.232532 0.187008 0.0171232 10
reco:opflash:OpFlashFinder 0.093018 0.115033 0.147282 0.111322 0.0154648 10
reco:opslicer:OpSlicer 0.326019 0.396957 0.555298 0.376414 0.0644825 10
reco:caldata:DataPrepModule 3.31545 3.39879 3.6384 3.35942 0.095843 10
reco:wclsdatasp:WireCellToolkit 22.6015 23.1717 23.7704 23.1488 0.404978 10
reco:gaushit:GausHitFinder 0.490797 0.668029 0.940204 0.655518 0.128486 10
reco:nhitsfilter:NumberOfHitsFilter 0.000210939 0.000303881 0.000476453 0.000286613 8.08773e-05 10
reco:reco3d:SpacePointSolver 3.26369 7.51713 13.0724 7.79329 2.79021 10
reco:hitpdune:DisambigFromSpacePoints 0.544963 0.797387 1.2042 0.809017 0.208036 10
reco:pandora:StandardPandora 8.63783 15.424 27.2659 15.6385 5.94187 10
reco:pandoraWriter:StandardPandora 0.166377 0.216922 0.272086 0.232848 0.0385693 10
reco:pandoraTrack:LArPandoraTrackCreation 1.22979 1.78151 2.71462 1.78848 0.42556 10
reco:pandoraShower:LArPandoraShowerCreation 0.951034 1.75804 2.71166 1.89269 0.539458 10
reco:pandoracalo:Calorimetry 0.70861 1.06683 1.55318 1.10244 0.259386 10
reco:pandoracalonosce:Calorimetry 0.645552 0.986479 1.48801 1.02197 0.253984 10
reco:pandorapid:Chi2ParticleID 0.00239925 0.00311494 0.0040522 0.00309288 0.000486076 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0225009 0.0277459 0.0333697 0.0293808 0.00381006 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00240693 0.00284581 0.00360525 0.0028231 0.000328459 10
reco:pandoraShowercalo:ShowerCalorimetry 0.970849 1.9732 3.22424 2.19967 0.69851 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.942845 1.92197 3.16247 2.15385 0.684628 10
reco:emtrkmichelid:EmTrackMichelId 74.9484 95.6701 119.498 98.9783 13.9576 10
reco:crttag:SingleCRTMatchingProducer 0.00508566 0.00808125 0.0129486 0.00754378 0.00248135 10
reco:crtreco:TwoCRTMatchingProducer 0.00331365 0.00434072 0.00567157 0.00461098 0.0007558 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.388362 0.512932 0.634938 0.535455 0.0828731 10
reco:pandora2Track:LArPandoraTrackCreation 3.08638 5.28348 7.76349 5.65649 1.45593 10
reco:pandora2calo:Calorimetry 1.59095 2.86037 4.38674 3.15073 0.877898 10
reco:pandora2calonosce:Calorimetry 1.52212 2.73475 4.23501 3.00476 0.853304 10
reco:pandora2pid:Chi2ParticleID 0.00554116 0.00699294 0.00848019 0.00715329 0.000930963 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0260062 0.0339237 0.0403215 0.0366096 0.00484059 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00508749 0.00683371 0.00830003 0.00697808 0.000986837 10
reco:pandora2Shower:LArPandoraShowerCreation 1.17456 2.00188 2.994 2.20994 0.539064 10
reco:pandora2Showercalo:ShowerCalorimetry 1.39901 2.56095 4.07503 2.82568 0.816935 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.26839 2.37934 3.78075 2.65761 0.761097 10
[art]:TriggerResults:TriggerResultInserter 3.0026e-05 3.87857e-05 9.2665e-05 3.2918e-05 1.80608e-05 10
end_path:out1:RootOutput 3.908e-06 6.6887e-06 1.3085e-05 6.5275e-06 2.58885e-06 10
end_path:out1:RootOutput(write) 1.22719 1.60802 2.04168 1.6425 0.251896 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4878.7 MB
Peak resident set size usage (VmHWM): 4067.99 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9460960
-rw-r--r-- 1 dunegli fnalgrid 2250069118 Aug 1 12:46 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2138019256 Aug 1 12:44 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1899357163 Aug 1 13:16 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1700113846 Aug 1 11:38 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1633748125 Aug 1 11:32 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 66089120 Aug 1 13:14 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242928 Aug 1 13:16 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Aug 1 13:16 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Aug 1 13:16 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Aug 1 13:16 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Aug 1 12:46 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Aug 1 11:38 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Aug 1 13:16 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Aug 1 11:29 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Aug 1 13:16 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Aug 1 12:49 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Aug 1 12:46 debugprod.log
