Jobsub ID 271381.0@dunegpschedd01.fnal.gov
| Jobsub ID | 271381.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11481 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-03 04:01:16 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2026-01-03 06:38:51 |
| From worker node | Hostname | dunegli-49757-0-cmswn4075.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-03 04:29:31 |
| Input files | monte-carlo-011481-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7747s) |
| CPU time | 2h (7695s = 99%) |
| Max RSS bytes | 4259442688 (4062 MiB) |
| Outputting started | 2026-01-03 06:38:39 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11481/1/001/reco_stage1.root
|
| Finished | 2026-01-03 06:38:51 |
| Saved logs | justin-logs:271381.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
epare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 166226 traces, 0 summary
Retagger: tagging trace set: gauss with 124437 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 124437 traces tagged "gauss"
FrameSaver: q=4.31479e+06 n=2177644 tag=gauss
wclsFrameSaver: saving 166226 traces tagged "wiener"
FrameSaver: q=4.57132e+06 n=1919800 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38926 XUs and 41472 XVs -> 537 XUVs
C:0 T:1 73366 XUs and 72487 XVs -> 6210 XUVs
C:0 T:2 151987 XUs and 158437 XVs -> 8809 XUVs
C:0 T:3 68164 XUs and 63928 XVs -> 657 XUVs
C:0 T:4 15475 XUs and 14135 XVs -> 110 XUVs
C:0 T:5 71243 XUs and 50760 XVs -> 7288 XUVs
C:0 T:6 112169 XUs and 82738 XVs -> 5208 XUVs
C:0 T:7 45452 XUs and 31719 XVs -> 353 XUVs
C:0 T:8 9184 XUs and 14705 XVs -> 187 XUVs
C:0 T:9 93722 XUs and 223277 XVs -> 14118 XUVs
C:0 T:10 29035 XUs and 11949 XVs -> 3127 XUVs
C:0 T:11 145 XUs and 68 XVs -> 11 XUVs
46615 XUVs total
14988 collection wire objects
42346 potential space points
Neighbour search...
4297704 tests to find 2046588 neighbours
Iterating with no regularization...
Begin: 7.96489e+07
0 6.81023e+07
1 6.71445e+07
2 6.70052e+07
3 6.69657e+07
Now with regularization...
Begin: 5.46721e+07
0 5.46435e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411507836
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411507836
fLifetime: 30000 [us]
03-Jan-2026 06:38:38 UTC Closed output file "reco_stage1.root"
03-Jan-2026 06:38:38 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 190.093 233.816 297.548 236.776 32.6164 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00090115 0.00296536 0.00513924 0.00318348 0.00124426 10
reco:ophit:OpHitFinder 0.179042 0.209459 0.2449 0.205713 0.0182452 10
reco:opflash:OpFlashFinder 0.100047 0.138363 0.18336 0.136773 0.0215842 10
reco:opslicer:OpSlicer 0.384694 0.449488 0.562882 0.443003 0.0499357 10
reco:caldata:DataPrepModule 3.35354 3.45588 3.65884 3.44987 0.0765741 10
reco:wclsdatasp:WireCellToolkit 22.0044 23.2452 24.0095 23.4845 0.693615 10
reco:gaushit:GausHitFinder 0.658255 0.800781 0.908501 0.801939 0.0846695 10
reco:nhitsfilter:NumberOfHitsFilter 0.000281311 0.000363243 0.000615451 0.000338363 8.85909e-05 10
reco:reco3d:SpacePointSolver 6.50194 10.8959 24.6796 9.83601 4.93618 10
reco:hitpdune:DisambigFromSpacePoints 0.893831 1.20184 1.53336 1.20208 0.217022 10
reco:pandora:StandardPandora 15.2129 26.5956 63.6446 21.5768 13.7419 10
reco:pandoraWriter:StandardPandora 0.225006 0.279694 0.31992 0.288195 0.0332592 10
reco:pandoraTrack:LArPandoraTrackCreation 1.92681 2.15151 2.70577 2.1084 0.234578 10
reco:pandoraShower:LArPandoraShowerCreation 1.96291 2.78839 3.66942 3.03177 0.579246 10
reco:pandoracalo:Calorimetry 1.20007 1.36072 1.61988 1.35172 0.130035 10
reco:pandoracalonosce:Calorimetry 1.10126 1.25051 1.51039 1.23822 0.124549 10
reco:pandorapid:Chi2ParticleID 0.00285609 0.00351308 0.00547511 0.00327428 0.000697346 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0299847 0.0388006 0.0608717 0.0369674 0.00795934 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00270563 0.00308469 0.00362024 0.00307712 0.000220515 10
reco:pandoraShowercalo:ShowerCalorimetry 2.62328 3.79529 4.91366 4.16277 0.793523 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.57348 3.71876 4.83773 4.08599 0.786253 10
reco:emtrkmichelid:EmTrackMichelId 101.824 120.355 134.68 121.817 11.7677 10
reco:crttag:SingleCRTMatchingProducer 0.00722228 0.00908404 0.0146991 0.00833222 0.00214143 10
reco:crtreco:TwoCRTMatchingProducer 0.00461901 0.00532489 0.00605903 0.00535312 0.000492259 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.539898 0.691691 0.863707 0.668619 0.0966696 10
reco:pandora2Track:LArPandoraTrackCreation 5.86066 7.89394 9.8968 8.38023 1.42219 10
reco:pandora2calo:Calorimetry 3.28859 4.39732 5.46844 4.69004 0.759468 10
reco:pandora2calonosce:Calorimetry 3.12471 4.20093 5.25991 4.47829 0.734582 10
reco:pandora2pid:Chi2ParticleID 0.00729796 0.00857673 0.0101454 0.00865398 0.000967864 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.03647 0.044367 0.0501732 0.0448272 0.00423861 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00707495 0.00831992 0.00979426 0.00843415 0.000914269 10
reco:pandora2Shower:LArPandoraShowerCreation 2.10715 2.91371 3.70393 3.07829 0.525074 10
reco:pandora2Showercalo:ShowerCalorimetry 3.39482 4.56264 5.71791 4.87889 0.812239 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.16224 4.26225 5.35078 4.52335 0.758803 10
[art]:TriggerResults:TriggerResultInserter 3.4024e-05 4.91699e-05 0.000144673 3.96795e-05 3.20307e-05 10
end_path:out1:RootOutput 8.175e-06 9.7252e-06 1.6651e-05 8.997e-06 2.34237e-06 10
end_path:out1:RootOutput(write) 1.69385 2.01873 2.27663 2.08877 0.207673 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5076.86 MB
Peak resident set size usage (VmHWM): 4259.44 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10603856
-rw-r--r-- 1 dunegli fnalgrid 2471483206 Jan 3 05:58 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2347049363 Jan 3 05:57 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2193198463 Jan 3 06:38 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1925458401 Jan 3 04:40 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1837962783 Jan 3 04:32 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 82516190 Jan 3 06:35 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242763 Jan 3 06:38 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 3 06:38 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 3 06:38 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 3 06:38 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 3 05:58 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 3 04:40 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 3 06:38 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 3 04:29 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 3 06:38 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 3 06:02 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 3 05:58 debugprod.log