Jobsub ID 269679.1@dunegpschedd01.fnal.gov
| Jobsub ID | 269679.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11308 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-22 13:46:35 |
| Site | IT_CNAF |
| Entry | CMSHTPC_T1_IT_CNAF_condor_ce02 |
| Last heartbeat | 2025-12-22 16:56:36 |
| From worker node | Hostname | wn-s04-05-34-04.cr.cnaf.infn.it |
| cpuinfo | AMD EPYC 7313 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-12-22 13:47:53 |
| Input files | monte-carlo-011308-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11055s) |
| CPU time | 2h (10740s = 97%) |
| Max RSS bytes | 5378539520 (5129 MiB) |
| Outputting started | 2025-12-22 16:52:09 |
| Output files | |
| Finished | 2025-12-22 16:56:36 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
aver: q=4.50061e+06 n=2160718 tag=gauss
wclsFrameSaver: saving 167854 traces tagged "wiener"
FrameSaver: q=4.87755e+06 n=1900416 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22081 XUs and 21354 XVs -> 319 XUVs
C:0 T:1 61058 XUs and 49365 XVs -> 10190 XUVs
C:0 T:2 269176 XUs and 267846 XVs -> 35662 XUVs
C:0 T:3 63137 XUs and 85679 XVs -> 791 XUVs
C:0 T:4 15109 XUs and 16332 XVs -> 217 XUVs
C:0 T:5 113702 XUs and 100773 XVs -> 14575 XUVs
C:0 T:6 170413 XUs and 187214 XVs -> 14004 XUVs
C:0 T:7 50255 XUs and 60556 XVs -> 681 XUVs
C:0 T:8 11298 XUs and 12385 XVs -> 363 XUVs
C:0 T:9 263581 XUs and 326627 XVs -> 38741 XUVs
C:0 T:10 49137 XUs and 39132 XVs -> 5666 XUVs
C:0 T:11 231 XUs and 178 XVs -> 23 XUVs
121232 XUVs total
18341 collection wire objects
110143 potential space points
Neighbour search...
27932991 tests to find 11005680 neighbours
Iterating with no regularization...
Begin: 1.09811e+08
0 6.48771e+07
1 6.16323e+07
2 6.09501e+07
3 6.0684e+07
4 6.05395e+07
5 6.04482e+07
6 6.03879e+07
Now with regularization...
Begin: 4.33474e+07
0 4.27723e+07
1 4.23792e+07
2 4.21084e+07
3 4.19182e+07
4 4.17683e+07
5 4.16477e+07
6 4.15428e+07
7 4.14514e+07
8 4.13687e+07
9 4.12995e+07
10 4.1242e+07
11 4.11913e+07
12 4.11471e+07
13 4.11077e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411274528
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411274528
fLifetime: 30000 [us]
22-Dec-2025 17:52:07 CET Closed output file "reco_stage1.root"
22-Dec-2025 17:52:07 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 195.871 378.227 1156.07 300.337 267.244 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00067532 0.00313679 0.00576612 0.00331478 0.0014702 10
reco:ophit:OpHitFinder 0.209057 0.243199 0.276617 0.239733 0.0232824 10
reco:opflash:OpFlashFinder 0.154949 0.187247 0.242748 0.188641 0.0264126 10
reco:opslicer:OpSlicer 0.423818 0.511132 0.618142 0.518064 0.0512527 10
reco:caldata:DataPrepModule 3.49764 3.62944 3.98508 3.6207 0.133353 10
reco:wclsdatasp:WireCellToolkit 22.9651 25.2362 29.3988 24.5572 1.93192 10
reco:gaushit:GausHitFinder 0.707081 0.99475 1.81797 0.87667 0.328281 10
reco:nhitsfilter:NumberOfHitsFilter 0.000291248 0.000515012 0.000884243 0.000479417 0.000179082 10
reco:reco3d:SpacePointSolver 10.2844 28.85 99.4948 23.0597 24.4253 10
reco:hitpdune:DisambigFromSpacePoints 0.813732 1.57615 3.06877 1.35786 0.640016 10
reco:pandora:StandardPandora 14.7946 104.115 694.516 37.0784 197.673 10
reco:pandoraWriter:StandardPandora 0.236734 0.394469 0.881147 0.325381 0.179472 10
reco:pandoraTrack:LArPandoraTrackCreation 1.95853 3.82581 8.48013 3.48331 1.77511 10
reco:pandoraShower:LArPandoraShowerCreation 1.67712 4.05083 7.64658 3.71771 1.74277 10
reco:pandoracalo:Calorimetry 1.23413 2.1787 4.36258 2.01062 0.83001 10
reco:pandoracalonosce:Calorimetry 1.15004 1.98363 4.16558 1.68496 0.809229 10
reco:pandorapid:Chi2ParticleID 0.00316272 0.00432944 0.00634962 0.00402856 0.000942274 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0303391 0.037546 0.0454715 0.0359978 0.00457582 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00300638 0.00400509 0.00615208 0.0038694 0.000827996 10
reco:pandoraShowercalo:ShowerCalorimetry 1.93543 4.26881 7.29579 4.01695 1.58582 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.88733 4.16156 7.21556 3.87403 1.57837 10
reco:emtrkmichelid:EmTrackMichelId 106.173 149.619 216.454 139.717 35.8954 10
reco:crttag:SingleCRTMatchingProducer 0.00785619 0.0117841 0.018641 0.0101889 0.0036101 10
reco:crtreco:TwoCRTMatchingProducer 0.0048797 0.00694377 0.0113624 0.00575067 0.0020867 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.603249 0.811085 1.10842 0.773625 0.18772 10
reco:pandora2Track:LArPandoraTrackCreation 5.18496 12.0723 21.8037 10.2275 5.23026 10
reco:pandora2calo:Calorimetry 3.00344 6.34885 11.2192 5.69073 2.46536 10
reco:pandora2calonosce:Calorimetry 2.86196 6.01837 10.663 5.54762 2.25488 10
reco:pandora2pid:Chi2ParticleID 0.00663086 0.0111089 0.0173661 0.0106208 0.00342031 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.03596 0.0537519 0.089823 0.0480403 0.0158857 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00645727 0.0107123 0.0172502 0.0103196 0.00321947 10
reco:pandora2Shower:LArPandoraShowerCreation 1.95613 4.25141 7.96209 3.64504 1.75052 10
reco:pandora2Showercalo:ShowerCalorimetry 2.6624 5.27096 9.56859 4.87989 1.8862 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.46074 4.8396 9.03221 4.44966 1.75121 10
[art]:TriggerResults:TriggerResultInserter 2.9255e-05 4.23429e-05 9.1673e-05 3.89335e-05 1.6906e-05 10
end_path:out1:RootOutput 8.265e-06 1.10357e-05 2.2923e-05 9.618e-06 4.14859e-06 10
end_path:out1:RootOutput(write) 1.82073 2.56102 3.71287 2.30873 0.64199 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6199.89 MB
Peak resident set size usage (VmHWM): 5378.54 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 13149088
-rw-r--r-- 1 neutrino002 neutrino 3022562387 Dec 22 16:47 detsim_stage2.root
-rw-r--r-- 1 neutrino002 neutrino 2879579138 Dec 22 16:46 detsim_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 2789527897 Dec 22 17:52 reco_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 2417698619 Dec 22 15:05 g4_stage2.root
-rw-r--r-- 1 neutrino002 neutrino 2258545585 Dec 22 14:54 g4_stage1.root
-rw-r--r-- 1 neutrino002 neutrino 96118130 Dec 22 17:48 Pandora_Events.pndr
-rw-r--r-- 1 neutrino002 neutrino 244977 Dec 22 17:52 jobscript.log
-rw-r--r-- 1 neutrino002 neutrino 217088 Dec 22 17:52 mem.db
-rw-r--r-- 1 neutrino002 neutrino 62376 Dec 22 17:52 Pandora_Geometry.xml
-rw-r--r-- 1 neutrino002 neutrino 36864 Dec 22 17:52 time.db
-rw-r--r-- 1 neutrino002 neutrino 519 Dec 22 16:47 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 neutrino002 neutrino 519 Dec 22 15:05 g4_protoDUNE_hist.root
-rw-r--r-- 1 neutrino002 neutrino 519 Dec 22 17:52 protoDUNE_reco1_hist.root
-rw-r--r-- 1 neutrino002 neutrino 52 Dec 22 14:47 all-input-dids.txt
-rw-r--r-- 1 neutrino002 neutrino 7 Dec 22 17:52 justin-processed-pfns.txt
-rw-r--r-- 1 neutrino002 neutrino 0 Dec 22 16:52 ProtoDUNE.log
-rw-r--r-- 1 neutrino002 neutrino 0 Dec 22 16:47 debugprod.log
