Jobsub ID 270451.0@dunegpschedd01.fnal.gov
| Jobsub ID | 270451.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11368 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-27 22:55:14 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2025-12-28 04:14:58 |
| From worker node | Hostname | mh-7662-12.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-27 23:01:51 |
| Input files | monte-carlo-011368-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (18725s) |
| CPU time | 4h (17668s = 94%) |
| Max RSS bytes | 4356063232 (4154 MiB) |
| Outputting started | 2025-12-28 04:13:57 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11368/1/001/reco_stage1.root
|
| Finished | 2025-12-28 04:14:58 |
| Saved logs | justin-logs:270451.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ice:prepare: Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120404 traces, 0 summary
Retagger: tagging trace set: gauss with 93380 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 93380 traces tagged "gauss"
FrameSaver: q=3.22619e+06 n=1659227 tag=gauss
wclsFrameSaver: saving 120404 traces tagged "wiener"
FrameSaver: q=3.4136e+06 n=1473975 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 37706 XUs and 29714 XVs -> 442 XUVs
C:0 T:1 104551 XUs and 72837 XVs -> 12428 XUVs
C:0 T:2 55732 XUs and 80754 XVs -> 2267 XUVs
C:0 T:3 29695 XUs and 40346 XVs -> 205 XUVs
C:0 T:4 12415 XUs and 14242 XVs -> 129 XUVs
C:0 T:5 59823 XUs and 42483 XVs -> 6690 XUVs
C:0 T:6 78563 XUs and 79420 XVs -> 3516 XUVs
C:0 T:7 32144 XUs and 32259 XVs -> 181 XUVs
C:0 T:8 6258 XUs and 6896 XVs -> 131 XUVs
C:0 T:9 49788 XUs and 62062 XVs -> 8076 XUVs
C:0 T:10 52333 XUs and 26463 XVs -> 4272 XUVs
C:0 T:11 54 XUs and 35 XVs -> 4 XUVs
38341 XUVs total
11479 collection wire objects
35540 potential space points
Neighbour search...
5696104 tests to find 2474862 neighbours
Iterating with no regularization...
Begin: 8.54285e+07
0 6.34657e+07
1 6.21865e+07
2 6.20178e+07
3 6.19812e+07
Now with regularization...
Begin: 5.04954e+07
0 5.0442e+07
1 5.0415e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411382691
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411382691
fLifetime: 30000 [us]
27-Dec-2025 20:13:54 PST Closed output file "reco_stage1.root"
27-Dec-2025 20:13:54 PST Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 432.972 630.756 825.821 663.362 118.468 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00196618 0.00483391 0.00745046 0.00503052 0.0018356 10
reco:ophit:OpHitFinder 0.33871 0.442015 0.535331 0.449789 0.0615483 10
reco:opflash:OpFlashFinder 0.206122 0.318732 0.422146 0.309123 0.0660339 10
reco:opslicer:OpSlicer 0.839274 1.10717 1.46684 1.08663 0.178537 10
reco:caldata:DataPrepModule 6.15596 7.5334 8.16032 7.81152 0.660091 10
reco:wclsdatasp:WireCellToolkit 46.0642 50.9461 58.1792 49.9782 4.41216 10
reco:gaushit:GausHitFinder 1.26342 1.93179 2.39745 1.95723 0.341197 10
reco:nhitsfilter:NumberOfHitsFilter 0.000627213 0.000955849 0.00157774 0.000968946 0.000265659 10
reco:reco3d:SpacePointSolver 11.7347 22.9642 37.7095 23.7526 7.39716 10
reco:hitpdune:DisambigFromSpacePoints 1.8508 3.06351 4.03849 2.84229 0.741372 10
reco:pandora:StandardPandora 34.2051 63.5276 91.7508 62.905 16.8263 10
reco:pandoraWriter:StandardPandora 0.477375 0.750162 1.00833 0.77541 0.192698 10
reco:pandoraTrack:LArPandoraTrackCreation 4.67911 8.1188 11.254 8.56597 2.08258 10
reco:pandoraShower:LArPandoraShowerCreation 5.15363 10.2946 13.2447 11.1099 2.72046 10
reco:pandoracalo:Calorimetry 2.29671 4.66054 6.49821 4.62591 1.41139 10
reco:pandoracalonosce:Calorimetry 2.13833 4.1026 5.72749 4.28584 1.16038 10
reco:pandorapid:Chi2ParticleID 0.0071959 0.00970871 0.0154912 0.00861022 0.00263804 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0574546 0.0918692 0.127884 0.0898506 0.019902 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00682944 0.0089377 0.013036 0.00874293 0.0017801 10
reco:pandoraShowercalo:ShowerCalorimetry 4.67078 9.91068 13.527 9.86997 3.0161 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.59525 9.5381 13.156 9.997 2.99544 10
reco:emtrkmichelid:EmTrackMichelId 249.411 336.9 447.519 340.61 60.2658 10
reco:crttag:SingleCRTMatchingProducer 0.0161443 0.0233932 0.0312894 0.0223153 0.00486644 10
reco:crtreco:TwoCRTMatchingProducer 0.0121358 0.0181406 0.0286419 0.0168212 0.00483462 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.989345 1.45552 2.07798 1.31084 0.307551 10
reco:pandora2Track:LArPandoraTrackCreation 15.672 30.6259 50.5193 31.6834 10.7919 10
reco:pandora2calo:Calorimetry 7.06228 14.1347 23.3141 14.7339 5.0696 10
reco:pandora2calonosce:Calorimetry 6.64941 12.5556 17.7709 13.2639 3.73822 10
reco:pandora2pid:Chi2ParticleID 0.0173971 0.0243371 0.0401534 0.0232434 0.00609135 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0741265 0.11482 0.193919 0.107712 0.033404 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.017181 0.0241631 0.0388877 0.0228633 0.00570917 10
reco:pandora2Shower:LArPandoraShowerCreation 6.09504 10.1327 15.2513 10.1907 2.90279 10
reco:pandora2Showercalo:ShowerCalorimetry 5.76862 10.9581 17.7679 11.0784 3.86851 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.3126 9.29642 13.7997 9.18121 2.42655 10
[art]:TriggerResults:TriggerResultInserter 5.8291e-05 0.000109199 0.000232635 7.7062e-05 6.10202e-05 10
end_path:out1:RootOutput 9.98e-06 1.46464e-05 2.4321e-05 1.36355e-05 4.21457e-06 10
end_path:out1:RootOutput(write) 3.32368 4.967 7.10568 4.61592 1.14323 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5204.75 MB
Peak resident set size usage (VmHWM): 4356.06 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.31 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.72 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11108592
-rw-r--r-- 1 cuser cuser 2586257762 Dec 27 18:25 detsim_stage2.root
-rw-r--r-- 1 cuser cuser 2451676924 Dec 27 18:21 detsim_stage1.root
-rw-r--r-- 1 cuser cuser 2318756877 Dec 27 20:13 reco_stage1.root
-rw-r--r-- 1 cuser cuser 2007732393 Dec 27 15:27 g4_stage2.root
-rw-r--r-- 1 cuser cuser 1923938402 Dec 27 15:10 g4_stage1.root
-rw-r--r-- 1 cuser cuser 86216370 Dec 27 20:08 Pandora_Events.pndr
-rw-r--r-- 1 cuser cuser 243208 Dec 27 20:13 jobscript.log
-rw-r--r-- 1 cuser cuser 217088 Dec 27 20:13 mem.db
-rw-r--r-- 1 cuser cuser 62376 Dec 27 20:13 Pandora_Geometry.xml
-rw-r--r-- 1 cuser cuser 36864 Dec 27 20:13 time.db
-rw-r--r-- 1 cuser cuser 519 Dec 27 18:25 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 cuser cuser 519 Dec 27 15:27 g4_protoDUNE_hist.root
-rw-r--r-- 1 cuser cuser 519 Dec 27 20:13 protoDUNE_reco1_hist.root
-rw-r--r-- 1 cuser cuser 52 Dec 27 15:01 all-input-dids.txt
-rw-r--r-- 1 cuser cuser 7 Dec 27 20:13 justin-processed-pfns.txt
-rw-r--r-- 1 cuser cuser 0 Dec 27 18:37 ProtoDUNE.log
-rw-r--r-- 1 cuser cuser 0 Dec 27 18:25 debugprod.log
