Jobsub ID 269136.0@dunegpschedd01.fnal.gov
| Jobsub ID | 269136.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11270 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-18 22:20:15 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2025-12-19 03:46:24 |
| From worker node | Hostname | mh-7662-3.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-18 22:21:02 |
| Input files | monte-carlo-011270-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (19459s) |
| CPU time | 5h (18155s = 93%) |
| Max RSS bytes | 4544086016 (4333 MiB) |
| Outputting started | 2025-12-19 03:45:22 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11270/1/001/reco_stage1.root
|
| Finished | 2025-12-19 03:46:24 |
| Saved logs | justin-logs:269136.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
sedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 216688 traces, 0 summary
Retagger: tagging trace set: gauss with 159258 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 159258 traces tagged "gauss"
FrameSaver: q=6.14886e+06 n=2769068 tag=gauss
wclsFrameSaver: saving 216688 traces tagged "wiener"
FrameSaver: q=6.62293e+06 n=2445313 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 50582 XUs and 34667 XVs -> 720 XUVs
C:0 T:1 104531 XUs and 80626 XVs -> 6414 XUVs
C:0 T:2 125614 XUs and 117528 XVs -> 5396 XUVs
C:0 T:3 58107 XUs and 48142 XVs -> 377 XUVs
C:0 T:4 18743 XUs and 19118 XVs -> 385 XUVs
C:0 T:5 94114 XUs and 83941 XVs -> 8029 XUVs
C:0 T:6 183479 XUs and 190640 XVs -> 10238 XUVs
C:0 T:7 67459 XUs and 69882 XVs -> 1102 XUVs
C:0 T:8 18953 XUs and 15323 XVs -> 986 XUVs
C:0 T:9 255847 XUs and 270124 XVs -> 43713 XUVs
C:0 T:10 104258 XUs and 81920 XVs -> 19712 XUVs
C:0 T:11 514 XUs and 386 XVs -> 60 XUVs
97132 XUVs total
18858 collection wire objects
88294 potential space points
Neighbour search...
20601880 tests to find 6862178 neighbours
Iterating with no regularization...
Begin: 1.92743e+08
0 1.12077e+08
1 1.0626e+08
2 1.05183e+08
3 1.04766e+08
4 1.04546e+08
5 1.04406e+08
6 1.04319e+08
Now with regularization...
Begin: 8.24598e+07
0 8.2003e+07
1 8.16839e+07
2 8.14278e+07
3 8.12123e+07
4 8.10297e+07
5 8.08726e+07
6 8.0741e+07
7 8.06287e+07
8 8.053e+07
9 8.04445e+07
10 8.03731e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411201009
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411201009
fLifetime: 30000 [us]
18-Dec-2025 19:45:19 PST Closed output file "reco_stage1.root"
18-Dec-2025 19:45:19 PST Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 455.178 600.343 981.561 562.716 148.616 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00169511 0.00484676 0.00731235 0.00551406 0.00195982 10
reco:ophit:OpHitFinder 0.365578 0.459576 0.61538 0.446829 0.0764531 10
reco:opflash:OpFlashFinder 0.244837 0.332996 0.407953 0.32571 0.049639 10
reco:opslicer:OpSlicer 0.78114 1.07646 1.69426 1.02809 0.229136 10
reco:caldata:DataPrepModule 6.10231 7.23072 9.3295 6.89891 1.01299 10
reco:wclsdatasp:WireCellToolkit 42.7931 50.1478 56.4102 50.8258 3.89195 10
reco:gaushit:GausHitFinder 1.3804 1.66335 2.60128 1.46565 0.407107 10
reco:nhitsfilter:NumberOfHitsFilter 0.000599902 0.000760499 0.00097704 0.000764715 0.000114702 10
reco:reco3d:SpacePointSolver 13.0734 29.4008 63.7432 26.808 14.0396 10
reco:hitpdune:DisambigFromSpacePoints 1.61926 2.66882 4.68524 2.27504 0.930269 10
reco:pandora:StandardPandora 36.5214 69.1354 145.94 62.3602 32.2658 10
reco:pandoraWriter:StandardPandora 0.572026 0.720699 0.93279 0.690192 0.121902 10
reco:pandoraTrack:LArPandoraTrackCreation 5.588 8.23882 13.1645 8.48309 2.0564 10
reco:pandoraShower:LArPandoraShowerCreation 4.62837 9.08329 19.5327 8.42564 3.91131 10
reco:pandoracalo:Calorimetry 2.85429 3.89566 6.77162 3.79996 1.08924 10
reco:pandoracalonosce:Calorimetry 2.61379 3.65786 5.85805 3.5627 0.899591 10
reco:pandorapid:Chi2ParticleID 0.00648364 0.00942525 0.0146794 0.0085124 0.00253341 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0553593 0.0859053 0.124794 0.0753735 0.0245323 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00646881 0.00895194 0.0120371 0.00814723 0.00194732 10
reco:pandoraShowercalo:ShowerCalorimetry 4.15007 8.59272 18.8583 7.43064 3.87387 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.02474 7.66355 16.4522 6.5801 3.29533 10
reco:emtrkmichelid:EmTrackMichelId 257.239 314.022 439.899 304.696 54.0564 10
reco:crttag:SingleCRTMatchingProducer 0.0137814 0.0222281 0.0359746 0.02018 0.00757851 10
reco:crtreco:TwoCRTMatchingProducer 0.0104202 0.0148921 0.0220354 0.0144802 0.00387418 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.830357 1.29217 1.66088 1.35329 0.2351 10
reco:pandora2Track:LArPandoraTrackCreation 16.0945 25.1287 56.947 21.1525 11.4475 10
reco:pandora2calo:Calorimetry 6.96697 12.0508 29.5096 10.3786 6.0642 10
reco:pandora2calonosce:Calorimetry 6.14471 10.8415 27.2009 8.79976 5.71532 10
reco:pandora2pid:Chi2ParticleID 0.0157898 0.0229302 0.0457762 0.0203159 0.00813962 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0629458 0.0978909 0.160106 0.0943944 0.0242747 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0159876 0.0218022 0.0458821 0.0191721 0.00820978 10
reco:pandora2Shower:LArPandoraShowerCreation 5.18592 9.72106 19.8868 8.49842 4.09263 10
reco:pandora2Showercalo:ShowerCalorimetry 5.74587 9.4689 20.453 8.38643 4.01211 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.10045 8.58251 18.9296 8.21898 3.70604 10
[art]:TriggerResults:TriggerResultInserter 5.0511e-05 8.03367e-05 0.000170924 7.33365e-05 3.47806e-05 10
end_path:out1:RootOutput 1.3031e-05 1.54802e-05 1.95e-05 1.3865e-05 2.45599e-06 10
end_path:out1:RootOutput(write) 3.40896 4.79318 8.28632 4.32792 1.38112 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5401.05 MB
Peak resident set size usage (VmHWM): 4541.69 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.30 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.52 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 12181916
-rw-r--r--. 1 cuser cuser 2782381140 Dec 18 18:01 detsim_stage2.root
-rw-r--r--. 1 cuser cuser 2638182567 Dec 18 17:57 detsim_stage1.root
-rw-r--r--. 1 cuser cuser 2518676157 Dec 18 19:45 reco_stage1.root
-rw-r--r--. 1 cuser cuser 2276130770 Dec 18 14:59 g4_stage2.root
-rw-r--r--. 1 cuser cuser 2171009100 Dec 18 14:33 g4_stage1.root
-rw-r--r--. 1 cuser cuser 87278090 Dec 18 19:33 Pandora_Events.pndr
-rw-r--r--. 1 cuser cuser 243297 Dec 18 19:45 jobscript.log
-rw-r--r--. 1 cuser cuser 217088 Dec 18 19:45 mem.db
-rw-r--r--. 1 cuser cuser 62376 Dec 18 19:45 Pandora_Geometry.xml
-rw-r--r--. 1 cuser cuser 36864 Dec 18 19:45 time.db
-rw-r--r--. 1 cuser cuser 519 Dec 18 18:01 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 cuser cuser 519 Dec 18 14:59 g4_protoDUNE_hist.root
-rw-r--r--. 1 cuser cuser 519 Dec 18 19:45 protoDUNE_reco1_hist.root
-rw-r--r--. 1 cuser cuser 52 Dec 18 14:21 all-input-dids.txt
-rw-r--r--. 1 cuser cuser 7 Dec 18 19:45 justin-processed-pfns.txt
-rw-r--r--. 1 cuser cuser 0 Dec 18 18:10 ProtoDUNE.log
-rw-r--r--. 1 cuser cuser 0 Dec 18 18:01 debugprod.log
