Jobsub ID 269043.1@dunegpschedd01.fnal.gov
| Jobsub ID | 269043.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11245 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-18 10:38:44 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2025-12-18 14:10:01 |
| From worker node | Hostname | dunegli-49199-0-cmswn2413.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-18 10:40:58 |
| Input files | monte-carlo-011245-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12525s) |
| CPU time | 3h (12416s = 99%) |
| Max RSS bytes | 4288167936 (4089 MiB) |
| Outputting started | 2025-12-18 14:09:44 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11245/1/001/reco_stage1.root
|
| Finished | 2025-12-18 14:10:01 |
| Saved logs | justin-logs:269043.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
eToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 146824 traces, 0 summary
Retagger: tagging trace set: gauss with 111985 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 111985 traces tagged "gauss"
FrameSaver: q=3.86543e+06 n=1962830 tag=gauss
wclsFrameSaver: saving 146824 traces tagged "wiener"
FrameSaver: q=4.10246e+06 n=1736178 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 25400 XUs and 28357 XVs -> 626 XUVs
C:0 T:1 60935 XUs and 94530 XVs -> 13685 XUVs
C:0 T:2 166639 XUs and 144491 XVs -> 12273 XUVs
C:0 T:3 49705 XUs and 49610 XVs -> 518 XUVs
C:0 T:4 17657 XUs and 21445 XVs -> 432 XUVs
C:0 T:5 106183 XUs and 165278 XVs -> 27280 XUVs
C:0 T:6 102812 XUs and 103773 XVs -> 4919 XUVs
C:0 T:7 37011 XUs and 38579 XVs -> 322 XUVs
C:0 T:8 7171 XUs and 9079 XVs -> 89 XUVs
C:0 T:9 40454 XUs and 77146 XVs -> 4769 XUVs
C:0 T:10 33563 XUs and 20918 XVs -> 3718 XUVs
C:0 T:11 166 XUs and 168 XVs -> 13 XUVs
68644 XUVs total
13136 collection wire objects
63803 potential space points
Neighbour search...
14283361 tests to find 5928612 neighbours
Iterating with no regularization...
Begin: 6.36092e+07
0 5.35135e+07
1 5.27334e+07
2 5.26188e+07
3 5.25854e+07
Now with regularization...
Begin: 4.19059e+07
0 4.18469e+07
1 4.1794e+07
2 4.17526e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411191426
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411191426
fLifetime: 30000 [us]
18-Dec-2025 14:09:42 UTC Closed output file "reco_stage1.root"
18-Dec-2025 14:09:42 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 233.504 372.76 463.437 382.009 63.4514 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00119435 0.00327843 0.00496567 0.00345193 0.00130138 10
reco:ophit:OpHitFinder 0.276297 0.309772 0.345047 0.306304 0.0237436 10
reco:opflash:OpFlashFinder 0.156834 0.21187 0.25555 0.216685 0.030563 10
reco:opslicer:OpSlicer 0.596422 0.748906 0.921259 0.709538 0.102454 10
reco:caldata:DataPrepModule 5.10082 5.35741 5.69055 5.34385 0.136655 10
reco:wclsdatasp:WireCellToolkit 31.3734 35.4047 37.5048 35.8105 1.79878 10
reco:gaushit:GausHitFinder 0.802279 1.23966 1.49517 1.23645 0.193795 10
reco:nhitsfilter:NumberOfHitsFilter 0.000419782 0.000571602 0.000800852 0.000553033 8.97387e-05 10
reco:reco3d:SpacePointSolver 8.49767 17.2285 26.8201 17.3713 5.15621 10
reco:hitpdune:DisambigFromSpacePoints 0.937868 1.88516 2.42558 2.00362 0.461814 10
reco:pandora:StandardPandora 15.7936 40.3794 67.3597 42.8544 13.9043 10
reco:pandoraWriter:StandardPandora 0.3243 0.475074 0.599885 0.472574 0.0692164 10
reco:pandoraTrack:LArPandoraTrackCreation 3.34416 5.61903 7.8429 5.56576 1.3065 10
reco:pandoraShower:LArPandoraShowerCreation 2.34611 6.61495 10.0615 6.64876 2.0513 10
reco:pandoracalo:Calorimetry 1.46561 2.66865 3.78619 2.65897 0.639956 10
reco:pandoracalonosce:Calorimetry 1.32918 2.47173 3.48479 2.42092 0.6112 10
reco:pandorapid:Chi2ParticleID 0.00520745 0.00664758 0.00884974 0.00631999 0.00119667 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0436898 0.0548948 0.0645955 0.0545635 0.00633567 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00508464 0.00608791 0.00714913 0.0061494 0.000709625 10
reco:pandoraShowercalo:ShowerCalorimetry 2.14377 5.91352 9.36859 5.85641 1.83578 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.72596 5.89867 9.6492 5.99748 1.98647 10
reco:emtrkmichelid:EmTrackMichelId 126.256 181.331 216.563 181.477 24.6673 10
reco:crttag:SingleCRTMatchingProducer 0.0107019 0.0154329 0.0259381 0.0141908 0.00386338 10
reco:crtreco:TwoCRTMatchingProducer 0.00752678 0.0110395 0.0136975 0.011331 0.00167144 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.732382 0.94025 1.21914 0.936455 0.131347 10
reco:pandora2Track:LArPandoraTrackCreation 8.05187 18.6098 27.5402 18.7371 5.07716 10
reco:pandora2calo:Calorimetry 3.05431 8.30133 13.0132 8.35488 2.46201 10
reco:pandora2calonosce:Calorimetry 3.15075 7.75479 12.0458 7.84211 2.10227 10
reco:pandora2pid:Chi2ParticleID 0.0114782 0.0170713 0.0226412 0.0171198 0.00305333 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0514597 0.0722695 0.0852849 0.0743425 0.00969441 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0103909 0.016129 0.0203106 0.0162833 0.00272934 10
reco:pandora2Shower:LArPandoraShowerCreation 2.77469 6.82019 10.142 6.89833 1.97049 10
reco:pandora2Showercalo:ShowerCalorimetry 3.06574 6.91654 10.3784 7.18046 1.85367 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.35697 6.10391 8.62418 6.02495 1.72175 10
[art]:TriggerResults:TriggerResultInserter 3.552e-05 5.67023e-05 0.000131452 5.04105e-05 2.5491e-05 10
end_path:out1:RootOutput 5.99e-06 1.03372e-05 1.5871e-05 1.0095e-05 2.28146e-06 10
end_path:out1:RootOutput(write) 2.26276 3.23813 3.92547 3.26032 0.456611 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5110.05 MB
Peak resident set size usage (VmHWM): 4288.17 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.47 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11014872
-rw-r--r-- 1 dunegli fnalgrid 2548318780 Dec 18 13:05 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2414963485 Dec 18 13:02 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2268837026 Dec 18 14:09 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2017285858 Dec 18 11:00 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1946345577 Dec 18 10:46 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 82845420 Dec 18 14:05 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243261 Dec 18 14:09 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 18 14:09 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 18 14:09 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 18 14:09 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 18 13:05 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 18 11:00 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 18 14:09 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 18 10:40 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 18 14:09 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 18 13:12 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 18 13:05 debugprod.log