Jobsub ID 265425.0@dunegpschedd02.fnal.gov
| Jobsub ID | 265425.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11464 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 16:11:23 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2026-01-01 19:37:15 |
| From worker node | Hostname | dunegli-49724-0-cmswn2357.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 16:27:13 |
| Input files | monte-carlo-011464-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11378s) |
| CPU time | 3h (11291s = 99%) |
| Max RSS bytes | 4248444928 (4051 MiB) |
| Outputting started | 2026-01-01 19:36:51 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11464/1/001/reco_stage1.root
|
| Finished | 2026-01-01 19:37:07 |
| Saved logs | justin-logs:265425.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
PrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 102501 traces, 0 summary
Retagger: tagging trace set: gauss with 82608 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 82608 traces tagged "gauss"
FrameSaver: q=2.78721e+06 n=1525270 tag=gauss
wclsFrameSaver: saving 102501 traces tagged "wiener"
FrameSaver: q=2.93424e+06 n=1382059 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 46020 XUs and 41631 XVs -> 467 XUVs
C:0 T:1 94225 XUs and 82679 XVs -> 6312 XUVs
C:0 T:2 64733 XUs and 104753 XVs -> 4973 XUVs
C:0 T:3 33071 XUs and 43207 XVs -> 208 XUVs
C:0 T:4 8610 XUs and 8516 XVs -> 78 XUVs
C:0 T:5 31536 XUs and 21804 XVs -> 4330 XUVs
C:0 T:6 37334 XUs and 51160 XVs -> 1427 XUVs
C:0 T:7 18585 XUs and 25495 XVs -> 98 XUVs
C:0 T:8 8575 XUs and 10359 XVs -> 92 XUVs
C:0 T:9 51454 XUs and 75740 XVs -> 4385 XUVs
C:0 T:10 13872 XUs and 7814 XVs -> 1165 XUVs
C:0 T:11 73 XUs and 58 XVs -> 10 XUVs
23545 XUVs total
9273 collection wire objects
21826 potential space points
Neighbour search...
2195314 tests to find 1020364 neighbours
Iterating with no regularization...
Begin: 5.93126e+07
0 5.17803e+07
1 5.12832e+07
2 5.12187e+07
3 5.12021e+07
Now with regularization...
Begin: 4.31371e+07
0 4.31067e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411477769
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411477769
fLifetime: 30000 [us]
01-Jan-2026 19:36:50 UTC Closed output file "reco_stage1.root"
01-Jan-2026 19:36:50 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 269.523 374.755 509.605 363.686 69.9616 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000957638 0.00303588 0.00529308 0.00322253 0.00120411 10
reco:ophit:OpHitFinder 0.243527 0.263613 0.291805 0.263182 0.0157777 10
reco:opflash:OpFlashFinder 0.143181 0.165215 0.225338 0.155025 0.0233378 10
reco:opslicer:OpSlicer 0.538694 0.663296 0.863993 0.668557 0.0897772 10
reco:caldata:DataPrepModule 5.45963 5.79638 6.09016 5.79556 0.185498 10
reco:wclsdatasp:WireCellToolkit 43.8083 57.6852 62.8869 60.5908 6.93447 10
reco:gaushit:GausHitFinder 1.1489 1.50025 1.78245 1.47105 0.204457 10
reco:nhitsfilter:NumberOfHitsFilter 0.000319762 0.000516057 0.000757185 0.000468764 0.00014098 10
reco:reco3d:SpacePointSolver 9.59104 13.4934 19.4072 11.828 3.77165 10
reco:hitpdune:DisambigFromSpacePoints 1.47901 2.28 3.63286 2.07708 0.610334 10
reco:pandora:StandardPandora 19.2042 39.2705 66.9785 35.1567 15.0026 10
reco:pandoraWriter:StandardPandora 0.306983 0.444676 0.560414 0.447238 0.0786765 10
reco:pandoraTrack:LArPandoraTrackCreation 2.63915 4.70339 8.0022 4.31026 1.42688 10
reco:pandoraShower:LArPandoraShowerCreation 2.18864 4.45847 7.82707 3.99212 1.87062 10
reco:pandoracalo:Calorimetry 1.38786 2.691 4.3324 2.556 0.778577 10
reco:pandoracalonosce:Calorimetry 1.28903 2.47426 4.05999 2.36076 0.737799 10
reco:pandorapid:Chi2ParticleID 0.00558902 0.00668667 0.00804758 0.00668872 0.000788468 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0485214 0.0685893 0.0881653 0.0709003 0.0117406 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0053813 0.00637843 0.00809067 0.00623165 0.000752721 10
reco:pandoraShowercalo:ShowerCalorimetry 2.03815 4.79808 8.89467 4.32357 2.05698 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.98103 4.64517 8.80898 4.20846 1.99079 10
reco:emtrkmichelid:EmTrackMichelId 132.751 179.275 228.238 176.815 28.1705 10
reco:crttag:SingleCRTMatchingProducer 0.012087 0.0171147 0.0237433 0.0168163 0.00347262 10
reco:crtreco:TwoCRTMatchingProducer 0.00730964 0.0104762 0.0135968 0.00995004 0.00225424 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.41756 1.68525 2.01525 1.67011 0.19406 10
reco:pandora2Track:LArPandoraTrackCreation 7.70173 14.5896 25.711 13.2588 5.49944 10
reco:pandora2calo:Calorimetry 3.80734 7.65559 13.057 7.23092 2.78264 10
reco:pandora2calonosce:Calorimetry 3.6596 7.28251 12.3956 6.76442 2.62909 10
reco:pandora2pid:Chi2ParticleID 0.0125016 0.0164688 0.0220634 0.0157255 0.00305444 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0593486 0.0859216 0.11399 0.0883803 0.0158957 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.012332 0.0162207 0.0213967 0.0158444 0.00284862 10
reco:pandora2Shower:LArPandoraShowerCreation 2.69446 4.85267 8.10125 4.49536 1.66843 10
reco:pandora2Showercalo:ShowerCalorimetry 2.8842 5.88069 10.3495 5.44466 2.18133 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.66845 5.33089 9.25275 5.06458 1.91176 10
[art]:TriggerResults:TriggerResultInserter 3.86e-05 5.99092e-05 0.000122657 5.65905e-05 2.18221e-05 10
end_path:out1:RootOutput 6.796e-06 9.5223e-06 1.4932e-05 9.1025e-06 2.16442e-06 10
end_path:out1:RootOutput(write) 1.84235 2.54963 3.41946 2.51911 0.45987 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5061.97 MB
Peak resident set size usage (VmHWM): 4248.44 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.70 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10084756
-rw-r--r-- 1 dunegli fnalgrid 2375102046 Jan 1 18:32 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2261100034 Jan 1 18:29 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2039341397 Jan 1 19:36 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1826459189 Jan 1 16:44 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1754650120 Jan 1 16:32 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 69514410 Jan 1 19:33 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242717 Jan 1 19:36 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 19:36 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 19:36 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 19:36 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 18:32 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 16:44 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 19:36 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 16:27 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 19:36 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 18:37 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 18:32 debugprod.log
