Jobsub ID 264685.0@dunegpschedd02.fnal.gov
| Jobsub ID | 264685.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11378 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-28 15:22:06 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2025-12-28 17:31:35 |
| From worker node | Hostname | dunegli-49579-0-cmswn6018.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-28 15:23:48 |
| Input files | monte-carlo-011378-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7656s) |
| CPU time | 2h (7615s = 99%) |
| Max RSS bytes | 4437360640 (4231 MiB) |
| Outputting started | 2025-12-28 17:31:25 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11378/1/001/reco_stage1.root
|
| Finished | 2025-12-28 17:31:35 |
| Saved logs | justin-logs:264685.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
epService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 130496 traces, 0 summary
Retagger: tagging trace set: gauss with 95508 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95508 traces tagged "gauss"
FrameSaver: q=3.40192e+06 n=1639307 tag=gauss
wclsFrameSaver: saving 130496 traces tagged "wiener"
FrameSaver: q=3.63966e+06 n=1436852 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 44122 XUs and 34182 XVs -> 1255 XUVs
C:0 T:1 243757 XUs and 124195 XVs -> 37991 XUVs
C:0 T:2 99932 XUs and 111943 XVs -> 11809 XUVs
C:0 T:3 41820 XUs and 49474 XVs -> 596 XUVs
C:0 T:4 9825 XUs and 6680 XVs -> 108 XUVs
C:0 T:5 115604 XUs and 61877 XVs -> 22928 XUVs
C:0 T:6 79865 XUs and 127018 XVs -> 4519 XUVs
C:0 T:7 34920 XUs and 52333 XVs -> 461 XUVs
C:0 T:8 9192 XUs and 6902 XVs -> 98 XUVs
C:0 T:9 139994 XUs and 82493 XVs -> 12267 XUVs
C:0 T:10 17344 XUs and 26886 XVs -> 3928 XUVs
C:0 T:11 130 XUs and 110 XVs -> 23 XUVs
95983 XUVs total
12282 collection wire objects
87759 potential space points
Neighbour search...
25296693 tests to find 10005818 neighbours
Iterating with no regularization...
Begin: 7.4355e+07
0 5.59212e+07
1 5.46891e+07
2 5.44938e+07
3 5.44294e+07
4 5.44035e+07
Now with regularization...
Begin: 4.30148e+07
0 4.29345e+07
1 4.28764e+07
2 4.2831e+07
3 4.27927e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411396632
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411396632
fLifetime: 30000 [us]
28-Dec-2025 17:31:24 UTC Closed output file "reco_stage1.root"
28-Dec-2025 17:31:24 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 175.645 219.828 275.599 219.791 33.7488 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000599505 0.00286523 0.00433835 0.00312604 0.00120569 10
reco:ophit:OpHitFinder 0.177396 0.209202 0.255158 0.208166 0.0216997 10
reco:opflash:OpFlashFinder 0.0998913 0.14829 0.205209 0.148651 0.0285182 10
reco:opslicer:OpSlicer 0.321342 0.404052 0.488518 0.420936 0.0484141 10
reco:caldata:DataPrepModule 3.07345 3.14373 3.33383 3.10732 0.0763146 10
reco:wclsdatasp:WireCellToolkit 20.3037 21.231 21.9062 21.2366 0.482298 10
reco:gaushit:GausHitFinder 0.538762 0.657002 0.772737 0.675186 0.0780664 10
reco:nhitsfilter:NumberOfHitsFilter 0.000209149 0.000259155 0.000413101 0.000239646 5.69815e-05 10
reco:reco3d:SpacePointSolver 5.2464 12.2011 16.9104 12.4418 4.00252 10
reco:hitpdune:DisambigFromSpacePoints 0.608206 0.926116 1.27797 0.965007 0.206202 10
reco:pandora:StandardPandora 11.8112 21.9462 42.5498 19.5014 9.1947 10
reco:pandoraWriter:StandardPandora 0.200727 0.255417 0.318695 0.264026 0.0402113 10
reco:pandoraTrack:LArPandoraTrackCreation 1.48459 2.24504 3.03343 2.13428 0.486886 10
reco:pandoraShower:LArPandoraShowerCreation 1.76673 2.54375 3.73211 2.3917 0.625577 10
reco:pandoracalo:Calorimetry 0.935639 1.35503 1.8123 1.31408 0.273085 10
reco:pandoracalonosce:Calorimetry 0.863605 1.26935 1.70855 1.22872 0.261229 10
reco:pandorapid:Chi2ParticleID 0.00247476 0.00314083 0.0043721 0.00303264 0.000518023 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0237179 0.0296206 0.0369637 0.0288738 0.00421843 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00237239 0.00284651 0.00336614 0.00281033 0.000325183 10
reco:pandoraShowercalo:ShowerCalorimetry 1.96273 2.86232 4.12335 2.74765 0.6914 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.89592 2.79176 4.0028 2.69255 0.683076 10
reco:emtrkmichelid:EmTrackMichelId 98.8489 118.053 143.323 119.119 14.6774 10
reco:crttag:SingleCRTMatchingProducer 0.00591035 0.00807415 0.0111944 0.00737264 0.00159867 10
reco:crtreco:TwoCRTMatchingProducer 0.00427932 0.00489467 0.00578309 0.00467477 0.000564991 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.449291 0.551919 0.654166 0.554201 0.0622112 10
reco:pandora2Track:LArPandoraTrackCreation 5.36353 7.38598 10.6254 6.95538 1.82618 10
reco:pandora2calo:Calorimetry 2.92784 4.02729 5.64201 3.91225 0.926381 10
reco:pandora2calonosce:Calorimetry 2.83967 3.86708 5.41486 3.73944 0.880094 10
reco:pandora2pid:Chi2ParticleID 0.00616903 0.0071532 0.00864924 0.00706626 0.000868673 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0308606 0.0371822 0.0456679 0.0375442 0.00522233 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00593818 0.0069757 0.00847179 0.00688737 0.000861513 10
reco:pandora2Shower:LArPandoraShowerCreation 2.08162 2.81565 4.03335 2.68148 0.650215 10
reco:pandora2Showercalo:ShowerCalorimetry 2.64492 3.57799 4.95371 3.51163 0.784163 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.43142 3.32771 4.61665 3.26496 0.724788 10
[art]:TriggerResults:TriggerResultInserter 3.261e-05 4.3896e-05 0.0001052 3.7973e-05 2.06325e-05 10
end_path:out1:RootOutput 6.319e-06 9.1229e-06 1.3761e-05 8.9135e-06 1.73502e-06 10
end_path:out1:RootOutput(write) 1.5261 1.85902 2.30957 1.8514 0.250959 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5257.13 MB
Peak resident set size usage (VmHWM): 4437.36 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 1.93 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11173288
-rw-r--r-- 1 dunegli fnalgrid 2583351272 Dec 28 16:53 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2452966753 Dec 28 16:52 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2303326128 Dec 28 17:31 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2047111261 Dec 28 15:34 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1971162840 Dec 28 15:26 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 82851580 Dec 28 17:29 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242991 Dec 28 17:31 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 28 17:31 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 28 17:31 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 28 17:31 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 16:53 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 15:34 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 17:31 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 28 15:23 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 28 17:31 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 28 16:57 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 28 16:53 debugprod.log
