Jobsub ID 232180.1@dunegpschedd02.fnal.gov
| Jobsub ID | 232180.1@dunegpschedd02.fnal.gov |
| Workflow ID | 9276 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-22 21:28:56 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-10-23 02:00:24 |
| From worker node | Hostname | dunegli-7312581-0-fnpc8001.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-22 21:29:55 |
| Input files | monte-carlo-009276-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16206s) |
| CPU time | 4h (15484s = 95%) |
| Max RSS bytes | 4454801408 (4248 MiB) |
| Outputting started | 2025-10-23 02:00:01 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09276/1/001/reco_stage1.root
|
| Finished | 2025-10-23 02:00:24 |
| Saved logs | justin-logs:232180.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 138560 traces, 0 summary
Retagger: tagging trace set: gauss with 104477 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 104477 traces tagged "gauss"
FrameSaver: q=3.67771e+06 n=1866172 tag=gauss
wclsFrameSaver: saving 138560 traces tagged "wiener"
FrameSaver: q=3.90545e+06 n=1659374 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 36234 XUs and 33437 XVs -> 502 XUVs
C:0 T:1 92661 XUs and 68031 XVs -> 8407 XUVs
C:0 T:2 88051 XUs and 91960 XVs -> 8074 XUVs
C:0 T:3 39338 XUs and 38978 XVs -> 282 XUVs
C:0 T:4 15512 XUs and 11100 XVs -> 122 XUVs
C:0 T:5 106662 XUs and 37742 XVs -> 10356 XUVs
C:0 T:6 144354 XUs and 144142 XVs -> 5896 XUVs
C:0 T:7 56038 XUs and 52941 XVs -> 573 XUVs
C:0 T:8 6646 XUs and 7672 XVs -> 99 XUVs
C:0 T:9 39581 XUs and 54572 XVs -> 4722 XUVs
C:0 T:10 50733 XUs and 44745 XVs -> 5001 XUVs
C:0 T:11 163 XUs and 159 XVs -> 11 XUVs
44045 XUVs total
12037 collection wire objects
40575 potential space points
Neighbour search...
4589043 tests to find 2166602 neighbours
Iterating with no regularization...
Begin: 6.54234e+07
0 5.24416e+07
1 5.15355e+07
2 5.13947e+07
3 5.13568e+07
Now with regularization...
Begin: 4.15948e+07
0 4.1536e+07
1 4.1507e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410053931
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410053931
fLifetime: 30000 [us]
23-Oct-2025 01:59:59 UTC Closed output file "reco_stage1.root"
23-Oct-2025 01:59:59 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 363.082 475.965 621.902 472.062 68.9176 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00137879 0.00403255 0.00664089 0.00423292 0.00171215 10
reco:ophit:OpHitFinder 0.240164 0.312554 0.344972 0.30696 0.0297618 10
reco:opflash:OpFlashFinder 0.160725 0.223422 0.267717 0.22445 0.0291106 10
reco:opslicer:OpSlicer 0.467736 0.777235 0.972349 0.800441 0.130174 10
reco:caldata:DataPrepModule 6.22441 6.33113 6.53721 6.32467 0.0875646 10
reco:wclsdatasp:WireCellToolkit 46.9201 59.392 65.5273 62.7497 6.72808 10
reco:gaushit:GausHitFinder 1.36035 1.77956 2.22142 1.81748 0.228414 10
reco:nhitsfilter:NumberOfHitsFilter 0.000444032 0.000636958 0.000786719 0.000668083 0.000103111 10
reco:reco3d:SpacePointSolver 10.7128 19.1245 36.9657 17.5948 7.01815 10
reco:hitpdune:DisambigFromSpacePoints 1.99561 3.02128 4.6702 3.0498 0.716145 10
reco:pandora:StandardPandora 33.8807 57.5936 91.241 56.0218 13.7341 10
reco:pandoraWriter:StandardPandora 0.424456 0.534147 0.647936 0.542434 0.0597661 10
reco:pandoraTrack:LArPandoraTrackCreation 4.78977 6.84596 8.8742 6.44868 1.14113 10
reco:pandoraShower:LArPandoraShowerCreation 4.174 6.54614 9.06787 6.66764 1.41655 10
reco:pandoracalo:Calorimetry 1.99189 3.33796 4.26831 3.208 0.637023 10
reco:pandoracalonosce:Calorimetry 1.7677 3.06788 3.93633 3.04174 0.599772 10
reco:pandorapid:Chi2ParticleID 0.00663282 0.00780662 0.00841178 0.0081781 0.000601861 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0690597 0.0842781 0.0977698 0.0829626 0.00891204 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00643394 0.00750243 0.00822226 0.00762848 0.000670354 10
reco:pandoraShowercalo:ShowerCalorimetry 3.42542 6.77978 9.38777 6.94124 1.65658 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.35465 6.73312 9.27698 6.82278 1.71456 10
reco:emtrkmichelid:EmTrackMichelId 179.742 223.055 272.258 228.285 26.5362 10
reco:crttag:SingleCRTMatchingProducer 0.0148361 0.0190781 0.0223709 0.0194548 0.00227271 10
reco:crtreco:TwoCRTMatchingProducer 0.00918544 0.0121748 0.0146416 0.0121554 0.00182957 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.4754 2.04171 2.60097 1.99494 0.344011 10
reco:pandora2Track:LArPandoraTrackCreation 12.868 22.4298 32.1401 22.1635 5.17612 10
reco:pandora2calo:Calorimetry 5.22113 9.72687 13.4509 9.94042 2.17381 10
reco:pandora2calonosce:Calorimetry 4.95726 9.20782 12.6109 9.39655 2.06781 10
reco:pandora2pid:Chi2ParticleID 0.0142382 0.019106 0.0225152 0.0194097 0.00210218 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0827368 0.107038 0.126523 0.10791 0.012018 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0144169 0.0188997 0.0216187 0.0192453 0.00182261 10
reco:pandora2Shower:LArPandoraShowerCreation 4.65006 7.23811 9.59133 7.331 1.41265 10
reco:pandora2Showercalo:ShowerCalorimetry 4.72942 8.44797 11.4139 8.71399 1.83006 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.40762 7.8279 10.4942 8.10753 1.70966 10
[art]:TriggerResults:TriggerResultInserter 5.3219e-05 7.22407e-05 0.000145444 6.6866e-05 2.50853e-05 10
end_path:out1:RootOutput 8.298e-06 9.8316e-06 1.6487e-05 9.4165e-06 2.27868e-06 10
end_path:out1:RootOutput(write) 2.57506 3.20973 4.12509 3.25966 0.442676 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5265.56 MB
Peak resident set size usage (VmHWM): 4454.8 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10934556
-rw-r--r-- 1 dunegli fnalgrid 2551444624 Oct 23 00:37 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2424576230 Oct 23 00:30 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2258687146 Oct 23 01:59 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1981046878 Oct 22 22:03 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1900536943 Oct 22 21:39 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 80069460 Oct 23 01:54 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243080 Oct 23 02:00 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Oct 23 02:00 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Oct 23 02:00 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Oct 23 01:59 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 23 00:37 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 22 22:03 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 23 02:00 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Oct 22 21:29 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Oct 23 02:00 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 23 00:45 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 23 00:37 debugprod.log