Jobsub ID 265699.0@dunegpschedd02.fnal.gov
| Jobsub ID | 265699.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11492 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-03 19:22:08 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-03 23:03:51 |
| From worker node | Hostname | tdm005.pic.es |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-03 19:22:37 |
| Input files | monte-carlo-011492-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13228s) |
| CPU time | 3h (12632s = 95%) |
| Max RSS bytes | 4096397312 (3906 MiB) |
| Outputting started | 2026-01-03 23:03:07 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11492/1/001/reco_stage1.root
|
| Finished | 2026-01-03 23:03:51 |
| Saved logs | justin-logs:265699.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
rvice:prepare: Running tool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 105620 traces, 0 summary
Retagger: tagging trace set: gauss with 83050 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83050 traces tagged "gauss"
FrameSaver: q=2.9759e+06 n=1512382 tag=gauss
wclsFrameSaver: saving 105620 traces tagged "wiener"
FrameSaver: q=3.14054e+06 n=1356234 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 29137 XUs and 24558 XVs -> 209 XUVs
C:0 T:1 52384 XUs and 49886 XVs -> 3502 XUVs
C:0 T:2 114379 XUs and 134540 XVs -> 4676 XUVs
C:0 T:3 49682 XUs and 52409 XVs -> 491 XUVs
C:0 T:4 10827 XUs and 8774 XVs -> 61 XUVs
C:0 T:5 26315 XUs and 17640 XVs -> 1979 XUVs
C:0 T:6 79256 XUs and 88305 XVs -> 8352 XUVs
C:0 T:7 26358 XUs and 31982 XVs -> 576 XUVs
C:0 T:8 8996 XUs and 7958 XVs -> 64 XUVs
C:0 T:9 48852 XUs and 52942 XVs -> 3118 XUVs
C:0 T:10 11352 XUs and 11734 XVs -> 1811 XUVs
C:0 T:11 71 XUs and 55 XVs -> 16 XUVs
24855 XUVs total
8780 collection wire objects
22097 potential space points
Neighbour search...
1415601 tests to find 734036 neighbours
Iterating with no regularization...
Begin: 6.42161e+07
0 5.41465e+07
1 5.3263e+07
2 5.31237e+07
3 5.30831e+07
Now with regularization...
Begin: 4.44815e+07
0 4.44392e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411520596
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411520596
fLifetime: 30000 [us]
04-Jan-2026 00:03:04 CET Closed output file "reco_stage1.root"
04-Jan-2026 00:03:04 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 284.573 386.52 508.24 391.666 70.2156 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00102099 0.00412789 0.0058857 0.00461197 0.00152943 10
reco:ophit:OpHitFinder 0.259718 0.329706 0.410912 0.328574 0.0436161 10
reco:opflash:OpFlashFinder 0.125683 0.175014 0.241319 0.166184 0.0437074 10
reco:opslicer:OpSlicer 0.490419 0.747595 1.00746 0.775545 0.14753 10
reco:caldata:DataPrepModule 6.13108 6.68721 7.49613 6.67708 0.486994 10
reco:wclsdatasp:WireCellToolkit 37.5196 40.5497 43.0144 41.0175 1.89033 10
reco:gaushit:GausHitFinder 0.947888 1.44792 1.83805 1.47427 0.313018 10
reco:nhitsfilter:NumberOfHitsFilter 0.000418637 0.000804439 0.00164537 0.000680732 0.000343585 10
reco:reco3d:SpacePointSolver 9.01078 16.8607 28.1068 16.788 5.0952 10
reco:hitpdune:DisambigFromSpacePoints 0.857794 1.60627 2.30614 1.42552 0.463494 10
reco:pandora:StandardPandora 14.3774 30.4136 57.5524 29.9285 11.5495 10
reco:pandoraWriter:StandardPandora 0.397467 0.574184 0.748393 0.576042 0.105554 10
reco:pandoraTrack:LArPandoraTrackCreation 2.01564 5.08038 10.3821 4.65957 2.14912 10
reco:pandoraShower:LArPandoraShowerCreation 1.851 4.7564 8.22137 4.28218 2.00858 10
reco:pandoracalo:Calorimetry 1.27349 2.61876 5.32161 2.52736 1.0858 10
reco:pandoracalonosce:Calorimetry 1.05498 2.58282 5.54757 2.41894 1.20707 10
reco:pandorapid:Chi2ParticleID 0.00329463 0.00680011 0.0103985 0.00649823 0.00176311 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0388249 0.0676847 0.0837237 0.0698941 0.0125999 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00326562 0.00652687 0.0110081 0.00650223 0.00187712 10
reco:pandoraShowercalo:ShowerCalorimetry 2.10325 5.49196 8.83679 5.35132 2.49978 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.01722 5.29959 8.24074 4.47801 2.2492 10
reco:emtrkmichelid:EmTrackMichelId 167.099 213.133 257.978 211.031 30.0654 10
reco:crttag:SingleCRTMatchingProducer 0.0115701 0.0182663 0.050848 0.0147047 0.0110804 10
reco:crtreco:TwoCRTMatchingProducer 0.00641644 0.010439 0.0266883 0.00849387 0.00566578 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.48297 0.885774 1.17221 0.95302 0.227708 10
reco:pandora2Track:LArPandoraTrackCreation 6.11872 14.1694 23.8519 15.3338 5.08399 10
reco:pandora2calo:Calorimetry 3.18212 7.38849 12.9428 7.53157 3.01976 10
reco:pandora2calonosce:Calorimetry 3.19669 6.65545 10.8103 6.22134 2.51683 10
reco:pandora2pid:Chi2ParticleID 0.00766133 0.0140885 0.0239504 0.0139325 0.00467357 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.039733 0.0747025 0.114136 0.0730678 0.0216263 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00738582 0.0136327 0.0233229 0.013336 0.00462483 10
reco:pandora2Shower:LArPandoraShowerCreation 2.39327 4.99864 8.41629 4.99097 1.75228 10
reco:pandora2Showercalo:ShowerCalorimetry 2.51258 5.41025 8.48976 5.45119 2.00302 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.16644 5.06615 7.46953 5.31155 1.74327 10
[art]:TriggerResults:TriggerResultInserter 6.5373e-05 0.00011312 0.000236801 9.6777e-05 4.47799e-05 10
end_path:out1:RootOutput 1.2229e-05 1.58327e-05 2.7283e-05 1.4057e-05 4.42017e-06 10
end_path:out1:RootOutput(write) 2.4335 3.18498 3.90713 3.15408 0.508605 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4967.57 MB
Peak resident set size usage (VmHWM): 4096.4 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9677012
-rw-r--r-- 1 dune001 dune 2291681723 Jan 3 22:55 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2182338109 Jan 3 22:53 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 1946398082 Jan 4 00:03 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1742425511 Jan 3 20:45 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1678880770 Jan 3 20:31 g4_stage1.root
-rw-r--r-- 1 dune001 dune 66902240 Jan 3 23:58 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242858 Jan 4 00:03 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 4 00:03 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 4 00:03 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 4 00:03 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 3 22:55 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 3 20:45 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 4 00:03 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 3 20:22 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 4 00:03 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 3 23:01 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 3 22:56 debugprod.log
