Jobsub ID 272559.1@dunegpschedd02.fnal.gov
| Jobsub ID | 272559.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11927 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-14 22:13:03 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2026-01-15 02:39:24 |
| From worker node | Hostname | tds431.pic.es |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-14 22:14:12 |
| Input files | monte-carlo-011927-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15867s) |
| CPU time | 4h (15233s = 96%) |
| Max RSS bytes | 4552871936 (4341 MiB) |
| Outputting started | 2026-01-15 02:38:40 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11927/1/001/reco_stage1.root
|
| Finished | 2026-01-15 02:39:24 |
| Saved logs | justin-logs:272559.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ool adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 147281 traces, 0 summary
Retagger: tagging trace set: gauss with 107379 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 107379 traces tagged "gauss"
FrameSaver: q=3.74575e+06 n=1830966 tag=gauss
wclsFrameSaver: saving 147281 traces tagged "wiener"
FrameSaver: q=3.99947e+06 n=1593775 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 62516 XUs and 60142 XVs -> 963 XUVs
C:0 T:1 156452 XUs and 129043 XVs -> 11124 XUVs
C:0 T:2 122325 XUs and 128722 XVs -> 5351 XUVs
C:0 T:3 48695 XUs and 47565 XVs -> 273 XUVs
C:0 T:4 10314 XUs and 11748 XVs -> 128 XUVs
C:0 T:5 38672 XUs and 33855 XVs -> 3453 XUVs
C:0 T:6 126593 XUs and 102847 XVs -> 5738 XUVs
C:0 T:7 45220 XUs and 35519 XVs -> 326 XUVs
C:0 T:8 5570 XUs and 4852 XVs -> 63 XUVs
C:0 T:9 39663 XUs and 45321 XVs -> 2579 XUVs
C:0 T:10 74525 XUs and 14806 XVs -> 7272 XUVs
C:0 T:11 80 XUs and 38 XVs -> 12 XUVs
37282 XUVs total
13514 collection wire objects
33707 potential space points
Neighbour search...
2333539 tests to find 1185086 neighbours
Iterating with no regularization...
Begin: 1.16246e+08
0 8.72947e+07
1 8.59269e+07
2 8.57352e+07
3 8.56827e+07
Now with regularization...
Begin: 7.27782e+07
0 7.27049e+07
1 7.26796e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411744351
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411744351
fLifetime: 30000 [us]
15-Jan-2026 03:38:37 CET Closed output file "reco_stage1.root"
15-Jan-2026 03:38:37 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 375.156 526.66 679.474 521.731 96.3232 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00089973 0.00539356 0.0165698 0.00447733 0.00421198 10
reco:ophit:OpHitFinder 0.296314 0.357901 0.502161 0.328963 0.0716544 10
reco:opflash:OpFlashFinder 0.193666 0.250518 0.363812 0.226297 0.0594485 10
reco:opslicer:OpSlicer 0.66348 0.8842 1.47375 0.756146 0.291096 10
reco:caldata:DataPrepModule 4.79276 5.41194 7.10828 5.22406 0.645846 10
reco:wclsdatasp:WireCellToolkit 36.2249 40.8773 51.2616 40.3761 4.17727 10
reco:gaushit:GausHitFinder 1.04645 1.5564 2.30551 1.51111 0.380305 10
reco:nhitsfilter:NumberOfHitsFilter 0.000523541 0.00140341 0.00690353 0.000777087 0.0018423 10
reco:reco3d:SpacePointSolver 15.1617 23.1739 39.701 22.4784 6.5273 10
reco:hitpdune:DisambigFromSpacePoints 1.25533 2.00049 2.63799 2.08836 0.428925 10
reco:pandora:StandardPandora 25.3211 63.4118 124.4 53.4799 29.7373 10
reco:pandoraWriter:StandardPandora 0.422239 0.617496 0.881747 0.642213 0.124473 10
reco:pandoraTrack:LArPandoraTrackCreation 3.666 7.91086 12.141 7.90904 2.47833 10
reco:pandoraShower:LArPandoraShowerCreation 3.66179 8.61901 13.0382 8.0574 3.2264 10
reco:pandoracalo:Calorimetry 1.79068 3.92779 5.57219 4.2295 1.14309 10
reco:pandoracalonosce:Calorimetry 1.69664 3.54604 5.13036 3.88466 1.07073 10
reco:pandorapid:Chi2ParticleID 0.0052559 0.00748273 0.0115167 0.00734135 0.00161469 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0452415 0.0644711 0.101706 0.0617968 0.0145011 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00517663 0.00710085 0.0110354 0.00705915 0.00157187 10
reco:pandoraShowercalo:ShowerCalorimetry 4.08248 7.57437 10.8033 7.60489 2.18658 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.90151 7.59677 10.9313 8.28992 2.27266 10
reco:emtrkmichelid:EmTrackMichelId 205.968 272.799 324.65 269.353 37.6352 10
reco:crttag:SingleCRTMatchingProducer 0.0187266 0.0243253 0.0363027 0.0229357 0.00488303 10
reco:crtreco:TwoCRTMatchingProducer 0.0106333 0.0163013 0.0231789 0.0145597 0.00406958 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.897421 1.17765 1.72912 1.04435 0.280983 10
reco:pandora2Track:LArPandoraTrackCreation 13.4666 23.8656 37.5498 23.9186 6.9721 10
reco:pandora2calo:Calorimetry 6.26787 10.3801 15.1764 10.1631 2.87364 10
reco:pandora2calonosce:Calorimetry 6.12244 10.4152 13.634 11.1738 2.83943 10
reco:pandora2pid:Chi2ParticleID 0.0120391 0.0191754 0.0274979 0.0192955 0.00470525 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0606903 0.088301 0.130605 0.0801019 0.0226345 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0114825 0.0188493 0.0273764 0.018702 0.00452627 10
reco:pandora2Shower:LArPandoraShowerCreation 5.3604 8.80763 11.6273 9.04041 1.9841 10
reco:pandora2Showercalo:ShowerCalorimetry 6.42024 9.19554 13.0388 8.62698 2.0154 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.35698 7.8713 11.4212 7.39107 1.78992 10
[art]:TriggerResults:TriggerResultInserter 5.5322e-05 7.21548e-05 0.000111092 6.66815e-05 1.72774e-05 10
end_path:out1:RootOutput 8.641e-06 1.29653e-05 1.6331e-05 1.261e-05 2.34956e-06 10
end_path:out1:RootOutput(write) 2.96858 3.98771 5.00078 3.91011 0.56758 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5409 MB
Peak resident set size usage (VmHWM): 4552.87 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11628680
-rw-r--r-- 1 dune001 dune 2678916483 Jan 15 02:07 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2540726711 Jan 15 02:04 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2422088968 Jan 15 03:38 reco_stage1.root
-rw-r--r-- 1 dune001 dune 2132836729 Jan 14 23:42 g4_stage2.root
-rw-r--r-- 1 dune001 dune 2043832387 Jan 14 23:24 g4_stage1.root
-rw-r--r-- 1 dune001 dune 88728220 Jan 15 03:32 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242962 Jan 15 03:38 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 15 03:38 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 15 03:38 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 15 03:38 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 15 02:07 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 14 23:42 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 15 03:38 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 14 23:14 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 15 03:38 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 15 02:16 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 15 02:07 debugprod.log
