Jobsub ID 274681.0@dunegpschedd02.fnal.gov
| Jobsub ID | 274681.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12043 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-18 06:05:29 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2026-01-18 11:56:46 |
| From worker node | Hostname | td805.pic.es |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-18 06:06:10 |
| Input files | monte-carlo-012043-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (20972s) |
| CPU time | 5h (20122s = 95%) |
| Max RSS bytes | 4361056256 (4159 MiB) |
| Outputting started | 2026-01-18 11:55:44 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12043/1/001/reco_stage1.root
|
| Finished | 2026-01-18 11:56:38 |
| Saved logs | justin-logs:274681.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ce:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 108919 traces, 0 summary
Retagger: tagging trace set: gauss with 83466 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 83466 traces tagged "gauss"
FrameSaver: q=2.78664e+06 n=1494396 tag=gauss
wclsFrameSaver: saving 108919 traces tagged "wiener"
FrameSaver: q=2.93983e+06 n=1320736 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28707 XUs and 33785 XVs -> 381 XUVs
C:0 T:1 67273 XUs and 62264 XVs -> 4673 XUVs
C:0 T:2 55851 XUs and 80662 XVs -> 3685 XUVs
C:0 T:3 28848 XUs and 31802 XVs -> 209 XUVs
C:0 T:4 9314 XUs and 8398 XVs -> 80 XUVs
C:0 T:5 37940 XUs and 25231 XVs -> 2787 XUVs
C:0 T:6 127349 XUs and 98048 XVs -> 5313 XUVs
C:0 T:7 44427 XUs and 35656 XVs -> 256 XUVs
C:0 T:8 5564 XUs and 6405 XVs -> 53 XUVs
C:0 T:9 31060 XUs and 46551 XVs -> 2446 XUVs
C:0 T:10 32541 XUs and 19585 XVs -> 4075 XUVs
C:0 T:11 75 XUs and 54 XVs -> 6 XUVs
23964 XUVs total
10537 collection wire objects
22279 potential space points
Neighbour search...
1253657 tests to find 682692 neighbours
Iterating with no regularization...
Begin: 5.69209e+07
0 4.57805e+07
1 4.52687e+07
2 4.52022e+07
3 4.51818e+07
Now with regularization...
Begin: 3.82598e+07
0 3.823e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411811289
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411811289
fLifetime: 30000 [us]
18-Jan-2026 12:55:40 CET Closed output file "reco_stage1.root"
18-Jan-2026 12:55:40 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 465.435 713.113 1272.88 683.079 208.737 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00138883 0.00492967 0.00933111 0.00491975 0.00220548 10
reco:ophit:OpHitFinder 0.413318 0.479461 0.629297 0.468145 0.0584078 10
reco:opflash:OpFlashFinder 0.202218 0.297902 0.486286 0.279353 0.0755849 10
reco:opslicer:OpSlicer 0.916222 1.20994 1.70858 1.20116 0.205801 10
reco:caldata:DataPrepModule 6.47478 8.68776 9.41344 8.90418 0.778102 10
reco:wclsdatasp:WireCellToolkit 47.2768 59.6766 69.2697 60.1861 5.94466 10
reco:gaushit:GausHitFinder 1.69207 2.13684 3.17941 2.08296 0.390395 10
reco:nhitsfilter:NumberOfHitsFilter 0.000715236 0.000981203 0.0014557 0.000960658 0.00021592 10
reco:reco3d:SpacePointSolver 13.953 24.0447 74.1745 15.9509 17.501 10
reco:hitpdune:DisambigFromSpacePoints 1.627 2.85306 6.1464 2.54632 1.20443 10
reco:pandora:StandardPandora 30.1523 75.2304 162.538 69.1952 37.2 10
reco:pandoraWriter:StandardPandora 0.512567 0.797738 1.292 0.777093 0.221657 10
reco:pandoraTrack:LArPandoraTrackCreation 5.12452 9.29542 17.9956 9.48084 3.49582 10
reco:pandoraShower:LArPandoraShowerCreation 5.54118 10.9208 24.6001 9.77971 5.24199 10
reco:pandoracalo:Calorimetry 2.76721 5.31176 11.3527 4.88681 2.37243 10
reco:pandoracalonosce:Calorimetry 2.44832 4.74323 10.2837 4.30502 2.20975 10
reco:pandorapid:Chi2ParticleID 0.00631502 0.010172 0.0163249 0.00999727 0.00281279 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.05838 0.100407 0.170456 0.0991211 0.0341742 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00564067 0.0100803 0.0155658 0.01079 0.00296732 10
reco:pandoraShowercalo:ShowerCalorimetry 4.55557 11.3135 30.6258 10.3534 7.55568 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.38131 11.1563 30.5654 9.03679 7.35714 10
reco:emtrkmichelid:EmTrackMichelId 271.99 383.986 606.317 375.506 85.3036 10
reco:crttag:SingleCRTMatchingProducer 0.0146549 0.0521198 0.255906 0.0310235 0.0683217 10
reco:crtreco:TwoCRTMatchingProducer 0.0108782 0.0204258 0.0320894 0.0197903 0.0056017 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.07067 1.5175 2.51864 1.41228 0.399223 10
reco:pandora2Track:LArPandoraTrackCreation 15.1811 30.2761 65.392 27.1788 13.5264 10
reco:pandora2calo:Calorimetry 7.53358 16.2675 38.7333 14.3663 8.34974 10
reco:pandora2calonosce:Calorimetry 6.71807 13.8103 32.3117 12.8268 6.95927 10
reco:pandora2pid:Chi2ParticleID 0.0141777 0.0236787 0.0424752 0.0218004 0.00761426 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0762119 0.120299 0.220449 0.111952 0.0391334 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0145447 0.0229561 0.0395965 0.020635 0.00707097 10
reco:pandora2Shower:LArPandoraShowerCreation 5.16537 10.3877 21.9336 9.27378 4.5147 10
reco:pandora2Showercalo:ShowerCalorimetry 5.56626 12.297 26.3828 11.2794 5.46687 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.88516 10.9477 23.7235 10.3213 4.79742 10
[art]:TriggerResults:TriggerResultInserter 6.335e-05 9.53798e-05 0.000174672 8.8436e-05 3.12282e-05 10
end_path:out1:RootOutput 1.052e-05 1.45731e-05 1.9841e-05 1.4875e-05 3.12242e-06 10
end_path:out1:RootOutput(write) 3.50488 4.87596 7.94306 4.75386 1.14608 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5203.49 MB
Peak resident set size usage (VmHWM): 4361.06 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.36 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10851340
-rw-r--r-- 1 dune001 dune 2516249292 Jan 18 10:52 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2386821239 Jan 18 10:49 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2221597980 Jan 18 12:55 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1999476328 Jan 18 07:40 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1907520193 Jan 18 07:18 g4_stage1.root
-rw-r--r-- 1 dune001 dune 79471170 Jan 18 12:48 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 242892 Jan 18 12:55 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 18 12:55 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 18 12:55 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 18 12:55 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 18 10:53 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 18 07:40 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 18 12:55 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 18 07:06 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 18 12:55 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 18 11:03 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 18 10:53 debugprod.log
