Jobsub ID 293866.0@dunegpschedd02.fnal.gov
| Jobsub ID | 293866.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12282 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-22 22:09:30 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-23 04:48:53 |
| From worker node | Hostname | gpu05.pic.es |
| cpuinfo | Intel(R) Xeon(R) Gold 6230R CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-22 22:10:43 |
| Input files | monte-carlo-012282-000001
|
| Jobscript | Exit code | 0 |
| Real time | 6h (23825s) |
| CPU time | 6h (23228s = 97%) |
| Max RSS bytes | 4509659136 (4300 MiB) |
| Outputting started | 2026-01-23 04:47:48 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12282/1/001/reco_stage1.root
|
| Finished | 2026-01-23 04:48:53 |
| Saved logs | justin-logs:293866.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
dRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 150627 traces, 0 summary
Retagger: tagging trace set: gauss with 113623 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 113623 traces tagged "gauss"
FrameSaver: q=3.88765e+06 n=2006305 tag=gauss
wclsFrameSaver: saving 150627 traces tagged "wiener"
FrameSaver: q=4.11828e+06 n=1765393 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 50255 XUs and 57257 XVs -> 788 XUVs
C:0 T:1 141844 XUs and 127518 XVs -> 17789 XUVs
C:0 T:2 72297 XUs and 65483 XVs -> 3930 XUVs
C:0 T:3 38938 XUs and 28692 XVs -> 847 XUVs
C:0 T:4 15212 XUs and 14966 XVs -> 179 XUVs
C:0 T:5 170428 XUs and 98613 XVs -> 30898 XUVs
C:0 T:6 43455 XUs and 43293 XVs -> 1968 XUVs
C:0 T:7 18938 XUs and 18102 XVs -> 238 XUVs
C:0 T:8 11017 XUs and 10705 XVs -> 127 XUVs
C:0 T:9 137816 XUs and 125597 XVs -> 19904 XUVs
C:0 T:10 57775 XUs and 38767 XVs -> 5532 XUVs
C:0 T:11 32 XUs and 29 XVs -> 2 XUVs
82202 XUVs total
14204 collection wire objects
77058 potential space points
Neighbour search...
20826714 tests to find 8563334 neighbours
Iterating with no regularization...
Begin: 6.61326e+07
0 5.57201e+07
1 5.49872e+07
2 5.48764e+07
3 5.48437e+07
Now with regularization...
Begin: 4.46902e+07
0 4.46294e+07
1 4.45693e+07
2 4.45193e+07
3 4.44788e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411905241
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411905241
fLifetime: 30000 [us]
23-Jan-2026 05:47:45 CET Closed output file "reco_stage1.root"
23-Jan-2026 05:47:45 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 577.929 1101.39 1701.37 1122.43 318.839 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00185453 0.00597485 0.0108048 0.00579658 0.00289196 10
reco:ophit:OpHitFinder 0.316493 0.52473 0.664134 0.551767 0.112927 10
reco:opflash:OpFlashFinder 0.19925 0.370623 0.466002 0.392469 0.0896443 10
reco:opslicer:OpSlicer 0.714054 1.28807 1.94141 1.17972 0.343121 10
reco:caldata:DataPrepModule 7.42617 10.3992 12.4622 11.4433 1.98051 10
reco:wclsdatasp:WireCellToolkit 70.2249 80.5379 87.2144 81.2323 5.21223 10
reco:gaushit:GausHitFinder 1.99482 3.09787 4.68929 3.21019 0.81584 10
reco:nhitsfilter:NumberOfHitsFilter 0.000819568 0.00135496 0.00209371 0.00130324 0.000374384 10
reco:reco3d:SpacePointSolver 15.0649 45.4635 75.1317 43.4022 20.6772 10
reco:hitpdune:DisambigFromSpacePoints 2.58543 5.52306 9.0879 5.54166 2.10864 10
reco:pandora:StandardPandora 37.6363 122.329 320.709 89.6692 86.263 10
reco:pandoraWriter:StandardPandora 0.662731 0.972953 1.32791 0.951665 0.207884 10
reco:pandoraTrack:LArPandoraTrackCreation 9.98312 23.3791 38.4276 22.3685 9.04929 10
reco:pandoraShower:LArPandoraShowerCreation 8.6161 27.2059 46.234 27.8178 11.93 10
reco:pandoracalo:Calorimetry 4.16733 10.7922 16.4758 10.6298 4.06084 10
reco:pandoracalonosce:Calorimetry 3.94246 10.5631 15.8881 11.2922 4.11455 10
reco:pandorapid:Chi2ParticleID 0.0071838 0.0122511 0.0161792 0.0118778 0.00269901 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0644031 0.118503 0.157815 0.128074 0.0293137 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00850242 0.0125033 0.0168549 0.0119353 0.00277464 10
reco:pandoraShowercalo:ShowerCalorimetry 7.68751 27.1518 49.184 27.2309 12.7088 10
reco:pandoraShowercalonosce:ShowerCalorimetry 6.95792 26.2662 49.2643 26.5307 12.3536 10
reco:emtrkmichelid:EmTrackMichelId 304.831 441.36 651.695 430.094 98.0541 10
reco:crttag:SingleCRTMatchingProducer 0.0310323 0.063488 0.0777109 0.0736675 0.0156401 10
reco:crtreco:TwoCRTMatchingProducer 0.0264113 0.0570224 0.0713508 0.0646447 0.0149007 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.5088 2.46309 3.14384 2.57194 0.486196 10
reco:pandora2Track:LArPandoraTrackCreation 27.8561 96.4406 149.363 95.3488 36.9323 10
reco:pandora2calo:Calorimetry 10.7081 37.3712 73.6182 36.8252 16.8057 10
reco:pandora2calonosce:Calorimetry 10.7866 36.267 67.8257 35.2483 16.7079 10
reco:pandora2pid:Chi2ParticleID 0.016989 0.0298777 0.0428986 0.0306953 0.00904914 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0854523 0.151721 0.232377 0.155852 0.0438898 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0167516 0.0290645 0.0416557 0.0305125 0.00829921 10
reco:pandora2Shower:LArPandoraShowerCreation 9.91054 24.7622 42.8589 23.7392 9.85589 10
reco:pandora2Showercalo:ShowerCalorimetry 10.0204 32.5449 56.0848 30.9709 14.5619 10
reco:pandora2Showercalonosce:ShowerCalorimetry 9.30367 27.9437 49.8021 28.9413 12.3672 10
[art]:TriggerResults:TriggerResultInserter 3.4962e-05 7.33647e-05 0.000202783 5.76215e-05 4.5113e-05 10
end_path:out1:RootOutput 6.203e-06 1.10621e-05 3.5458e-05 8.118e-06 8.27395e-06 10
end_path:out1:RootOutput(write) 4.03926 5.5979 8.35454 5.38536 1.3194 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5328.45 MB
Peak resident set size usage (VmHWM): 4509.66 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.40 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 6.65 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.36 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11112844
-rw-r--r-- 1 dune001 dune 2590325119 Jan 23 02:40 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2460053785 Jan 23 02:36 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 2318725521 Jan 23 05:47 reco_stage1.root
-rw-r--r-- 1 dune001 dune 2004358011 Jan 22 23:49 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1920362657 Jan 22 23:24 g4_stage1.root
-rw-r--r-- 1 dune001 dune 85089200 Jan 23 05:33 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 243012 Jan 23 05:47 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 23 05:47 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 23 05:47 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 23 05:47 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 23 02:40 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 22 23:49 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 23 05:47 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 22 23:10 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 23 05:47 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 23 02:53 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 23 02:40 debugprod.log
