Jobsub ID 281935.1@dunegpschedd01.fnal.gov
| Jobsub ID | 281935.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12090 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-19 08:26:46 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce2 |
| Last heartbeat | 2026-01-19 11:32:51 |
| From worker node | Hostname | milan22.farm.particle.cz |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-19 08:27:20 |
| Input files | monte-carlo-012090-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11089s) |
| CPU time | 2h (10747s = 96%) |
| Max RSS bytes | 4052541440 (3864 MiB) |
| Outputting started | 2026-01-19 11:32:11 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12090/1/001/reco_stage1.root
|
| Finished | 2026-01-19 11:32:51 |
| Saved logs | justin-logs:281935.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
oolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 144905 traces, 0 summary
Retagger: tagging trace set: gauss with 112402 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 112402 traces tagged "gauss"
FrameSaver: q=3.95257e+06 n=2017341 tag=gauss
wclsFrameSaver: saving 144905 traces tagged "wiener"
FrameSaver: q=4.16417e+06 n=1799664 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 19053 XUs and 32694 XVs -> 224 XUVs
C:0 T:1 43145 XUs and 60686 XVs -> 3552 XUVs
C:0 T:2 85321 XUs and 69354 XVs -> 4583 XUVs
C:0 T:3 35045 XUs and 28064 XVs -> 205 XUVs
C:0 T:4 10389 XUs and 19201 XVs -> 118 XUVs
C:0 T:5 55326 XUs and 79483 XVs -> 5536 XUVs
C:0 T:6 187132 XUs and 139222 XVs -> 5949 XUVs
C:0 T:7 71694 XUs and 53884 XVs -> 526 XUVs
C:0 T:8 7309 XUs and 7667 XVs -> 151 XUVs
C:0 T:9 45988 XUs and 62302 XVs -> 5888 XUVs
C:0 T:10 65230 XUs and 39967 XVs -> 13809 XUVs
C:0 T:11 54 XUs and 39 XVs -> 3 XUVs
40544 XUVs total
13240 collection wire objects
37220 potential space points
Neighbour search...
3644990 tests to find 1750530 neighbours
Iterating with no regularization...
Begin: 1.05066e+08
0 8.44627e+07
1 8.32769e+07
2 8.31092e+07
3 8.30601e+07
Now with regularization...
Begin: 7.11812e+07
0 7.11101e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411833372
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411833372
fLifetime: 30000 [us]
19-Jan-2026 12:32:09 CET Closed output file "reco_stage1.root"
19-Jan-2026 12:32:09 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 258.683 347.344 422.76 369.981 53.7138 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00108264 0.00324883 0.00502053 0.0034059 0.00116839 10
reco:ophit:OpHitFinder 0.280211 0.326432 0.366634 0.331505 0.02814 10
reco:opflash:OpFlashFinder 0.122235 0.166653 0.234916 0.164694 0.0295385 10
reco:opslicer:OpSlicer 0.563464 0.738942 0.918729 0.729509 0.0930581 10
reco:caldata:DataPrepModule 5.57751 6.19239 6.72783 6.28689 0.405989 10
reco:wclsdatasp:WireCellToolkit 33.7336 36.2887 38.8414 36.1753 1.48664 10
reco:gaushit:GausHitFinder 0.744585 1.25003 1.57751 1.30574 0.243977 10
reco:nhitsfilter:NumberOfHitsFilter 0.00027113 0.000534653 0.000818262 0.000548976 0.000135269 10
reco:reco3d:SpacePointSolver 9.6978 15.3818 20.748 14.5718 3.57321 10
reco:hitpdune:DisambigFromSpacePoints 1.11896 1.60423 2.17411 1.57915 0.358985 10
reco:pandora:StandardPandora 16.685 30.3702 44.759 30.8953 9.03885 10
reco:pandoraWriter:StandardPandora 0.235036 0.444259 0.599783 0.47139 0.107343 10
reco:pandoraTrack:LArPandoraTrackCreation 1.64092 3.20904 5.16738 3.26623 1.01325 10
reco:pandoraShower:LArPandoraShowerCreation 1.83109 3.21568 4.09501 3.46205 0.814714 10
reco:pandoracalo:Calorimetry 0.939383 1.96196 2.82701 2.1084 0.584551 10
reco:pandoracalonosce:Calorimetry 0.800742 1.73782 2.91555 1.85181 0.621112 10
reco:pandorapid:Chi2ParticleID 0.00314199 0.00569957 0.00821255 0.00609343 0.00164205 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0274658 0.0534933 0.0709034 0.0556065 0.0143196 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00301635 0.00522239 0.00754536 0.00552125 0.00144001 10
reco:pandoraShowercalo:ShowerCalorimetry 1.76308 3.41796 4.73587 3.7318 1.06703 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.76795 3.38586 4.61125 3.66649 0.972448 10
reco:emtrkmichelid:EmTrackMichelId 156.909 199.973 247.671 207.81 27.9707 10
reco:crttag:SingleCRTMatchingProducer 0.00837345 0.0133859 0.0181655 0.0129185 0.0029144 10
reco:crtreco:TwoCRTMatchingProducer 0.00607188 0.00801178 0.00925317 0.00849488 0.00114652 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.68273 0.930737 1.11459 0.953137 0.127606 10
reco:pandora2Track:LArPandoraTrackCreation 5.56199 10.1494 13.6629 10.7076 2.74767 10
reco:pandora2calo:Calorimetry 2.50808 5.17331 7.16089 5.64801 1.52437 10
reco:pandora2calonosce:Calorimetry 2.6958 5.03553 7.27897 5.27351 1.45206 10
reco:pandora2pid:Chi2ParticleID 0.00896217 0.014832 0.0189121 0.0162 0.0030839 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.049183 0.076138 0.098341 0.0756252 0.0142113 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0104045 0.014496 0.0188472 0.0144596 0.00244727 10
reco:pandora2Shower:LArPandoraShowerCreation 2.21188 3.91731 5.41163 4.18968 1.04206 10
reco:pandora2Showercalo:ShowerCalorimetry 2.51182 4.70582 6.59977 5.11501 1.31063 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.10639 4.50714 6.43777 4.87998 1.33058 10
[art]:TriggerResults:TriggerResultInserter 3.485e-05 6.30043e-05 0.000188121 5.13105e-05 4.24645e-05 10
end_path:out1:RootOutput 8.79e-06 1.39981e-05 2.235e-05 1.335e-05 3.28283e-06 10
end_path:out1:RootOutput(write) 1.88452 2.98151 3.67098 3.10131 0.542856 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4892.98 MB
Peak resident set size usage (VmHWM): 4052.54 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.86 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9704320
-rw-r--r-- 1 fermilab users 2307314691 Jan 19 11:32 detsim_stage2.root
-rw-r--r-- 1 fermilab users 2193555832 Jan 19 11:30 detsim_stage1.root
-rw-r--r-- 1 fermilab users 1972553753 Jan 19 12:32 reco_stage1.root
-rw-r--r-- 1 fermilab users 1736659450 Jan 19 09:45 g4_stage2.root
-rw-r--r-- 1 fermilab users 1656753537 Jan 19 09:34 g4_stage1.root
-rw-r--r-- 1 fermilab users 69747720 Jan 19 12:26 Pandora_Events.pndr
-rw-r--r-- 1 fermilab users 242858 Jan 19 12:32 jobscript.log
-rw-r--r-- 1 fermilab users 217088 Jan 19 12:32 mem.db
-rw-r--r-- 1 fermilab users 62376 Jan 19 12:32 Pandora_Geometry.xml
-rw-r--r-- 1 fermilab users 36864 Jan 19 12:32 time.db
-rw-r--r-- 1 fermilab users 519 Jan 19 11:32 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 19 09:45 g4_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 19 12:32 protoDUNE_reco1_hist.root
-rw-r--r-- 1 fermilab users 52 Jan 19 09:27 all-input-dids.txt
-rw-r--r-- 1 fermilab users 7 Jan 19 12:32 justin-processed-pfns.txt
-rw-r--r-- 1 fermilab users 0 Jan 19 11:38 ProtoDUNE.log
-rw-r--r-- 1 fermilab users 0 Jan 19 11:32 debugprod.log
