Jobsub ID 249055.0@dunegpschedd02.fnal.gov
| Jobsub ID | 249055.0@dunegpschedd02.fnal.gov |
| Workflow ID | 10438 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-21 00:17:44 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc01 |
| Last heartbeat | 2025-11-21 03:05:12 |
| From worker node | Hostname | wn-da-14.gina.surf.nl |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-21 00:18:43 |
| Input files | monte-carlo-010438-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (9915s) |
| CPU time | 2h (9786s = 98%) |
| Max RSS bytes | 3935916032 (3753 MiB) |
| Outputting started | 2025-11-21 03:03:59 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10438/1/001/reco_stage1.root
|
| Finished | 2025-11-21 03:05:12 |
| Saved logs | justin-logs:249055.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
lFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 137076 traces, 0 summary
Retagger: tagging trace set: gauss with 102704 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 102704 traces tagged "gauss"
FrameSaver: q=3.63001e+06 n=1812205 tag=gauss
wclsFrameSaver: saving 137076 traces tagged "wiener"
FrameSaver: q=3.86323e+06 n=1606714 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 43285 XUs and 38082 XVs -> 373 XUVs
C:0 T:1 89777 XUs and 77057 XVs -> 5424 XUVs
C:0 T:2 152194 XUs and 140675 XVs -> 29596 XUVs
C:0 T:3 54557 XUs and 46403 XVs -> 1561 XUVs
C:0 T:4 13332 XUs and 9330 XVs -> 103 XUVs
C:0 T:5 46527 XUs and 23648 XVs -> 3432 XUVs
C:0 T:6 58464 XUs and 82595 XVs -> 4458 XUVs
C:0 T:7 24349 XUs and 31845 XVs -> 230 XUVs
C:0 T:8 10206 XUs and 10264 XVs -> 154 XUVs
C:0 T:9 61429 XUs and 71398 XVs -> 4241 XUVs
C:0 T:10 30169 XUs and 32379 XVs -> 5842 XUVs
C:0 T:11 114 XUs and 165 XVs -> 33 XUVs
55447 XUVs total
11438 collection wire objects
49321 potential space points
Neighbour search...
8186227 tests to find 3710428 neighbours
Iterating with no regularization...
Begin: 6.88338e+07
0 5.94159e+07
1 5.86542e+07
2 5.85406e+07
3 5.85074e+07
Now with regularization...
Begin: 4.81771e+07
0 4.81255e+07
1 4.80882e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410639709
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410639709
fLifetime: 30000 [us]
21-Nov-2025 04:03:57 CET Closed output file "reco_stage1.root"
21-Nov-2025 04:03:57 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 216.875 291.391 366.165 278.661 44.1432 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000752402 0.00376161 0.00605059 0.00400467 0.00179414 10
reco:ophit:OpHitFinder 0.192707 0.223616 0.258133 0.219815 0.0186688 10
reco:opflash:OpFlashFinder 0.0920741 0.127983 0.167461 0.123996 0.0210554 10
reco:opslicer:OpSlicer 0.435921 0.532889 0.635932 0.532342 0.0553063 10
reco:caldata:DataPrepModule 4.3072 4.4315 4.71497 4.39746 0.117653 10
reco:wclsdatasp:WireCellToolkit 32.8247 55.4862 68.2544 60.7451 12.6752 10
reco:gaushit:GausHitFinder 0.737535 0.905455 1.13384 0.913488 0.109929 10
reco:nhitsfilter:NumberOfHitsFilter 0.000425119 0.000590479 0.000742232 0.000570925 9.04923e-05 10
reco:reco3d:SpacePointSolver 4.7766 7.97998 15.4663 6.59775 3.38653 10
reco:hitpdune:DisambigFromSpacePoints 0.671252 0.954627 1.40504 0.926398 0.214933 10
reco:pandora:StandardPandora 11.2111 20.1637 31.3614 18.3348 6.16734 10
reco:pandoraWriter:StandardPandora 0.253182 0.312739 0.375578 0.310985 0.037771 10
reco:pandoraTrack:LArPandoraTrackCreation 1.67703 2.85009 4.06126 2.92969 0.664361 10
reco:pandoraShower:LArPandoraShowerCreation 1.85287 2.88755 4.32329 2.85736 0.803159 10
reco:pandoracalo:Calorimetry 0.957256 1.56632 2.2526 1.62407 0.369197 10
reco:pandoracalonosce:Calorimetry 0.851932 1.43336 2.03367 1.49314 0.343017 10
reco:pandorapid:Chi2ParticleID 0.00369143 0.00484885 0.00678263 0.00481257 0.000784925 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0297077 0.0376892 0.0443956 0.0369978 0.00468619 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00351586 0.0044623 0.00518593 0.00442366 0.000500428 10
reco:pandoraShowercalo:ShowerCalorimetry 1.79834 2.91683 4.4812 2.54941 0.966632 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.71353 2.79136 4.46578 2.40162 0.967627 10
reco:emtrkmichelid:EmTrackMichelId 128.437 156.508 192.193 153.737 18.2795 10
reco:crttag:SingleCRTMatchingProducer 0.00710848 0.0101902 0.01515 0.00914136 0.00286302 10
reco:crtreco:TwoCRTMatchingProducer 0.0048674 0.00676232 0.0089018 0.00660339 0.00115428 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.512564 0.655528 0.892505 0.617812 0.106739 10
reco:pandora2Track:LArPandoraTrackCreation 5.4285 8.41646 11.6944 8.18255 2.01668 10
reco:pandora2calo:Calorimetry 2.54684 4.08269 5.92423 3.65394 1.17155 10
reco:pandora2calonosce:Calorimetry 2.3818 3.83042 5.64496 3.41606 1.1338 10
reco:pandora2pid:Chi2ParticleID 0.00954311 0.0111672 0.0124031 0.0115804 0.000998175 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0379041 0.0485126 0.0561731 0.0507915 0.00613318 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00953198 0.011024 0.0123031 0.0113858 0.000971411 10
reco:pandora2Shower:LArPandoraShowerCreation 2.06005 3.15685 4.45071 3.10883 0.73591 10
reco:pandora2Showercalo:ShowerCalorimetry 2.19003 3.52085 5.25877 3.06507 1.06183 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.02338 3.20721 4.90343 2.77263 0.984976 10
[art]:TriggerResults:TriggerResultInserter 2.7662e-05 3.78209e-05 9.3328e-05 2.99765e-05 1.94064e-05 10
end_path:out1:RootOutput 5.781e-06 6.6938e-06 1.028e-05 6.317e-06 1.24328e-06 10
end_path:out1:RootOutput(write) 1.7506 2.19969 2.76421 2.15034 0.295831 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4736.4 MB
Peak resident set size usage (VmHWM): 3935.92 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.71 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9103688
-rw-r--r--. 1 dune009 dune 2178213068 Nov 21 03:13 detsim_stage2.root
-rw-r--r--. 1 dune009 dune 2070952176 Nov 21 03:12 detsim_stage1.root
-rw-r--r--. 1 dune009 dune 1818430855 Nov 21 04:03 reco_stage1.root
-rw-r--r--. 1 dune009 dune 1630299357 Nov 21 01:34 g4_stage2.root
-rw-r--r--. 1 dune009 dune 1560145752 Nov 21 01:24 g4_stage1.root
-rw-r--r--. 1 dune009 dune 63521830 Nov 21 03:59 Pandora_Events.pndr
-rw-r--r--. 1 dune009 dune 242638 Nov 21 04:03 jobscript.log
-rw-r--r--. 1 dune009 dune 217088 Nov 21 04:03 mem.db
-rw-r--r--. 1 dune009 dune 62376 Nov 21 04:03 Pandora_Geometry.xml
-rw-r--r--. 1 dune009 dune 36864 Nov 21 04:03 time.db
-rw-r--r--. 1 dune009 dune 519 Nov 21 03:13 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Nov 21 01:34 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Nov 21 04:03 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune009 dune 52 Nov 21 01:18 all-input-dids.txt
-rw-r--r--. 1 dune009 dune 7 Nov 21 04:03 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune 0 Nov 21 03:18 ProtoDUNE.log
-rw-r--r--. 1 dune009 dune 0 Nov 21 03:13 debugprod.log