Jobsub ID 239645.1@dunegpschedd01.fnal.gov
| Jobsub ID | 239645.1@dunegpschedd01.fnal.gov |
| Workflow ID | 9427 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-28 23:31:44 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc03 |
| Last heartbeat | 2025-10-29 03:04:06 |
| From worker node | Hostname | wn-lb-04.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-28 23:32:49 |
| Input files | monte-carlo-009427-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12569s) |
| CPU time | 3h (12407s = 98%) |
| Max RSS bytes | 4270522368 (4072 MiB) |
| Outputting started | 2025-10-29 03:02:18 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09427/1/001/reco_stage1.root
|
| Finished | 2025-10-29 03:04:06 |
| Saved logs | justin-logs:239645.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
l adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 149444 traces, 0 summary
Retagger: tagging trace set: gauss with 119361 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 119361 traces tagged "gauss"
FrameSaver: q=4.2354e+06 n=2218144 tag=gauss
wclsFrameSaver: saving 149444 traces tagged "wiener"
FrameSaver: q=4.44787e+06 n=1997878 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 41052 XUs and 35123 XVs -> 412 XUVs
C:0 T:1 74283 XUs and 82896 XVs -> 9446 XUVs
C:0 T:2 128469 XUs and 196982 XVs -> 6137 XUVs
C:0 T:3 57991 XUs and 79672 XVs -> 707 XUVs
C:0 T:4 14501 XUs and 11667 XVs -> 174 XUVs
C:0 T:5 52393 XUs and 35043 XVs -> 6181 XUVs
C:0 T:6 53989 XUs and 59825 XVs -> 1910 XUVs
C:0 T:7 23057 XUs and 24253 XVs -> 159 XUVs
C:0 T:8 9882 XUs and 9047 XVs -> 235 XUVs
C:0 T:9 86199 XUs and 94068 XVs -> 9086 XUVs
C:0 T:10 78373 XUs and 49374 XVs -> 9313 XUVs
C:0 T:11 163 XUs and 108 XVs -> 16 XUVs
43776 XUVs total
12938 collection wire objects
39930 potential space points
Neighbour search...
3775012 tests to find 1865358 neighbours
Iterating with no regularization...
Begin: 8.50825e+07
0 7.20527e+07
1 7.11174e+07
2 7.0984e+07
3 7.09472e+07
Now with regularization...
Begin: 6.04559e+07
0 6.04239e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410176357
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410176357
fLifetime: 30000 [us]
29-Oct-2025 04:02:16 CET Closed output file "reco_stage1.root"
29-Oct-2025 04:02:16 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 221.211 371.01 647.229 345.285 109.164 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000911155 0.00571531 0.010915 0.00583899 0.00314988 10
reco:ophit:OpHitFinder 0.291018 0.352942 0.464512 0.334833 0.0514347 10
reco:opflash:OpFlashFinder 0.176665 0.234353 0.327935 0.22702 0.0430083 10
reco:opslicer:OpSlicer 0.590066 0.708281 1.04997 0.639003 0.136875 10
reco:caldata:DataPrepModule 4.83784 5.40837 6.58629 5.08018 0.647847 10
reco:wclsdatasp:WireCellToolkit 33.5903 49.5811 64.5279 49.5679 9.09859 10
reco:gaushit:GausHitFinder 0.840944 1.15792 1.84784 1.09244 0.278301 10
reco:nhitsfilter:NumberOfHitsFilter 0.000353119 0.000595315 0.000761981 0.000580889 0.000122471 10
reco:reco3d:SpacePointSolver 7.11351 15.1078 30.7318 13.2333 6.56643 10
reco:hitpdune:DisambigFromSpacePoints 0.843054 1.50796 2.6761 1.37419 0.593448 10
reco:pandora:StandardPandora 14.246 34.6175 74.7088 27.8984 17.1399 10
reco:pandoraWriter:StandardPandora 0.325324 0.422064 0.578483 0.424937 0.0725262 10
reco:pandoraTrack:LArPandoraTrackCreation 2.27506 5.35689 8.94486 5.23445 1.82389 10
reco:pandoraShower:LArPandoraShowerCreation 2.46959 6.53468 14.7612 6.22804 3.24151 10
reco:pandoracalo:Calorimetry 1.19756 2.87916 4.57156 2.89077 0.929448 10
reco:pandoracalonosce:Calorimetry 1.10194 2.71474 4.39725 2.74638 0.905882 10
reco:pandorapid:Chi2ParticleID 0.00450971 0.00521276 0.00588276 0.005171 0.000347715 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0343632 0.0457329 0.0641792 0.0434031 0.00850317 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00352414 0.00490881 0.00580022 0.00501715 0.000595236 10
reco:pandoraShowercalo:ShowerCalorimetry 2.20011 6.44235 14.8725 6.41199 3.29801 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.0485 6.34691 16.484 6.07578 3.76174 10
reco:emtrkmichelid:EmTrackMichelId 122.597 174.347 278.524 164.068 42.2583 10
reco:crttag:SingleCRTMatchingProducer 0.0117886 0.0177458 0.0356399 0.0161386 0.00646094 10
reco:crtreco:TwoCRTMatchingProducer 0.0080726 0.011944 0.0222551 0.0114441 0.00381273 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.601082 0.856145 1.05375 0.847322 0.132847 10
reco:pandora2Track:LArPandoraTrackCreation 7.11259 17.52 41.5779 16.7621 9.05492 10
reco:pandora2calo:Calorimetry 3.17501 8.58503 20.7667 8.14766 4.58424 10
reco:pandora2calonosce:Calorimetry 2.93103 8.11562 19.7339 7.58265 4.36859 10
reco:pandora2pid:Chi2ParticleID 0.00791479 0.0121365 0.019773 0.0117621 0.00298597 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.040959 0.059227 0.0988071 0.0563891 0.0150673 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00785722 0.0120912 0.0198342 0.0116068 0.00300452 10
reco:pandora2Shower:LArPandoraShowerCreation 2.52206 5.73084 13.9099 5.30878 2.96368 10
reco:pandora2Showercalo:ShowerCalorimetry 2.56049 7.00248 16.9002 6.74876 3.71158 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.28052 6.14758 14.9154 5.60234 3.30755 10
[art]:TriggerResults:TriggerResultInserter 3.1467e-05 5.28359e-05 0.000124867 4.61435e-05 2.56898e-05 10
end_path:out1:RootOutput 7.401e-06 8.4578e-06 1.2659e-05 7.857e-06 1.47667e-06 10
end_path:out1:RootOutput(write) 2.09164 2.94025 4.72307 2.86678 0.71086 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5072.48 MB
Peak resident set size usage (VmHWM): 4270.52 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10481260
-rw-r--r--. 1 dune009 dune 2446162815 Oct 29 02:58 detsim_stage2.root
-rw-r--r--. 1 dune009 dune 2321393032 Oct 29 02:56 detsim_stage1.root
-rw-r--r--. 1 dune009 dune 2137240465 Oct 29 04:02 reco_stage1.root
-rw-r--r--. 1 dune009 dune 1914462607 Oct 29 00:50 g4_stage2.root
-rw-r--r--. 1 dune009 dune 1836679274 Oct 29 00:38 g4_stage1.root
-rw-r--r--. 1 dune009 dune 76188110 Oct 29 03:57 Pandora_Events.pndr
-rw-r--r--. 1 dune009 dune 242834 Oct 29 04:02 jobscript.log
-rw-r--r--. 1 dune009 dune 217088 Oct 29 04:02 mem.db
-rw-r--r--. 1 dune009 dune 62376 Oct 29 04:02 Pandora_Geometry.xml
-rw-r--r--. 1 dune009 dune 36864 Oct 29 04:02 time.db
-rw-r--r--. 1 dune009 dune 519 Oct 29 02:58 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Oct 29 00:50 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Oct 29 04:02 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune009 dune 52 Oct 29 00:32 all-input-dids.txt
-rw-r--r--. 1 dune009 dune 7 Oct 29 04:02 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune 0 Oct 29 03:02 ProtoDUNE.log
-rw-r--r--. 1 dune009 dune 0 Oct 29 02:58 debugprod.log