Jobsub ID 268870.0@dunegpschedd02.fnal.gov
| Jobsub ID | 268870.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11730 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-11 13:08:49 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce02 |
| Last heartbeat | 2026-01-11 17:03:20 |
| From worker node | Hostname | ccwcondor0008 |
| cpuinfo | AMD EPYC 9334 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-11 13:09:31 |
| Input files | monte-carlo-011730-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13932s) |
| CPU time | 3h (13609s = 97%) |
| Max RSS bytes | 4472639488 (4265 MiB) |
| Outputting started | 2026-01-11 17:01:45 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11730/1/001/reco_stage1.root
|
| Finished | 2026-01-11 17:03:20 |
| Saved logs | justin-logs:268870.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
re: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 161372 traces, 0 summary
Retagger: tagging trace set: gauss with 119327 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 119327 traces tagged "gauss"
FrameSaver: q=4.16622e+06 n=2072158 tag=gauss
wclsFrameSaver: saving 161372 traces tagged "wiener"
FrameSaver: q=4.43838e+06 n=1805737 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 64478 XUs and 43794 XVs -> 803 XUVs
C:0 T:1 182456 XUs and 104491 XVs -> 12630 XUVs
C:0 T:2 309569 XUs and 133929 XVs -> 23309 XUVs
C:0 T:3 73091 XUs and 45093 XVs -> 829 XUVs
C:0 T:4 17178 XUs and 14026 XVs -> 160 XUVs
C:0 T:5 137310 XUs and 64541 XVs -> 10691 XUVs
C:0 T:6 103512 XUs and 78952 XVs -> 3866 XUVs
C:0 T:7 43569 XUs and 30257 XVs -> 269 XUVs
C:0 T:8 12436 XUs and 9408 XVs -> 184 XUVs
C:0 T:9 91160 XUs and 99872 XVs -> 11540 XUVs
C:0 T:10 18549 XUs and 7695 XVs -> 1576 XUVs
65857 XUVs total
15714 collection wire objects
59418 potential space points
Neighbour search...
10503412 tests to find 4692420 neighbours
Iterating with no regularization...
Begin: 8.57563e+07
0 6.71171e+07
1 6.59824e+07
2 6.58064e+07
3 6.575e+07
Now with regularization...
Begin: 5.38372e+07
0 5.37693e+07
1 5.37145e+07
2 5.36708e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411676359
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411676359
fLifetime: 30000 [us]
11-Jan-2026 18:01:43 CET Closed output file "reco_stage1.root"
11-Jan-2026 18:01:43 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 326.382 445.077 571.849 441.875 67.045 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00150476 0.00408058 0.00648404 0.00441622 0.00153144 10
reco:ophit:OpHitFinder 0.307804 0.349415 0.404152 0.348562 0.0263096 10
reco:opflash:OpFlashFinder 0.215472 0.25409 0.33149 0.241673 0.0361026 10
reco:opslicer:OpSlicer 0.615422 0.793817 0.920132 0.793336 0.0961633 10
reco:caldata:DataPrepModule 4.37124 5.30073 6.04733 5.39915 0.491292 10
reco:wclsdatasp:WireCellToolkit 29.567 32.7032 35.6703 33.0288 1.76378 10
reco:gaushit:GausHitFinder 0.831769 1.45607 1.83191 1.51487 0.253349 10
reco:nhitsfilter:NumberOfHitsFilter 0.000307775 0.00060623 0.000886057 0.000597912 0.000137438 10
reco:reco3d:SpacePointSolver 10.8791 26.0396 57.3969 21.9951 12.7909 10
reco:hitpdune:DisambigFromSpacePoints 1.42243 2.30011 3.58716 2.13878 0.634928 10
reco:pandora:StandardPandora 22.9477 45.5925 102.386 41.5784 20.7206 10
reco:pandoraWriter:StandardPandora 0.46481 0.555366 0.632071 0.560511 0.052913 10
reco:pandoraTrack:LArPandoraTrackCreation 4.2049 6.04079 8.05108 5.61317 1.19005 10
reco:pandoraShower:LArPandoraShowerCreation 3.45126 6.78511 11.2069 6.46237 2.22229 10
reco:pandoracalo:Calorimetry 2.29973 3.46891 4.39686 3.59225 0.710808 10
reco:pandoracalonosce:Calorimetry 2.14792 3.12824 4.54135 3.02301 0.631514 10
reco:pandorapid:Chi2ParticleID 0.00438461 0.00612957 0.00883341 0.00636301 0.00122345 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0424231 0.0647166 0.0796568 0.070781 0.0130402 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00435546 0.00583278 0.0068578 0.00622534 0.000851142 10
reco:pandoraShowercalo:ShowerCalorimetry 3.99722 6.77081 9.17788 6.57054 1.67423 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.75815 6.26146 8.07201 6.62636 1.32294 10
reco:emtrkmichelid:EmTrackMichelId 187.981 234.286 272.489 232.336 22.5934 10
reco:crttag:SingleCRTMatchingProducer 0.0112123 0.0168361 0.0234631 0.0161935 0.00358754 10
reco:crtreco:TwoCRTMatchingProducer 0.00713456 0.0108157 0.016782 0.0100122 0.00261584 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.729167 1.08647 1.36402 1.16789 0.215662 10
reco:pandora2Track:LArPandoraTrackCreation 11.9948 19.4997 27.0099 18.8389 4.25331 10
reco:pandora2calo:Calorimetry 5.42118 8.99639 11.0275 9.3016 1.78885 10
reco:pandora2calonosce:Calorimetry 5.65235 8.98809 12.1325 9.42552 1.80704 10
reco:pandora2pid:Chi2ParticleID 0.00875041 0.0145142 0.0228349 0.013986 0.00413069 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0526091 0.0784795 0.108016 0.0806626 0.018341 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00883629 0.0147311 0.0224787 0.0148432 0.00391327 10
reco:pandora2Shower:LArPandoraShowerCreation 4.13947 6.14956 8.28953 6.11186 1.41985 10
reco:pandora2Showercalo:ShowerCalorimetry 5.07111 7.78923 9.93904 7.98902 1.69527 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.44971 6.85562 9.64042 7.25128 1.53217 10
[art]:TriggerResults:TriggerResultInserter 4.0121e-05 7.45336e-05 0.000198289 6.3606e-05 4.28e-05 10
end_path:out1:RootOutput 7.512e-06 1.14554e-05 1.9559e-05 1.1638e-05 3.23082e-06 10
end_path:out1:RootOutput(write) 2.24273 3.21674 3.96978 3.23687 0.543648 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5278.57 MB
Peak resident set size usage (VmHWM): 4472.64 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.27 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11724688
-rw-r--r-- 1 dune001 lbno 2683234649 Jan 11 16:45 detsim_stage2.root
-rw-r--r-- 1 dune001 lbno 2535760560 Jan 11 16:43 detsim_stage1.root
-rw-r--r-- 1 dune001 lbno 2442718582 Jan 11 18:01 reco_stage1.root
-rw-r--r-- 1 dune001 lbno 2171715391 Jan 11 14:32 g4_stage2.root
-rw-r--r-- 1 dune001 lbno 2079738690 Jan 11 14:17 g4_stage1.root
-rw-r--r-- 1 dune001 lbno 92296950 Jan 11 17:56 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno 243196 Jan 11 18:01 jobscript.log
-rw-r--r-- 1 dune001 lbno 217088 Jan 11 18:01 mem.db
-rw-r--r-- 1 dune001 lbno 62376 Jan 11 18:01 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno 36864 Jan 11 18:01 time.db
-rw-r--r-- 1 dune001 lbno 519 Jan 11 16:45 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 11 14:32 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 11 18:01 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 lbno 52 Jan 11 14:09 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno 7 Jan 11 18:01 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno 0 Jan 11 16:51 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno 0 Jan 11 16:45 debugprod.log