Jobsub ID 296537.0@dunegpschedd02.fnal.gov
| Jobsub ID | 296537.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12533 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-29 16:40:10 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-01-29 19:43:24 |
| From worker node | Hostname | hnode77.pic.es |
| cpuinfo | AMD EPYC 7443P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-29 16:41:38 |
| Input files | monte-carlo-012533-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (10843s) |
| CPU time | 2h (9467s = 87%) |
| Max RSS bytes | 4043632640 (3856 MiB) |
| Outputting started | 2026-01-29 19:42:22 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12533/1/001/reco_stage1.root
|
| Finished | 2026-01-29 19:43:24 |
| Saved logs | justin-logs:296537.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 107201 traces, 0 summary
Retagger: tagging trace set: gauss with 80087 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 80087 traces tagged "gauss"
FrameSaver: q=2.78252e+06 n=1398300 tag=gauss
wclsFrameSaver: saving 107201 traces tagged "wiener"
FrameSaver: q=2.95232e+06 n=1232080 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 25495 XUs and 31624 XVs -> 317 XUVs
C:0 T:1 45140 XUs and 66761 XVs -> 7116 XUVs
C:0 T:2 100479 XUs and 94290 XVs -> 6508 XUVs
C:0 T:3 46987 XUs and 41763 XVs -> 270 XUVs
C:0 T:4 7120 XUs and 9951 XVs -> 156 XUVs
C:0 T:5 25394 XUs and 41035 XVs -> 4557 XUVs
C:0 T:6 71181 XUs and 54441 XVs -> 5209 XUVs
C:0 T:7 25573 XUs and 19492 XVs -> 153 XUVs
C:0 T:8 7650 XUs and 8282 XVs -> 75 XUVs
C:0 T:9 42570 XUs and 63188 XVs -> 3097 XUVs
C:0 T:10 37761 XUs and 22538 XVs -> 5764 XUVs
C:0 T:11 225 XUs and 185 XVs -> 31 XUVs
33253 XUVs total
9158 collection wire objects
30928 potential space points
Neighbour search...
3398602 tests to find 1815052 neighbours
Iterating with no regularization...
Begin: 6.68531e+07
0 5.53852e+07
1 5.46745e+07
2 5.458e+07
3 5.45519e+07
Now with regularization...
Begin: 4.63447e+07
0 4.62951e+07
1 4.62653e+07
Failure in algorithm Alg0061, LArCosmicRayTrackRecovery, STATUS_CODE_FAILURE
Failure in algorithm Alg0061, LArCosmicRayTrackRecovery, STATUS_CODE_FAILURE
run: 1 ; subrun: 0 ; event: 10
evttime: 412041453
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412041453
fLifetime: 30000 [us]
29-Jan-2026 20:42:20 CET Closed output file "reco_stage1.root"
29-Jan-2026 20:42:20 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 179.106 286.066 354.678 271.543 56.0942 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00109947 0.00336154 0.00502011 0.00355658 0.00143837 10
reco:ophit:OpHitFinder 0.205143 0.249452 0.300684 0.237475 0.0334673 10
reco:opflash:OpFlashFinder 0.115415 0.139103 0.159998 0.136861 0.0151944 10
reco:opslicer:OpSlicer 0.391053 0.591903 0.898714 0.548707 0.14591 10
reco:caldata:DataPrepModule 3.82839 4.80417 6.57298 4.6169 0.804217 10
reco:wclsdatasp:WireCellToolkit 26.8906 30.7178 36.3296 30.1113 2.66967 10
reco:gaushit:GausHitFinder 0.602076 0.904072 1.17771 0.890851 0.15291 10
reco:nhitsfilter:NumberOfHitsFilter 0.000254752 0.000449682 0.000809408 0.000412739 0.000142006 10
reco:reco3d:SpacePointSolver 5.70245 11.5868 14.621 12.6583 2.84261 10
reco:hitpdune:DisambigFromSpacePoints 0.516081 1.33946 2.815 1.29659 0.60088 10
reco:pandora:StandardPandora 8.86141 24.7712 43.2042 23.7038 10.4502 10
reco:pandoraWriter:StandardPandora 0.194424 0.340182 0.459956 0.360719 0.0747544 10
reco:pandoraTrack:LArPandoraTrackCreation 1.33345 3.64561 7.97435 3.74408 1.72741 10
reco:pandoraShower:LArPandoraShowerCreation 0.98137 3.20976 5.79695 3.17765 1.43445 10
reco:pandoracalo:Calorimetry 1.01575 1.82073 2.70767 1.84948 0.555246 10
reco:pandoracalonosce:Calorimetry 0.645139 1.56359 2.14748 1.70434 0.506482 10
reco:pandorapid:Chi2ParticleID 0.00247846 0.00431339 0.00594675 0.00392087 0.00104524 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0228975 0.0405169 0.0639313 0.0377985 0.0130994 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00258825 0.0041472 0.00613327 0.00378613 0.00105193 10
reco:pandoraShowercalo:ShowerCalorimetry 0.9556 3.57548 6.52689 3.40226 1.44079 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.925469 3.60424 8.10576 3.21067 1.86743 10
reco:emtrkmichelid:EmTrackMichelId 109.193 158.871 206.217 149.705 28.9788 10
reco:crttag:SingleCRTMatchingProducer 0.00483949 0.0138932 0.0514412 0.0100596 0.0129025 10
reco:crtreco:TwoCRTMatchingProducer 0.00376494 0.00842578 0.0138702 0.00857646 0.00286578 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.52509 0.800593 1.15124 0.750916 0.209591 10
reco:pandora2Track:LArPandoraTrackCreation 3.72717 9.29345 14.5723 8.72043 3.29911 10
reco:pandora2calo:Calorimetry 1.78377 5.03333 9.04737 4.70159 2.03369 10
reco:pandora2calonosce:Calorimetry 1.70473 4.847 7.98633 4.53509 1.92392 10
reco:pandora2pid:Chi2ParticleID 0.0052587 0.0119731 0.0195208 0.0107709 0.00490097 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0284877 0.0571732 0.0947177 0.0511661 0.0219211 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00571879 0.0110136 0.0181419 0.00925281 0.00405276 10
reco:pandora2Shower:LArPandoraShowerCreation 1.26807 3.39695 5.82721 3.08948 1.28485 10
reco:pandora2Showercalo:ShowerCalorimetry 1.5263 4.1654 6.67409 4.21223 1.41519 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.41731 4.10172 6.67455 3.79824 1.53292 10
[art]:TriggerResults:TriggerResultInserter 2.926e-05 4.23865e-05 8.6522e-05 4.00555e-05 1.57702e-05 10
end_path:out1:RootOutput 4.87e-06 4.23903e-05 0.000366973 6.47e-06 0.0001082 10
end_path:out1:RootOutput(write) 1.43027 2.42706 3.26497 2.38886 0.55633 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4870.74 MB
Peak resident set size usage (VmHWM): 4043.63 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9263812
-rw-r--r-- 1 dune001 dune 2210808604 Jan 29 19:52 detsim_stage2.root
-rw-r--r-- 1 dune001 dune 2097151401 Jan 29 19:51 detsim_stage1.root
-rw-r--r-- 1 dune001 dune 1871406826 Jan 29 20:42 reco_stage1.root
-rw-r--r-- 1 dune001 dune 1655773917 Jan 29 18:09 g4_stage2.root
-rw-r--r-- 1 dune001 dune 1581451804 Jan 29 17:53 g4_stage1.root
-rw-r--r-- 1 dune001 dune 68921950 Jan 29 20:39 Pandora_Events.pndr
-rw-r--r-- 1 dune001 dune 243040 Jan 29 20:42 jobscript.log
-rw-r--r-- 1 dune001 dune 217088 Jan 29 20:42 mem.db
-rw-r--r-- 1 dune001 dune 62376 Jan 29 20:42 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 dune 36864 Jan 29 20:42 time.db
-rw-r--r-- 1 dune001 dune 519 Jan 29 19:52 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 29 18:09 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 dune 519 Jan 29 20:42 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 dune 52 Jan 29 17:41 all-input-dids.txt
-rw-r--r-- 1 dune001 dune 7 Jan 29 20:42 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 dune 0 Jan 29 19:58 ProtoDUNE.log
-rw-r--r-- 1 dune001 dune 0 Jan 29 19:52 debugprod.log
