Jobsub ID 281535.0@dunegpschedd01.fnal.gov
| Jobsub ID | 281535.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12084 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-18 21:40:11 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce1 |
| Last heartbeat | 2026-01-19 00:35:29 |
| From worker node | Hostname | lupin11.farm.particle.cz |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-18 21:43:17 |
| Input files | monte-carlo-012084-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10287s) |
| CPU time | 2h (9859s = 95%) |
| Max RSS bytes | 4409593856 (4205 MiB) |
| Outputting started | 2026-01-19 00:34:45 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12084/1/001/reco_stage1.root
|
| Finished | 2026-01-19 00:35:29 |
| Saved logs | justin-logs:281535.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
edRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 142758 traces, 0 summary
Retagger: tagging trace set: gauss with 112515 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 112515 traces tagged "gauss"
FrameSaver: q=3.97613e+06 n=2059619 tag=gauss
wclsFrameSaver: saving 142758 traces tagged "wiener"
FrameSaver: q=4.21279e+06 n=1839704 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 49386 XUs and 40977 XVs -> 800 XUVs
C:0 T:1 147126 XUs and 113778 XVs -> 14794 XUVs
C:0 T:2 111522 XUs and 159503 XVs -> 6363 XUVs
C:0 T:3 53444 XUs and 60656 XVs -> 535 XUVs
C:0 T:4 13718 XUs and 11077 XVs -> 113 XUVs
C:0 T:5 52160 XUs and 34866 XVs -> 4895 XUVs
C:0 T:6 169323 XUs and 175230 XVs -> 8439 XUVs
C:0 T:7 57019 XUs and 56410 XVs -> 540 XUVs
C:0 T:8 4723 XUs and 6673 XVs -> 52 XUVs
C:0 T:9 29408 XUs and 54231 XVs -> 3024 XUVs
C:0 T:10 91184 XUs and 42351 XVs -> 7506 XUVs
C:0 T:11 96 XUs and 79 XVs -> 19 XUVs
47080 XUVs total
14480 collection wire objects
43444 potential space points
Neighbour search...
5202428 tests to find 2302134 neighbours
Iterating with no regularization...
Begin: 1.0227e+08
0 8.18275e+07
1 8.0641e+07
2 8.04653e+07
3 8.04055e+07
Now with regularization...
Begin: 6.82944e+07
0 6.8224e+07
1 6.81874e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411824297
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411824297
fLifetime: 30000 [us]
19-Jan-2026 01:34:43 CET Closed output file "reco_stage1.root"
19-Jan-2026 01:34:43 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 257.486 350.156 438.999 355.756 48.8858 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00102869 0.00325469 0.00522823 0.00333448 0.0013787 10
reco:ophit:OpHitFinder 0.271763 0.293861 0.350936 0.286161 0.0219428 10
reco:opflash:OpFlashFinder 0.153123 0.195084 0.240152 0.193282 0.0275066 10
reco:opslicer:OpSlicer 0.594372 0.730288 0.96854 0.724175 0.10507 10
reco:caldata:DataPrepModule 5.27822 5.53672 6.48832 5.43895 0.345572 10
reco:wclsdatasp:WireCellToolkit 32.1634 35.9133 38.4971 36.1476 1.77254 10
reco:gaushit:GausHitFinder 0.94725 1.24867 1.52807 1.2227 0.164604 10
reco:nhitsfilter:NumberOfHitsFilter 0.000452891 0.000543027 0.000734651 0.000536635 7.34381e-05 10
reco:reco3d:SpacePointSolver 9.12601 14.9184 21.1223 14.2847 3.85978 10
reco:hitpdune:DisambigFromSpacePoints 1.15545 1.54902 1.92578 1.53463 0.228036 10
reco:pandora:StandardPandora 21.4466 44.7389 65.5509 46.9281 14.5897 10
reco:pandoraWriter:StandardPandora 0.351809 0.579987 0.970409 0.545351 0.164439 10
reco:pandoraTrack:LArPandoraTrackCreation 3.38033 5.446 6.69421 5.53809 1.01335 10
reco:pandoraShower:LArPandoraShowerCreation 2.91098 5.65272 8.32792 5.33399 1.42005 10
reco:pandoracalo:Calorimetry 1.5937 2.74509 3.49202 2.79847 0.569482 10
reco:pandoracalonosce:Calorimetry 1.43918 2.53284 3.29991 2.60314 0.537098 10
reco:pandorapid:Chi2ParticleID 0.00562943 0.00683063 0.00873906 0.00655859 0.000899427 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0392563 0.0516803 0.0596335 0.0511503 0.00624587 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00522527 0.00653312 0.0074806 0.00672778 0.000726531 10
reco:pandoraShowercalo:ShowerCalorimetry 2.5273 5.20816 7.14829 5.13393 1.35534 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.48282 4.93105 7.06909 4.85859 1.23063 10
reco:emtrkmichelid:EmTrackMichelId 135.416 167.735 202.165 168.716 16.7519 10
reco:crttag:SingleCRTMatchingProducer 0.0135095 0.0164563 0.0213089 0.0160921 0.00240631 10
reco:crtreco:TwoCRTMatchingProducer 0.00774958 0.0103904 0.0145062 0.0101608 0.00187655 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.591235 0.843709 0.944811 0.87079 0.0970189 10
reco:pandora2Track:LArPandoraTrackCreation 8.74941 15.6843 24.5212 15.0979 3.80863 10
reco:pandora2calo:Calorimetry 3.71242 6.90038 10.3916 6.56836 1.6544 10
reco:pandora2calonosce:Calorimetry 3.56626 6.61236 9.72585 6.37944 1.56709 10
reco:pandora2pid:Chi2ParticleID 0.0133342 0.0166574 0.0217461 0.0159097 0.00253263 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0519049 0.0664943 0.0815667 0.0659598 0.00840212 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0130123 0.0163714 0.0209973 0.0155737 0.00235688 10
reco:pandora2Shower:LArPandoraShowerCreation 3.31993 5.61941 7.75678 5.38932 1.1951 10
reco:pandora2Showercalo:ShowerCalorimetry 3.16619 5.62059 7.38721 5.43395 1.21306 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.8054 4.98981 6.87884 4.73413 1.14732 10
[art]:TriggerResults:TriggerResultInserter 4.2231e-05 5.87601e-05 0.00015419 4.8645e-05 3.20122e-05 10
end_path:out1:RootOutput 9.36e-06 1.11301e-05 1.683e-05 1.05205e-05 1.98075e-06 10
end_path:out1:RootOutput(write) 2.59636 3.62291 4.58299 3.56361 0.583354 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5135.24 MB
Peak resident set size usage (VmHWM): 4318.81 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.58 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10729632
-rw-r--r-- 1 fermilab users 2509094828 Jan 19 00:32 detsim_stage2.root
-rw-r--r-- 1 fermilab users 2386060561 Jan 19 00:30 detsim_stage1.root
-rw-r--r-- 1 fermilab users 2192598331 Jan 19 01:34 reco_stage1.root
-rw-r--r-- 1 fermilab users 1952679871 Jan 18 23:03 g4_stage2.root
-rw-r--r-- 1 fermilab users 1871376146 Jan 18 22:50 g4_stage1.root
-rw-r--r-- 1 fermilab users 74703110 Jan 19 01:29 Pandora_Events.pndr
-rw-r--r-- 1 fermilab users 243137 Jan 19 01:34 jobscript.log
-rw-r--r-- 1 fermilab users 217088 Jan 19 01:34 mem.db
-rw-r--r-- 1 fermilab users 62376 Jan 19 01:34 Pandora_Geometry.xml
-rw-r--r-- 1 fermilab users 36864 Jan 19 01:34 time.db
-rw-r--r-- 1 fermilab users 519 Jan 19 00:32 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 18 23:03 g4_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 19 01:34 protoDUNE_reco1_hist.root
-rw-r--r-- 1 fermilab users 52 Jan 18 22:43 all-input-dids.txt
-rw-r--r-- 1 fermilab users 7 Jan 19 01:34 justin-processed-pfns.txt
-rw-r--r-- 1 fermilab users 0 Jan 19 00:40 ProtoDUNE.log
-rw-r--r-- 1 fermilab users 0 Jan 19 00:32 debugprod.log
