Jobsub ID 261515.1@dunegpschedd02.fnal.gov
| Jobsub ID | 261515.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11179 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 08:07:11 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 14:58:01 |
| From worker node | Hostname | dunegli-7878044-0-fnpc23002.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:36:15 |
| Input files | monte-carlo-011179-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12064s) |
| CPU time | 3h (11534s = 95%) |
| Max RSS bytes | 4552114176 (4341 MiB) |
| Outputting started | 2025-12-12 14:57:19 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11179/1/001/reco_stage1.root
|
| Finished | 2025-12-12 14:58:01 |
| Saved logs | justin-logs:261515.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
rvice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 158878 traces, 0 summary
Retagger: tagging trace set: gauss with 121824 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 121824 traces tagged "gauss"
FrameSaver: q=4.32906e+06 n=2197855 tag=gauss
wclsFrameSaver: saving 158878 traces tagged "wiener"
FrameSaver: q=4.6e+06 n=1959318 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 44438 XUs and 40831 XVs -> 575 XUVs
C:0 T:1 105502 XUs and 87099 XVs -> 7194 XUVs
C:0 T:2 138928 XUs and 155702 XVs -> 9530 XUVs
C:0 T:3 55604 XUs and 57552 XVs -> 720 XUVs
C:0 T:4 13952 XUs and 14928 XVs -> 271 XUVs
C:0 T:5 72791 XUs and 57618 XVs -> 8269 XUVs
C:0 T:6 149789 XUs and 146816 XVs -> 7471 XUVs
C:0 T:7 49504 XUs and 51285 XVs -> 487 XUVs
C:0 T:8 9277 XUs and 7767 XVs -> 66 XUVs
C:0 T:9 46671 XUs and 93834 XVs -> 5446 XUVs
C:0 T:10 70829 XUs and 54557 XVs -> 7066 XUVs
C:0 T:11 78 XUs and 62 XVs -> 8 XUVs
47103 XUVs total
15101 collection wire objects
42031 potential space points
Neighbour search...
2925119 tests to find 1522930 neighbours
Iterating with no regularization...
Begin: 1.05304e+08
0 8.93118e+07
1 8.80856e+07
2 8.78666e+07
3 8.77977e+07
Now with regularization...
Begin: 7.52573e+07
0 7.52022e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411058666
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058666
fLifetime: 30000 [us]
12-Dec-2025 14:57:18 UTC Closed output file "reco_stage1.root"
12-Dec-2025 14:57:18 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 318.838 454.637 779.741 428.953 131.429 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0012679 0.00518109 0.0101517 0.00524804 0.00260353 10
reco:ophit:OpHitFinder 0.252056 0.359375 0.472769 0.3688 0.0729078 10
reco:opflash:OpFlashFinder 0.157281 0.232528 0.327043 0.23608 0.0530488 10
reco:opslicer:OpSlicer 0.465996 0.806407 1.23343 0.858346 0.222485 10
reco:caldata:DataPrepModule 4.30731 6.11447 7.45835 6.88961 1.26852 10
reco:wclsdatasp:WireCellToolkit 30.5325 39.2824 49.4689 40.7837 5.92426 10
reco:gaushit:GausHitFinder 0.810206 1.46268 2.52551 1.36702 0.513776 10
reco:nhitsfilter:NumberOfHitsFilter 0.000616627 0.00088822 0.00125055 0.000819279 0.000221881 10
reco:reco3d:SpacePointSolver 8.87745 24.3147 70.1486 18.5392 16.688 10
reco:hitpdune:DisambigFromSpacePoints 0.939313 2.18113 4.93688 2.02864 1.08333 10
reco:pandora:StandardPandora 19.532 51.9215 89.7528 54.8966 22.0969 10
reco:pandoraWriter:StandardPandora 0.311566 0.606293 0.733126 0.631593 0.117515 10
reco:pandoraTrack:LArPandoraTrackCreation 3.1848 6.47933 10.4141 6.35234 1.93149 10
reco:pandoraShower:LArPandoraShowerCreation 2.39186 6.90696 15.8213 6.55685 3.40014 10
reco:pandoracalo:Calorimetry 1.97735 3.91724 5.93798 3.65464 1.39935 10
reco:pandoracalonosce:Calorimetry 2.18487 3.82521 5.5883 3.64685 1.22915 10
reco:pandorapid:Chi2ParticleID 0.00574158 0.00815159 0.00973358 0.00837875 0.00120752 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0500857 0.0826785 0.125565 0.0812003 0.0219635 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00490763 0.0073447 0.00962079 0.00735017 0.00151294 10
reco:pandoraShowercalo:ShowerCalorimetry 3.67641 8.48354 17.2918 8.01296 3.34043 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.55522 8.05301 21.9016 6.76349 4.96177 10
reco:emtrkmichelid:EmTrackMichelId 156.644 223.847 350.154 213.535 53.8223 10
reco:crttag:SingleCRTMatchingProducer 0.00767572 0.0224787 0.0309777 0.0225176 0.00639959 10
reco:crtreco:TwoCRTMatchingProducer 0.00564916 0.0113247 0.0182806 0.0118059 0.00346028 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.59599 0.964061 1.38198 0.943335 0.217676 10
reco:pandora2Track:LArPandoraTrackCreation 8.06331 21.1287 51.0389 17.4428 12.5865 10
reco:pandora2calo:Calorimetry 3.93692 10.6924 24.2416 9.55064 5.57937 10
reco:pandora2calonosce:Calorimetry 3.69356 9.52951 17.0564 8.42947 4.07023 10
reco:pandora2pid:Chi2ParticleID 0.00859672 0.0166001 0.0253884 0.017278 0.00540058 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.042178 0.0843502 0.124982 0.0933448 0.025547 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00889864 0.0156959 0.0241776 0.0158075 0.00496311 10
reco:pandora2Shower:LArPandoraShowerCreation 2.55632 6.00387 9.64762 5.36969 2.2263 10
reco:pandora2Showercalo:ShowerCalorimetry 3.35882 7.36091 11.3507 6.7964 2.44059 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.84019 6.49004 10.0659 6.06121 2.30676 10
[art]:TriggerResults:TriggerResultInserter 5.1528e-05 0.00010641 0.000289052 8.9776e-05 6.57039e-05 10
end_path:out1:RootOutput 1.561e-05 2.17304e-05 3.3444e-05 2.0474e-05 5.04853e-06 10
end_path:out1:RootOutput(write) 1.94509 3.22763 4.69156 3.16266 0.762235 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5360.82 MB
Peak resident set size usage (VmHWM): 4552.11 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.70 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11547784
-rw-r--r-- 1 dunegli fnalgrid 2666730388 Dec 12 13:39 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2530328874 Dec 12 13:37 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2397822102 Dec 12 14:57 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2118594790 Dec 12 11:50 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2024986661 Dec 12 11:40 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 85851060 Dec 12 14:51 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243201 Dec 12 14:57 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 14:57 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 14:57 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 14:57 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 13:39 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 11:50 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 14:57 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 14:57 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:45 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:39 debugprod.log
