Jobsub ID 261206.0@dunegpschedd02.fnal.gov
| Jobsub ID | 261206.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11167 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-11 20:12:39 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 22:15:12 |
| From worker node | Hostname | dunegli-8047050-0-fnpc17109.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:35:04 |
| Input files | monte-carlo-011167-000001
|
| Jobscript | Exit code | 0 |
| Real time | 10h (38343s) |
| CPU time | 10h (37834s = 98%) |
| Max RSS bytes | 4539281408 (4328 MiB) |
| Outputting started | 2025-12-12 22:14:07 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11167/1/001/reco_stage1.root
|
| Finished | 2025-12-12 22:15:12 |
| Saved logs | justin-logs:261206.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ervice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 143329 traces, 0 summary
Retagger: tagging trace set: gauss with 109190 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109190 traces tagged "gauss"
FrameSaver: q=3.7598e+06 n=1905658 tag=gauss
wclsFrameSaver: saving 143329 traces tagged "wiener"
FrameSaver: q=3.97528e+06 n=1677171 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35419 XUs and 40297 XVs -> 437 XUVs
C:0 T:1 74126 XUs and 74607 XVs -> 5557 XUVs
C:0 T:2 120789 XUs and 215192 XVs -> 10065 XUVs
C:0 T:3 54385 XUs and 70165 XVs -> 478 XUVs
C:0 T:4 15893 XUs and 14716 XVs -> 206 XUVs
C:0 T:5 61593 XUs and 49761 XVs -> 5848 XUVs
C:0 T:6 75745 XUs and 101516 XVs -> 3395 XUVs
C:0 T:7 30915 XUs and 42407 XVs -> 242 XUVs
C:0 T:8 7100 XUs and 7265 XVs -> 186 XUVs
C:0 T:9 34498 XUs and 39171 XVs -> 2333 XUVs
C:0 T:10 23538 XUs and 17711 XVs -> 3162 XUVs
C:0 T:11 93 XUs and 61 XVs -> 10 XUVs
31919 XUVs total
12386 collection wire objects
29376 potential space points
Neighbour search...
1888090 tests to find 932742 neighbours
Iterating with no regularization...
Begin: 7.42991e+07
0 6.2915e+07
1 6.20857e+07
2 6.19798e+07
3 6.19515e+07
Now with regularization...
Begin: 5.07216e+07
0 5.07074e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411058677
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058677
fLifetime: 30000 [us]
12-Dec-2025 22:14:01 UTC Closed output file "reco_stage1.root"
12-Dec-2025 22:14:02 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 1172.74 1879.87 3116 1588.25 586.36 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0033452 0.0107163 0.021307 0.0116832 0.00541257 10
reco:ophit:OpHitFinder 0.368016 0.553945 0.741782 0.551118 0.0918046 10
reco:opflash:OpFlashFinder 0.360846 0.689947 1.48411 0.637835 0.311449 10
reco:opslicer:OpSlicer 0.81765 1.42568 2.00048 1.42213 0.327098 10
reco:caldata:DataPrepModule 7.32278 10.2035 12.5201 10.6303 1.73501 10
reco:wclsdatasp:WireCellToolkit 84.8303 134.343 171.55 133.321 29.318 10
reco:gaushit:GausHitFinder 2.13549 3.59816 5.2845 3.60679 0.953495 10
reco:nhitsfilter:NumberOfHitsFilter 0.00222231 0.00337226 0.0053415 0.00317252 0.00104223 10
reco:reco3d:SpacePointSolver 28.1773 59.1685 93.2324 55.3096 22.2117 10
reco:hitpdune:DisambigFromSpacePoints 5.25643 11.6374 25.0884 8.68604 7.20484 10
reco:pandora:StandardPandora 91.21 220.736 665.748 183.719 160.058 10
reco:pandoraWriter:StandardPandora 0.906669 1.56426 2.22075 1.56971 0.441005 10
reco:pandoraTrack:LArPandoraTrackCreation 31.9108 55.9428 106.476 49.5567 21.2733 10
reco:pandoraShower:LArPandoraShowerCreation 37.3157 74.361 140.613 58.2338 32.6582 10
reco:pandoracalo:Calorimetry 14.7383 27.977 43.1566 28.0524 8.44954 10
reco:pandoracalonosce:Calorimetry 16.0058 28.1218 49.4245 27.3187 9.2372 10
reco:pandorapid:Chi2ParticleID 0.0122028 0.0189998 0.0267264 0.0196823 0.00489695 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0907736 0.165596 0.229619 0.181217 0.0456167 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.010051 0.0171978 0.0251559 0.0179115 0.00482951 10
reco:pandoraShowercalo:ShowerCalorimetry 45.9903 80.8145 149.711 71.9401 33.2351 10
reco:pandoraShowercalonosce:ShowerCalorimetry 33.8512 79.4838 132.492 71.473 30.1944 10
reco:emtrkmichelid:EmTrackMichelId 360.442 466.691 594.507 462.476 84.7305 10
reco:crttag:SingleCRTMatchingProducer 0.0539335 0.105475 0.153746 0.113356 0.0265705 10
reco:crtreco:TwoCRTMatchingProducer 0.0432861 0.0907159 0.134095 0.0953825 0.0234708 10
reco:anodepiercerst0:T0RecoAnodePiercers 2.20336 3.69815 7.23639 3.14576 1.69776 10
reco:pandora2Track:LArPandoraTrackCreation 94.8636 201.017 326.501 169.063 72.9076 10
reco:pandora2calo:Calorimetry 49.8518 104.381 171.912 96.7101 38.336 10
reco:pandora2calonosce:Calorimetry 40.7502 93.8029 158.67 91.2821 36.315 10
reco:pandora2pid:Chi2ParticleID 0.0253403 0.0471659 0.0671797 0.0512224 0.015454 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.115953 0.223366 0.30261 0.225419 0.0625363 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0226902 0.0426993 0.0583688 0.0483113 0.0134641 10
reco:pandora2Shower:LArPandoraShowerCreation 29.0192 56.122 82.2824 53.4642 18.4705 10
reco:pandora2Showercalo:ShowerCalorimetry 40.7597 82.9216 129.215 77.0744 29.6126 10
reco:pandora2Showercalonosce:ShowerCalorimetry 33.2251 73.1923 120.02 66.8188 29.5725 10
[art]:TriggerResults:TriggerResultInserter 0.000121386 0.000207662 0.00029578 0.000208201 5.92378e-05 10
end_path:out1:RootOutput 1.5547e-05 2.82793e-05 4.0701e-05 2.8629e-05 8.91108e-06 10
end_path:out1:RootOutput(write) 3.54869 6.02863 8.83137 5.97207 1.42478 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5546 MB
Peak resident set size usage (VmHWM): 4539.28 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.27 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.45 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.88 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 12557468
-rw-r--r-- 1 dunegli fnalgrid 2878030520 Dec 12 16:56 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2727633530 Dec 12 16:51 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2671630114 Dec 12 22:14 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2283511466 Dec 12 12:13 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2196275769 Dec 12 11:41 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 101131050 Dec 12 21:53 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242925 Dec 12 22:14 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 22:14 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 22:14 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 22:14 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 16:56 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 12:13 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 22:14 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:35 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 22:14 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 17:12 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 16:56 debugprod.log
