Jobsub ID 271178.0@dunegpschedd01.fnal.gov
| Jobsub ID | 271178.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11457 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-01 07:48:56 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-01 13:27:07 |
| From worker node | Hostname | dunegli-8210107-0-fnpc18008.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-01 08:12:53 |
| Input files | monte-carlo-011457-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (18813s) |
| CPU time | 4h (17726s = 94%) |
| Max RSS bytes | 4685455360 (4468 MiB) |
| Outputting started | 2026-01-01 13:26:26 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11457/1/001/reco_stage1.root
|
| Finished | 2026-01-01 13:27:07 |
| Saved logs | justin-logs:271178.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 153903 traces, 0 summary
Retagger: tagging trace set: gauss with 116515 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 116515 traces tagged "gauss"
FrameSaver: q=4.05852e+06 n=2080096 tag=gauss
wclsFrameSaver: saving 153903 traces tagged "wiener"
FrameSaver: q=4.28265e+06 n=1837631 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 56356 XUs and 39979 XVs -> 702 XUVs
C:0 T:1 132410 XUs and 98696 XVs -> 7792 XUVs
C:0 T:2 78316 XUs and 90582 XVs -> 3011 XUVs
C:0 T:3 39463 XUs and 39423 XVs -> 233 XUVs
C:0 T:4 18062 XUs and 13182 XVs -> 146 XUVs
C:0 T:5 94461 XUs and 49369 XVs -> 8833 XUVs
C:0 T:6 62101 XUs and 57493 XVs -> 2485 XUVs
C:0 T:7 26660 XUs and 22502 XVs -> 125 XUVs
C:0 T:8 13369 XUs and 12523 XVs -> 158 XUVs
C:0 T:9 105049 XUs and 111923 XVs -> 8631 XUVs
C:0 T:10 50896 XUs and 29691 XVs -> 6436 XUVs
C:0 T:11 2205 XUs and 4499 XVs -> 1573 XUVs
40125 XUVs total
14297 collection wire objects
37540 potential space points
Neighbour search...
3335922 tests to find 1718516 neighbours
Iterating with no regularization...
Begin: 6.99995e+07
0 5.89612e+07
1 5.81549e+07
2 5.80516e+07
3 5.80236e+07
Now with regularization...
Begin: 4.74224e+07
0 4.73883e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411470707
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411470707
fLifetime: 30000 [us]
01-Jan-2026 13:26:24 UTC Closed output file "reco_stage1.root"
01-Jan-2026 13:26:24 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 357.014 571.605 849.595 532.7 141.072 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00195698 0.0254156 0.20896 0.00509405 0.0612088 10
reco:ophit:OpHitFinder 0.294882 0.389692 0.527323 0.375655 0.0664452 10
reco:opflash:OpFlashFinder 0.158401 0.233327 0.349689 0.21119 0.0579026 10
reco:opslicer:OpSlicer 0.741907 1.03241 1.35132 1.0122 0.206418 10
reco:caldata:DataPrepModule 6.74619 8.18259 10.7635 7.43526 1.43386 10
reco:wclsdatasp:WireCellToolkit 42.7571 49.7018 57.0883 49.681 3.74808 10
reco:gaushit:GausHitFinder 1.34677 1.86499 2.94114 1.61983 0.479849 10
reco:nhitsfilter:NumberOfHitsFilter 0.000506217 0.000733302 0.0010336 0.000689308 0.000170313 10
reco:reco3d:SpacePointSolver 11.9874 20.9759 35.4308 20.3996 7.26763 10
reco:hitpdune:DisambigFromSpacePoints 1.51618 2.48656 3.92822 2.28537 0.836489 10
reco:pandora:StandardPandora 28.7778 54.9436 86.4415 46.8258 19.3221 10
reco:pandoraWriter:StandardPandora 0.472899 2.51295 6.46573 1.50604 1.96918 10
reco:pandoraTrack:LArPandoraTrackCreation 5.11648 7.66323 11.3864 7.75994 1.67587 10
reco:pandoraShower:LArPandoraShowerCreation 3.92811 10.0082 15.8528 8.98381 3.53661 10
reco:pandoracalo:Calorimetry 2.46104 4.41719 8.0497 4.07556 1.58829 10
reco:pandoracalonosce:Calorimetry 2.22482 3.96478 7.8321 3.8 1.5697 10
reco:pandorapid:Chi2ParticleID 0.00727687 0.0106543 0.0144992 0.0107644 0.00249984 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0481887 0.127542 0.493689 0.0922115 0.124645 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00729028 0.00968525 0.0136229 0.00972983 0.00196696 10
reco:pandoraShowercalo:ShowerCalorimetry 4.17726 10.2719 24.3353 8.34611 5.70656 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.80751 10.0878 21.9998 8.45568 5.24196 10
reco:emtrkmichelid:EmTrackMichelId 191.443 287.535 406.042 270.653 69.5146 10
reco:crttag:SingleCRTMatchingProducer 0.0140472 0.0233583 0.0349813 0.0226158 0.0061722 10
reco:crtreco:TwoCRTMatchingProducer 0.010132 0.0186884 0.0316958 0.0181733 0.00573864 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.9793 1.38158 2.0195 1.33579 0.335489 10
reco:pandora2Track:LArPandoraTrackCreation 12.7852 27.8148 49.4155 25.4611 10.0464 10
reco:pandora2calo:Calorimetry 5.63734 13.8215 21.8378 12.8048 5.08463 10
reco:pandora2calonosce:Calorimetry 5.61068 12.7629 21.2019 11.8383 4.70182 10
reco:pandora2pid:Chi2ParticleID 0.0211333 0.0299841 0.0475307 0.0293386 0.00824963 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0763316 0.124338 0.19958 0.128011 0.0393339 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0202487 0.0296932 0.0463954 0.029118 0.00781257 10
reco:pandora2Shower:LArPandoraShowerCreation 5.45068 10.6115 20.8757 9.72924 4.1121 10
reco:pandora2Showercalo:ShowerCalorimetry 5.61386 11.5898 28.1591 10.0023 6.15593 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.55917 10.1464 23.9777 9.42579 5.30908 10
[art]:TriggerResults:TriggerResultInserter 7.6337e-05 0.000117698 0.000313592 9.9211e-05 6.64252e-05 10
end_path:out1:RootOutput 1.5854e-05 1.94789e-05 3.6318e-05 1.77395e-05 5.79809e-06 10
end_path:out1:RootOutput(write) 3.89726 6.62487 13.4081 5.18811 2.92195 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5135.77 MB
Peak resident set size usage (VmHWM): 4318.31 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.30 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.81 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10136012
-rw-r--r-- 1 dunegli fnalgrid 2390082269 Jan 1 11:39 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2270285310 Jan 1 11:31 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2086856592 Jan 1 13:26 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1812366204 Jan 1 08:47 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1742245349 Jan 1 08:24 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 76813130 Jan 1 13:16 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242757 Jan 1 13:26 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 1 13:26 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 1 13:26 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 1 13:26 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 11:39 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 08:47 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 1 13:26 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 1 08:12 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 1 13:26 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 11:48 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 1 11:39 debugprod.log
