Jobsub ID 247575.0@dunegpschedd02.fnal.gov
| Jobsub ID | 247575.0@dunegpschedd02.fnal.gov |
| Workflow ID | 10290 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-17 09:57:12 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-17 12:22:02 |
| From worker node | Hostname | dunegli-7789642-0-fnpc23108.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-17 10:10:00 |
| Input files | monte-carlo-010290-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7907s) |
| CPU time | 2h (7816s = 98%) |
| Max RSS bytes | 4163428352 (3970 MiB) |
| Outputting started | 2025-11-17 12:21:47 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10290/1/001/reco_stage1.root
|
| Finished | 2025-11-17 12:22:02 |
| Saved logs | justin-logs:247575.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 151744 traces, 0 summary
Retagger: tagging trace set: gauss with 115236 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 115236 traces tagged "gauss"
FrameSaver: q=4.03176e+06 n=2058845 tag=gauss
wclsFrameSaver: saving 151744 traces tagged "wiener"
FrameSaver: q=4.28345e+06 n=1823204 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 61400 XUs and 55331 XVs -> 1351 XUVs
C:0 T:1 167151 XUs and 133273 XVs -> 13996 XUVs
C:0 T:2 87549 XUs and 118117 XVs -> 7997 XUVs
C:0 T:3 43059 XUs and 42376 XVs -> 321 XUVs
C:0 T:4 18407 XUs and 15340 XVs -> 230 XUVs
C:0 T:5 112798 XUs and 64126 XVs -> 13068 XUVs
C:0 T:6 113581 XUs and 110168 XVs -> 7192 XUVs
C:0 T:7 46698 XUs and 40711 XVs -> 381 XUVs
C:0 T:8 6488 XUs and 5190 XVs -> 48 XUVs
C:0 T:9 61370 XUs and 45713 XVs -> 6635 XUVs
C:0 T:10 84395 XUs and 33608 XVs -> 8283 XUVs
C:0 T:11 170 XUs and 126 XVs -> 15 XUVs
59517 XUVs total
14274 collection wire objects
53802 potential space points
Neighbour search...
7839046 tests to find 3614388 neighbours
Iterating with no regularization...
Begin: 7.14948e+07
0 6.06111e+07
1 5.96514e+07
2 5.94868e+07
3 5.94326e+07
Now with regularization...
Begin: 4.81878e+07
0 4.81394e+07
1 4.80962e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410567216
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410567216
fLifetime: 30000 [us]
17-Nov-2025 12:21:46 UTC Closed output file "reco_stage1.root"
17-Nov-2025 12:21:46 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 173.292 253.937 335.872 248.003 49.3858 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000704411 0.00345123 0.00501853 0.00376265 0.00132944 10
reco:ophit:OpHitFinder 0.160391 0.243163 0.300857 0.25106 0.0452437 10
reco:opflash:OpFlashFinder 0.0860069 0.135897 0.185588 0.133302 0.0281651 10
reco:opslicer:OpSlicer 0.311977 0.546452 0.721502 0.594043 0.14028 10
reco:caldata:DataPrepModule 3.21923 4.30578 5.21522 4.51747 0.822479 10
reco:wclsdatasp:WireCellToolkit 22.2508 27.1477 30.3496 28.1281 2.87215 10
reco:gaushit:GausHitFinder 0.518679 0.916072 1.35987 0.977087 0.251666 10
reco:nhitsfilter:NumberOfHitsFilter 0.000228167 0.000376537 0.000511338 0.000394055 0.00010159 10
reco:reco3d:SpacePointSolver 4.72248 14.9248 29.8163 15.2452 6.44443 10
reco:hitpdune:DisambigFromSpacePoints 0.52857 1.31729 2.056 1.30137 0.459786 10
reco:pandora:StandardPandora 10.0459 25.2965 44.8594 26.1755 9.56492 10
reco:pandoraWriter:StandardPandora 0.233787 0.372343 0.489232 0.382546 0.0777267 10
reco:pandoraTrack:LArPandoraTrackCreation 1.30662 2.7607 4.0852 2.84158 0.780649 10
reco:pandoraShower:LArPandoraShowerCreation 1.88935 3.52378 6.9694 3.09512 1.45647 10
reco:pandoracalo:Calorimetry 0.869866 1.63456 2.20792 1.67116 0.441638 10
reco:pandoracalonosce:Calorimetry 0.704814 1.52207 2.04765 1.53622 0.360978 10
reco:pandorapid:Chi2ParticleID 0.00251984 0.00431701 0.00553021 0.00438814 0.000767891 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0267538 0.0464364 0.0600976 0.0480845 0.0097698 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00240542 0.00398135 0.00512961 0.00419851 0.000818277 10
reco:pandoraShowercalo:ShowerCalorimetry 1.78794 3.70578 5.55881 3.51344 1.2718 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.71463 3.6423 5.41118 3.46053 1.16509 10
reco:emtrkmichelid:EmTrackMichelId 95.0961 126.205 158.403 120.491 19.6847 10
reco:crttag:SingleCRTMatchingProducer 0.00886994 0.012587 0.023008 0.0114344 0.00403046 10
reco:crtreco:TwoCRTMatchingProducer 0.00511867 0.00773794 0.0179474 0.00670331 0.00360102 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.546185 0.775457 0.980514 0.792053 0.14802 10
reco:pandora2Track:LArPandoraTrackCreation 6.619 10.2831 18.3586 9.3381 3.7438 10
reco:pandora2calo:Calorimetry 3.26423 5.01339 8.0289 4.90848 1.34087 10
reco:pandora2calonosce:Calorimetry 3.15795 4.76162 7.62654 4.70193 1.18597 10
reco:pandora2pid:Chi2ParticleID 0.00735342 0.0106926 0.0164997 0.0107946 0.00257276 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0408707 0.056935 0.0895421 0.058847 0.0138388 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00733557 0.0100936 0.0154776 0.0104113 0.00232334 10
reco:pandora2Shower:LArPandoraShowerCreation 2.6018 3.61697 5.82495 3.41638 0.868078 10
reco:pandora2Showercalo:ShowerCalorimetry 3.00248 4.44869 7.20865 4.25183 1.14796 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.74062 4.12968 6.61491 3.94066 1.16437 10
[art]:TriggerResults:TriggerResultInserter 4.6e-05 6.87797e-05 0.000198471 5.58655e-05 4.36525e-05 10
end_path:out1:RootOutput 9.715e-06 1.27064e-05 2.2494e-05 1.19585e-05 3.55449e-06 10
end_path:out1:RootOutput(write) 1.68967 2.44054 3.52399 2.33961 0.549604 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4981.03 MB
Peak resident set size usage (VmHWM): 4163.43 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.61 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10009960
-rw-r--r-- 1 dunegli fnalgrid 2352480953 Nov 17 11:38 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2232995675 Nov 17 11:36 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2059459949 Nov 17 12:21 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1799181651 Nov 17 10:20 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1726229845 Nov 17 10:12 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 79228400 Nov 17 12:18 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242962 Nov 17 12:21 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 17 12:21 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 17 12:21 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 17 12:21 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 17 11:38 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 17 10:20 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 17 12:21 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 17 10:10 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 17 12:21 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 17 11:42 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 17 11:38 debugprod.log
