Jobsub ID 254563.0@dunegpschedd01.fnal.gov
| Jobsub ID | 254563.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10414 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-20 18:58:44 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-20 21:42:07 |
| From worker node | Hostname | dunegli-7831237-0-fnpc23040.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-20 19:20:34 |
| Input files | monte-carlo-010414-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7926s) |
| CPU time | 2h (7876s = 99%) |
| Max RSS bytes | 4412481536 (4208 MiB) |
| Outputting started | 2025-11-20 21:32:41 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10414/1/001/reco_stage1.root
|
| Finished | 2025-11-20 21:42:07 |
| Saved logs | justin-logs:254563.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120666 traces, 0 summary
Retagger: tagging trace set: gauss with 90464 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90464 traces tagged "gauss"
FrameSaver: q=3.06815e+06 n=1566687 tag=gauss
wclsFrameSaver: saving 120666 traces tagged "wiener"
FrameSaver: q=3.25966e+06 n=1371557 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 24250 XUs and 13582 XVs -> 158 XUVs
C:0 T:1 46295 XUs and 32721 XVs -> 2931 XUVs
C:0 T:2 134663 XUs and 161125 XVs -> 7664 XUVs
C:0 T:3 60600 XUs and 59627 XVs -> 750 XUVs
C:0 T:4 7625 XUs and 5854 XVs -> 47 XUVs
C:0 T:5 34723 XUs and 17424 XVs -> 4603 XUVs
C:0 T:6 112480 XUs and 113521 XVs -> 6447 XUVs
C:0 T:7 37342 XUs and 39082 XVs -> 390 XUVs
C:0 T:8 13211 XUs and 16434 XVs -> 2834 XUVs
C:0 T:9 61184 XUs and 54288 XVs -> 5511 XUVs
C:0 T:10 28530 XUs and 22295 XVs -> 3695 XUVs
C:0 T:11 114 XUs and 69 XVs -> 10 XUVs
35040 XUVs total
11798 collection wire objects
32043 potential space points
Neighbour search...
3170155 tests to find 1566066 neighbours
Iterating with no regularization...
Begin: 5.36829e+07
0 4.3049e+07
1 4.22122e+07
2 4.20864e+07
3 4.20499e+07
Now with regularization...
Begin: 3.27829e+07
0 3.27304e+07
1 3.26999e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410635037
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410635037
fLifetime: 30000 [us]
20-Nov-2025 21:32:40 UTC Closed output file "reco_stage1.root"
20-Nov-2025 21:32:40 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 146.83 221.18 279.61 230.31 35.3583 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000860397 0.00264306 0.00384486 0.00298643 0.000999105 10
reco:ophit:OpHitFinder 0.168367 0.212532 0.243849 0.215178 0.0213786 10
reco:opflash:OpFlashFinder 0.0946619 0.135916 0.177889 0.135592 0.0252472 10
reco:opslicer:OpSlicer 0.331016 0.455959 0.569194 0.466542 0.0683256 10
reco:caldata:DataPrepModule 3.38544 3.50753 3.85422 3.44009 0.144049 10
reco:wclsdatasp:WireCellToolkit 22.3345 23.3136 25.4859 22.8713 0.980604 10
reco:gaushit:GausHitFinder 0.579628 0.802521 0.953384 0.821157 0.11173 10
reco:nhitsfilter:NumberOfHitsFilter 0.000242795 0.000395743 0.000737832 0.00034761 0.000137241 10
reco:reco3d:SpacePointSolver 6.41653 10.7504 16.4301 11.2195 2.57098 10
reco:hitpdune:DisambigFromSpacePoints 0.680791 1.13243 1.50659 1.16591 0.232215 10
reco:pandora:StandardPandora 8.42167 21.9525 41.6103 22.619 8.2442 10
reco:pandoraWriter:StandardPandora 0.183956 0.275343 0.361186 0.27742 0.0500885 10
reco:pandoraTrack:LArPandoraTrackCreation 1.0935 2.22694 2.82926 2.36069 0.500628 10
reco:pandoraShower:LArPandoraShowerCreation 1.20806 2.64121 3.62777 2.70905 0.706691 10
reco:pandoracalo:Calorimetry 0.658878 1.28646 1.60556 1.39579 0.260924 10
reco:pandoracalonosce:Calorimetry 0.577727 1.1924 1.49716 1.31335 0.254939 10
reco:pandorapid:Chi2ParticleID 0.00228271 0.0034017 0.00493156 0.00338972 0.000651444 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0260439 0.0338287 0.0407365 0.0332364 0.00370453 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00218825 0.00303118 0.00350816 0.00312687 0.000387839 10
reco:pandoraShowercalo:ShowerCalorimetry 1.25585 2.98736 4.01149 3.11902 0.807872 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.22184 2.91485 3.9427 3.05893 0.797069 10
reco:emtrkmichelid:EmTrackMichelId 83.9772 116.861 138.943 119.713 15.594 10
reco:crttag:SingleCRTMatchingProducer 0.00570762 0.0104665 0.0171788 0.00991549 0.00311265 10
reco:crtreco:TwoCRTMatchingProducer 0.00373733 0.00545468 0.00802037 0.00526529 0.00116547 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.400946 0.609966 0.756197 0.575118 0.10589 10
reco:pandora2Track:LArPandoraTrackCreation 3.71938 7.97398 11.4759 8.33675 2.0937 10
reco:pandora2calo:Calorimetry 1.80577 4.10664 5.6682 4.35066 1.04237 10
reco:pandora2calonosce:Calorimetry 1.7142 3.9339 5.4726 4.17449 1.00508 10
reco:pandora2pid:Chi2ParticleID 0.00565145 0.00832571 0.0105624 0.00849781 0.0013221 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0313107 0.042783 0.0527035 0.0433086 0.00547035 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00538393 0.00809179 0.0105066 0.00822499 0.00133684 10
reco:pandora2Shower:LArPandoraShowerCreation 1.41142 2.80271 3.82436 2.96825 0.628372 10
reco:pandora2Showercalo:ShowerCalorimetry 1.62232 3.6191 4.81052 3.88326 0.866235 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.53093 3.35672 4.38339 3.62566 0.784565 10
[art]:TriggerResults:TriggerResultInserter 3.0398e-05 4.51815e-05 0.000124859 3.62945e-05 2.67389e-05 10
end_path:out1:RootOutput 7.985e-06 9.4243e-06 1.529e-05 8.632e-06 2.01594e-06 10
end_path:out1:RootOutput(write) 1.40785 1.95192 2.32437 1.94984 0.263704 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5225.3 MB
Peak resident set size usage (VmHWM): 4412.48 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10474340
-rw-r--r-- 1 dunegli fnalgrid 2450079297 Nov 20 20:54 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2326563590 Nov 20 20:53 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2156623514 Nov 20 21:32 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1897617665 Nov 20 19:34 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1814509312 Nov 20 19:24 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 79713500 Nov 20 21:30 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242746 Nov 20 21:32 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 20 21:32 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 20 21:32 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 20 21:32 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 20 20:54 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 20 19:34 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 20 21:32 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 20 19:20 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 20 21:32 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 20 20:58 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 20 20:54 debugprod.log
