Jobsub ID 265700.1@dunegpschedd02.fnal.gov
| Jobsub ID | 265700.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11494 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-03 19:22:08 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-03 21:35:48 |
| From worker node | Hostname | dunegli-8232275-0-fnpc23105.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-03 19:22:32 |
| Input files | monte-carlo-011494-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7984s) |
| CPU time | 2h (7879s = 98%) |
| Max RSS bytes | 4135661568 (3944 MiB) |
| Outputting started | 2026-01-03 21:35:36 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11494/1/001/reco_stage1.root
|
| Finished | 2026-01-03 21:35:48 |
| Saved logs | justin-logs:265700.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
pService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 112921 traces, 0 summary
Retagger: tagging trace set: gauss with 89839 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 89839 traces tagged "gauss"
FrameSaver: q=3.28548e+06 n=1662461 tag=gauss
wclsFrameSaver: saving 112921 traces tagged "wiener"
FrameSaver: q=3.45281e+06 n=1498610 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 21579 XUs and 28217 XVs -> 260 XUVs
C:0 T:1 41680 XUs and 47058 XVs -> 2893 XUVs
C:0 T:2 55641 XUs and 43586 XVs -> 2852 XUVs
C:0 T:3 24691 XUs and 17943 XVs -> 121 XUVs
C:0 T:4 13485 XUs and 13998 XVs -> 76 XUVs
C:0 T:5 42050 XUs and 33613 XVs -> 4021 XUVs
C:0 T:6 97504 XUs and 84517 XVs -> 4678 XUVs
C:0 T:7 40674 XUs and 31035 XVs -> 180 XUVs
C:0 T:8 9632 XUs and 9692 XVs -> 172 XUVs
C:0 T:9 60288 XUs and 89780 XVs -> 5317 XUVs
C:0 T:10 40034 XUs and 29409 XVs -> 4207 XUVs
C:0 T:11 221 XUs and 155 XVs -> 15 XUVs
24792 XUVs total
9899 collection wire objects
23394 potential space points
Neighbour search...
1384528 tests to find 703006 neighbours
Iterating with no regularization...
Begin: 7.44345e+07
0 6.40423e+07
1 6.32969e+07
2 6.31787e+07
3 6.31452e+07
Now with regularization...
Begin: 5.2984e+07
0 5.29595e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411520574
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411520574
fLifetime: 30000 [us]
03-Jan-2026 21:35:35 UTC Closed output file "reco_stage1.root"
03-Jan-2026 21:35:35 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 135.64 239.085 352.066 216.16 63.5146 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000578312 0.0028474 0.0046981 0.00288326 0.00133942 10
reco:ophit:OpHitFinder 0.186384 0.211005 0.259453 0.198423 0.0257334 10
reco:opflash:OpFlashFinder 0.0962375 0.128444 0.163591 0.132318 0.0220314 10
reco:opslicer:OpSlicer 0.350154 0.453741 0.592685 0.438341 0.0736397 10
reco:caldata:DataPrepModule 3.13383 3.61041 5.16398 3.27685 0.736703 10
reco:wclsdatasp:WireCellToolkit 21.1267 23.3318 28.899 22.3613 2.74651 10
reco:gaushit:GausHitFinder 0.462729 0.76306 1.1907 0.731191 0.20015 10
reco:nhitsfilter:NumberOfHitsFilter 0.00017688 0.000279409 0.000398998 0.000274494 6.72364e-05 10
reco:reco3d:SpacePointSolver 3.65308 11.0748 20.5086 10.1605 4.56782 10
reco:hitpdune:DisambigFromSpacePoints 0.412336 1.02813 1.56992 1.00727 0.329929 10
reco:pandora:StandardPandora 8.9918 22.2622 31.2019 22.6709 7.13941 10
reco:pandoraWriter:StandardPandora 0.177084 0.298306 0.405325 0.296863 0.0736317 10
reco:pandoraTrack:LArPandoraTrackCreation 1.31271 2.51673 3.72459 2.3547 0.841238 10
reco:pandoraShower:LArPandoraShowerCreation 0.936594 2.78212 4.45851 2.63986 0.983927 10
reco:pandoracalo:Calorimetry 0.734374 1.40404 1.89225 1.40384 0.373147 10
reco:pandoracalonosce:Calorimetry 0.670559 1.31723 1.9076 1.20204 0.392123 10
reco:pandorapid:Chi2ParticleID 0.00266907 0.0033923 0.00538179 0.00320483 0.000775901 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0211031 0.0316919 0.0485393 0.0303981 0.00672091 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00254005 0.00319459 0.00521304 0.00294519 0.000760634 10
reco:pandoraShowercalo:ShowerCalorimetry 0.933984 2.98851 4.89149 2.59168 1.13126 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.933542 2.93222 4.82551 2.49776 1.11659 10
reco:emtrkmichelid:EmTrackMichelId 79.3093 131.71 203.012 117.842 36.4511 10
reco:crttag:SingleCRTMatchingProducer 0.00498787 0.00880641 0.0122779 0.00868503 0.0018679 10
reco:crtreco:TwoCRTMatchingProducer 0.00308376 0.0053352 0.00799456 0.0052563 0.00120591 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.277599 0.557162 0.837635 0.526168 0.160321 10
reco:pandora2Track:LArPandoraTrackCreation 3.14097 8.53497 15.4703 6.57406 3.72446 10
reco:pandora2calo:Calorimetry 1.629 4.3695 7.54843 3.66254 1.74215 10
reco:pandora2calonosce:Calorimetry 1.53144 4.21572 6.6397 4.05578 1.57819 10
reco:pandora2pid:Chi2ParticleID 0.00521351 0.00876591 0.0146033 0.00801631 0.00292855 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0259884 0.045545 0.0862542 0.0406725 0.0167249 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00506186 0.00863934 0.0145623 0.00799245 0.00286182 10
reco:pandora2Shower:LArPandoraShowerCreation 1.22677 2.99118 4.40808 3.09391 1.00752 10
reco:pandora2Showercalo:ShowerCalorimetry 1.40519 3.84237 6.42827 3.4442 1.46665 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.28624 3.53349 6.07697 3.15745 1.36115 10
[art]:TriggerResults:TriggerResultInserter 2.9265e-05 4.07613e-05 7.6297e-05 3.6766e-05 1.25639e-05 10
end_path:out1:RootOutput 4.157e-06 7.4677e-06 9.935e-06 7.732e-06 2.08435e-06 10
end_path:out1:RootOutput(write) 1.24624 2.03394 3.15256 1.8047 0.537433 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4952.42 MB
Peak resident set size usage (VmHWM): 4135.66 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10060148
-rw-r--r-- 1 dunegli fnalgrid 2372445970 Jan 3 20:54 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2252523619 Jan 3 20:52 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2074289421 Jan 3 21:35 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1795711060 Jan 3 19:33 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1726818483 Jan 3 19:25 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 79187590 Jan 3 21:32 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243054 Jan 3 21:35 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 3 21:35 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 3 21:35 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 3 21:35 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 3 20:54 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 3 19:33 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 3 21:35 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 3 19:22 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 3 21:35 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 3 20:57 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 3 20:54 debugprod.log
