Jobsub ID 261529.1@dunegpschedd02.fnal.gov
| Jobsub ID | 261529.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11152 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 09:47:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 16:44:21 |
| From worker node | Hostname | dunegli-7890439-0-fnpc19135.fnal.gov |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:36:22 |
| Input files | monte-carlo-011152-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (18405s) |
| CPU time | 5h (18179s = 98%) |
| Max RSS bytes | 4696784896 (4479 MiB) |
| Outputting started | 2025-12-12 16:43:07 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11152/1/001/reco_stage1.root
|
| Finished | 2025-12-12 16:44:21 |
| Saved logs | justin-logs:261529.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ce:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 143188 traces, 0 summary
Retagger: tagging trace set: gauss with 109124 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109124 traces tagged "gauss"
FrameSaver: q=3.75372e+06 n=1903755 tag=gauss
wclsFrameSaver: saving 143188 traces tagged "wiener"
FrameSaver: q=3.96827e+06 n=1674749 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35430 XUs and 39942 XVs -> 451 XUVs
C:0 T:1 74807 XUs and 74311 XVs -> 5590 XUVs
C:0 T:2 120699 XUs and 214921 XVs -> 10080 XUVs
C:0 T:3 54367 XUs and 70068 XVs -> 475 XUVs
C:0 T:4 15783 XUs and 14807 XVs -> 206 XUVs
C:0 T:5 61426 XUs and 50227 XVs -> 5882 XUVs
C:0 T:6 75775 XUs and 99129 XVs -> 3354 XUVs
C:0 T:7 30955 XUs and 41376 XVs -> 249 XUVs
C:0 T:8 7061 XUs and 7109 XVs -> 186 XUVs
C:0 T:9 34441 XUs and 38855 XVs -> 2273 XUVs
C:0 T:10 23551 XUs and 17628 XVs -> 3140 XUVs
C:0 T:11 94 XUs and 61 XVs -> 13 XUVs
31899 XUVs total
12353 collection wire objects
29342 potential space points
Neighbour search...
1899878 tests to find 935154 neighbours
Iterating with no regularization...
Begin: 7.58581e+07
0 6.41474e+07
1 6.33211e+07
2 6.32074e+07
3 6.31758e+07
Now with regularization...
Begin: 5.19267e+07
0 5.19094e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411058677
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058677
fLifetime: 30000 [us]
12-Dec-2025 16:43:03 UTC Closed output file "reco_stage1.root"
12-Dec-2025 16:43:03 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 499.231 777.304 1142.66 774.35 159.469 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00190812 0.00627675 0.0122253 0.00554825 0.00322841 10
reco:ophit:OpHitFinder 0.301358 0.347156 0.387305 0.353516 0.0224639 10
reco:opflash:OpFlashFinder 0.178201 0.257621 0.318306 0.263235 0.0382038 10
reco:opslicer:OpSlicer 0.696956 0.846434 0.990189 0.853519 0.0884716 10
reco:caldata:DataPrepModule 4.92404 5.23705 5.59914 5.19826 0.200634 10
reco:wclsdatasp:WireCellToolkit 40.5723 47.1071 53.7158 46.5359 4.34527 10
reco:gaushit:GausHitFinder 1.18861 1.6216 2.07871 1.5844 0.261 10
reco:nhitsfilter:NumberOfHitsFilter 0.00149807 0.00231321 0.00293558 0.0021577 0.000498007 10
reco:reco3d:SpacePointSolver 13.1324 29.5012 55.9781 29.1295 11.8435 10
reco:hitpdune:DisambigFromSpacePoints 1.60961 2.91028 4.00847 2.92716 0.71318 10
reco:pandora:StandardPandora 46.8874 85.3927 186.09 81.1477 38.3247 10
reco:pandoraWriter:StandardPandora 0.665199 0.927813 1.18848 0.947401 0.145188 10
reco:pandoraTrack:LArPandoraTrackCreation 12.7817 20.8609 33.9557 20.2584 5.83189 10
reco:pandoraShower:LArPandoraShowerCreation 11.5381 29.4455 60.3217 27.2203 12.4569 10
reco:pandoracalo:Calorimetry 5.57181 9.8127 16.5769 10.0765 3.06709 10
reco:pandoracalonosce:Calorimetry 5.20216 9.86117 16.1481 9.56682 3.06446 10
reco:pandorapid:Chi2ParticleID 0.0067325 0.00923981 0.0122856 0.00908459 0.00177808 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0537524 0.0800551 0.121782 0.0758726 0.0209654 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00692057 0.00813406 0.00998479 0.00819543 0.000900076 10
reco:pandoraShowercalo:ShowerCalorimetry 12.1796 26.3691 43.8839 23.1396 10.6 10
reco:pandoraShowercalonosce:ShowerCalorimetry 10.3013 23.3641 44.7517 20.339 9.59862 10
reco:emtrkmichelid:EmTrackMichelId 204.366 264.961 334.758 267.782 32.863 10
reco:crttag:SingleCRTMatchingProducer 0.031906 0.0433045 0.0631627 0.0406418 0.00923895 10
reco:crtreco:TwoCRTMatchingProducer 0.0223693 0.0347983 0.0500092 0.0318424 0.0086986 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.01198 1.20738 1.76475 1.12633 0.215743 10
reco:pandora2Track:LArPandoraTrackCreation 38.2206 67.0162 124.301 65.2489 23.7934 10
reco:pandora2calo:Calorimetry 21.0917 36.555 43.7881 39.3428 6.84002 10
reco:pandora2calonosce:Calorimetry 21.6613 36.1147 49.2883 37.1601 8.1092 10
reco:pandora2pid:Chi2ParticleID 0.0184944 0.0234047 0.0289885 0.0229983 0.00299638 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0771812 0.106722 0.155059 0.107553 0.0215219 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0174913 0.0221958 0.0288204 0.0214368 0.00346941 10
reco:pandora2Shower:LArPandoraShowerCreation 12.4591 23.7818 38.3596 22.2842 6.9132 10
reco:pandora2Showercalo:ShowerCalorimetry 16.3837 27.0747 40.0661 24.6432 8.18099 10
reco:pandora2Showercalonosce:ShowerCalorimetry 11.3338 21.6762 33.3486 21.9726 6.14399 10
[art]:TriggerResults:TriggerResultInserter 5.6721e-05 0.000105613 0.000229373 7.0066e-05 6.3274e-05 10
end_path:out1:RootOutput 1.243e-05 1.97362e-05 4.3821e-05 1.497e-05 9.30042e-06 10
end_path:out1:RootOutput(write) 3.20943 4.29399 5.42074 4.33795 0.555668 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5718.19 MB
Peak resident set size usage (VmHWM): 4696.78 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.27 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.02 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 12558512
-rw-r--r-- 1 dunegli fnalgrid 2878077048 Dec 12 14:30 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2727669454 Dec 12 14:27 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2672630777 Dec 12 16:43 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2283511466 Dec 12 11:57 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2196275769 Dec 12 11:41 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 101129180 Dec 12 16:34 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243053 Dec 12 16:43 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 16:43 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 16:43 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 16:43 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 14:30 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 11:57 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 16:43 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 16:43 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 14:40 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 14:30 debugprod.log
