Jobsub ID 250568.0@dunegpschedd01.fnal.gov
| Jobsub ID | 250568.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10194 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-14 18:39:14 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 20:28:38 |
| From worker node | Hostname | dunegli-7755959-0-fnpc23022.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 18:40:18 |
| Input files | monte-carlo-010194-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6480s) |
| CPU time | 1h (6375s = 98%) |
| Max RSS bytes | 3976220672 (3792 MiB) |
| Outputting started | 2025-11-14 20:28:19 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10194/1/001/reco_stage1.root
|
| Finished | 2025-11-14 20:28:38 |
| Saved logs | justin-logs:250568.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
e:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 116222 traces, 0 summary
Retagger: tagging trace set: gauss with 88148 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88148 traces tagged "gauss"
FrameSaver: q=2.90215e+06 n=1563206 tag=gauss
wclsFrameSaver: saving 116222 traces tagged "wiener"
FrameSaver: q=3.07591e+06 n=1371123 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 31601 XUs and 23880 XVs -> 755 XUVs
C:0 T:1 85696 XUs and 110046 XVs -> 19463 XUVs
C:0 T:2 145343 XUs and 120395 XVs -> 17934 XUVs
C:0 T:3 39483 XUs and 41653 XVs -> 524 XUVs
C:0 T:4 11628 XUs and 13328 XVs -> 151 XUVs
C:0 T:5 54563 XUs and 62319 XVs -> 10430 XUVs
C:0 T:6 190480 XUs and 180605 XVs -> 18088 XUVs
C:0 T:7 44810 XUs and 52947 XVs -> 712 XUVs
C:0 T:8 6614 XUs and 5883 XVs -> 27 XUVs
C:0 T:9 44388 XUs and 57802 XVs -> 4071 XUVs
C:0 T:10 26807 XUs and 14419 XVs -> 5962 XUVs
C:0 T:11 38 XUs and 43 XVs -> 2 XUVs
78119 XUVs total
11674 collection wire objects
70222 potential space points
Neighbour search...
20498518 tests to find 8164020 neighbours
Iterating with no regularization...
Begin: 5.35561e+07
0 4.48884e+07
1 4.43597e+07
2 4.4285e+07
3 4.426e+07
Now with regularization...
Begin: 3.67735e+07
0 3.67191e+07
1 3.66533e+07
2 3.65986e+07
3 3.65515e+07
4 3.65114e+07
5 3.64773e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410511978
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410511978
fLifetime: 30000 [us]
14-Nov-2025 20:28:18 UTC Closed output file "reco_stage1.root"
14-Nov-2025 20:28:18 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 127.963 181.574 255.407 179.14 38.3584 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000657624 0.00268268 0.00425654 0.00271825 0.00111955 10
reco:ophit:OpHitFinder 0.165185 0.196732 0.230774 0.194605 0.0240627 10
reco:opflash:OpFlashFinder 0.0749269 0.104492 0.145007 0.102586 0.0225224 10
reco:opslicer:OpSlicer 0.286116 0.390937 0.485011 0.389567 0.0567739 10
reco:caldata:DataPrepModule 3.5311 3.65984 3.85103 3.63959 0.0878407 10
reco:wclsdatasp:WireCellToolkit 22.3158 23.0447 23.9525 23.0652 0.499986 10
reco:gaushit:GausHitFinder 0.478163 0.635965 0.894886 0.662899 0.119101 10
reco:nhitsfilter:NumberOfHitsFilter 0.000191646 0.000299356 0.000515834 0.000276433 8.36139e-05 10
reco:reco3d:SpacePointSolver 3.09519 10.7268 17.1644 10.9743 4.91953 10
reco:hitpdune:DisambigFromSpacePoints 0.448786 0.80629 1.34572 0.815689 0.283535 10
reco:pandora:StandardPandora 6.99052 14.9486 30.355 15.1416 6.68999 10
reco:pandoraWriter:StandardPandora 0.164194 0.232278 0.314421 0.224634 0.0477027 10
reco:pandoraTrack:LArPandoraTrackCreation 0.920133 1.61241 2.57541 1.62783 0.52438 10
reco:pandoraShower:LArPandoraShowerCreation 0.798631 1.66507 2.67255 1.59467 0.660741 10
reco:pandoracalo:Calorimetry 0.593434 0.988303 1.56855 0.953694 0.311284 10
reco:pandoracalonosce:Calorimetry 0.528477 0.901702 1.45944 0.875035 0.297073 10
reco:pandorapid:Chi2ParticleID 0.002248 0.00319904 0.00542146 0.00281911 0.000955475 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0223801 0.0287637 0.0367798 0.0286132 0.00518362 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00204399 0.00284608 0.00364278 0.00279827 0.000519284 10
reco:pandoraShowercalo:ShowerCalorimetry 0.821533 1.86226 3.0923 1.74259 0.811722 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.797651 1.80065 2.96084 1.70614 0.771177 10
reco:emtrkmichelid:EmTrackMichelId 74.2533 98.5742 134.504 96.9938 18.9022 10
reco:crttag:SingleCRTMatchingProducer 0.00401429 0.0128492 0.0616117 0.00667196 0.0165393 10
reco:crtreco:TwoCRTMatchingProducer 0.00315949 0.00429936 0.00650026 0.00411635 0.00104008 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.372206 0.54788 0.729939 0.549971 0.113857 10
reco:pandora2Track:LArPandoraTrackCreation 2.49656 5.02451 8.05851 4.76136 1.87638 10
reco:pandora2calo:Calorimetry 1.38126 2.7427 4.4148 2.61511 1.05516 10
reco:pandora2calonosce:Calorimetry 1.29947 2.58421 4.04989 2.44725 0.982947 10
reco:pandora2pid:Chi2ParticleID 0.00475828 0.00690144 0.009454 0.0070242 0.00145894 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0255819 0.0362927 0.0461886 0.0365386 0.00743619 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00456958 0.00658609 0.00855395 0.00686963 0.00135731 10
reco:pandora2Shower:LArPandoraShowerCreation 0.988773 1.88283 2.83278 1.82936 0.649778 10
reco:pandora2Showercalo:ShowerCalorimetry 1.21682 2.40441 3.69721 2.32514 0.909267 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.1153 2.25162 3.59082 2.15704 0.872336 10
[art]:TriggerResults:TriggerResultInserter 3.2222e-05 4.79373e-05 0.000116562 4.0642e-05 2.3646e-05 10
end_path:out1:RootOutput 4.709e-06 8.6857e-06 1.3045e-05 8.0555e-06 2.17749e-06 10
end_path:out1:RootOutput(write) 1.21586 1.8273 2.61896 1.74729 0.410252 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4792.82 MB
Peak resident set size usage (VmHWM): 3976.22 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 8963184
-rw-r--r-- 1 dunegli fnalgrid 2150125723 Nov 14 19:56 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2045949521 Nov 14 19:55 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1796522656 Nov 14 20:28 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1584117827 Nov 14 18:49 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1535884217 Nov 14 18:43 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 65018380 Nov 14 20:25 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242865 Nov 14 20:28 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 20:28 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 20:28 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 20:28 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 19:56 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 18:49 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 20:28 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 18:40 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 20:28 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 20:00 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 19:56 debugprod.log
