Jobsub ID 254561.0@dunegpschedd01.fnal.gov
| Jobsub ID | 254561.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10412 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-20 18:58:44 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-20 21:03:35 |
| From worker node | Hostname | dunegli-7831263-0-fnpc22033.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-20 19:19:48 |
| Input files | monte-carlo-010412-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5885s) |
| CPU time | 1h (5822s = 98%) |
| Max RSS bytes | 3802009600 (3625 MiB) |
| Outputting started | 2025-11-20 20:57:54 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10412/1/001/reco_stage1.root
|
| Finished | 2025-11-20 21:03:35 |
| Saved logs | justin-logs:254561.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
RawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 84105 traces, 0 summary
Retagger: tagging trace set: gauss with 63104 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 63104 traces tagged "gauss"
FrameSaver: q=2.13464e+06 n=1081509 tag=gauss
wclsFrameSaver: saving 84105 traces tagged "wiener"
FrameSaver: q=2.25686e+06 n=944429 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 30295 XUs and 32712 XVs -> 521 XUVs
C:0 T:1 56851 XUs and 57842 XVs -> 5317 XUVs
C:0 T:2 30093 XUs and 36879 XVs -> 1093 XUVs
C:0 T:3 15833 XUs and 16465 XVs -> 117 XUVs
C:0 T:4 8725 XUs and 9152 XVs -> 64 XUVs
C:0 T:5 28067 XUs and 23129 XVs -> 2262 XUVs
C:0 T:6 42040 XUs and 53221 XVs -> 2020 XUVs
C:0 T:7 17167 XUs and 23184 XVs -> 137 XUVs
C:0 T:8 2560 XUs and 3464 XVs -> 13 XUVs
C:0 T:9 15332 XUs and 23925 XVs -> 1957 XUVs
C:0 T:10 22436 XUs and 12272 XVs -> 2708 XUVs
C:0 T:11 99 XUs and 75 XVs -> 4 XUVs
16213 XUVs total
6726 collection wire objects
15016 potential space points
Neighbour search...
568852 tests to find 326798 neighbours
Iterating with no regularization...
Begin: 4.26587e+07
0 3.71928e+07
1 3.68309e+07
2 3.67797e+07
3 3.67645e+07
Now with regularization...
Begin: 3.07124e+07
0 3.07008e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410635061
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410635061
fLifetime: 30000 [us]
20-Nov-2025 20:57:53 UTC Closed output file "reco_stage1.root"
20-Nov-2025 20:57:53 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 129.862 169.042 253.008 158.748 35.5343 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000744133 0.00255678 0.00401142 0.0027782 0.00101018 10
reco:ophit:OpHitFinder 0.162812 0.176884 0.193523 0.173949 0.0103747 10
reco:opflash:OpFlashFinder 0.0851338 0.0983379 0.125126 0.0958554 0.0118819 10
reco:opslicer:OpSlicer 0.289335 0.364728 0.441838 0.348101 0.046413 10
reco:caldata:DataPrepModule 3.34571 3.45907 3.67492 3.42927 0.103113 10
reco:wclsdatasp:WireCellToolkit 22.311 23.4083 26.2054 23.0109 1.19142 10
reco:gaushit:GausHitFinder 0.433211 0.605315 0.723345 0.604306 0.0926678 10
reco:nhitsfilter:NumberOfHitsFilter 0.000217911 0.000343947 0.000460568 0.000336554 5.89321e-05 10
reco:reco3d:SpacePointSolver 2.76619 9.02913 37.8442 5.83065 9.7745 10
reco:hitpdune:DisambigFromSpacePoints 0.428663 0.72772 1.15271 0.681761 0.197188 10
reco:pandora:StandardPandora 6.48117 12.8174 21.1784 12.4447 4.15228 10
reco:pandoraWriter:StandardPandora 0.15186 0.209413 0.28461 0.206255 0.0360334 10
reco:pandoraTrack:LArPandoraTrackCreation 0.788339 1.47243 2.43134 1.51578 0.452481 10
reco:pandoraShower:LArPandoraShowerCreation 0.883802 1.48665 2.76312 1.1918 0.598214 10
reco:pandoracalo:Calorimetry 0.511518 0.892985 1.52594 0.892704 0.283831 10
reco:pandoracalonosce:Calorimetry 0.449042 0.822681 1.4734 0.814974 0.281874 10
reco:pandorapid:Chi2ParticleID 0.00202023 0.0029746 0.00388999 0.00293498 0.00051019 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0208636 0.0272116 0.0353046 0.0259394 0.00453347 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00187103 0.00264561 0.0034645 0.0026242 0.000452855 10
reco:pandoraShowercalo:ShowerCalorimetry 0.941018 1.64777 3.17286 1.22116 0.751715 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.905759 1.59671 3.05122 1.18955 0.718511 10
reco:emtrkmichelid:EmTrackMichelId 75.0337 92.8718 117.838 90.2747 13.8991 10
reco:crttag:SingleCRTMatchingProducer 0.00476874 0.00882229 0.0152347 0.00721015 0.00391688 10
reco:crtreco:TwoCRTMatchingProducer 0.00323871 0.00422877 0.00641909 0.0038973 0.000938628 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.337687 0.500441 0.810099 0.474276 0.129024 10
reco:pandora2Track:LArPandoraTrackCreation 2.46467 4.51988 8.43333 3.75799 1.75556 10
reco:pandora2calo:Calorimetry 1.35107 2.44877 4.5836 1.90564 1.00853 10
reco:pandora2calonosce:Calorimetry 1.26736 2.32481 4.5 1.81672 0.986176 10
reco:pandora2pid:Chi2ParticleID 0.00473118 0.0063184 0.00839124 0.00606227 0.00102016 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.025057 0.0327516 0.0449208 0.0288174 0.00650753 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00453383 0.0061123 0.00806343 0.00591813 0.000965441 10
reco:pandora2Shower:LArPandoraShowerCreation 0.969055 1.73501 3.17177 1.4501 0.648068 10
reco:pandora2Showercalo:ShowerCalorimetry 1.16932 2.1445 3.99231 1.67241 0.884682 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.08603 1.99993 3.77929 1.55685 0.839527 10
[art]:TriggerResults:TriggerResultInserter 3.5126e-05 4.79314e-05 0.000135997 3.77215e-05 2.94744e-05 10
end_path:out1:RootOutput 7.574e-06 1.25915e-05 1.8304e-05 1.2834e-05 3.05817e-06 10
end_path:out1:RootOutput(write) 1.1184 1.54013 2.09457 1.43981 0.290123 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4608.7 MB
Peak resident set size usage (VmHWM): 3802.01 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 8479136
-rw-r--r-- 1 dunegli fnalgrid 2059162619 Nov 20 20:28 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1955999077 Nov 20 20:27 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1693210913 Nov 20 20:57 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1485518721 Nov 20 19:27 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1426203933 Nov 20 19:22 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 61923530 Nov 20 20:56 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242619 Nov 20 20:57 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 20 20:57 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 20 20:57 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 20 20:57 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 20 20:28 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 20 19:27 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 20 20:57 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 20 19:19 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 20 20:57 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 20 20:31 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 20 20:28 debugprod.log
