Jobsub ID 249111.0@dunegpschedd01.fnal.gov
| Jobsub ID | 249111.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10160 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-13 19:32:50 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 02:59:37 |
| From worker node | Hostname | dunegli-7743975-0-fnpc23031.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 01:01:31 |
| Input files | monte-carlo-010160-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6954s) |
| CPU time | 1h (6474s = 93%) |
| Max RSS bytes | 4026679296 (3840 MiB) |
| Outputting started | 2025-11-14 02:57:26 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10160/1/001/reco_stage1.root
|
| Finished | 2025-11-14 02:59:37 |
| Saved logs | justin-logs:249111.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
Service:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 127939 traces, 0 summary
Retagger: tagging trace set: gauss with 98571 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 98571 traces tagged "gauss"
FrameSaver: q=3.33576e+06 n=1702613 tag=gauss
wclsFrameSaver: saving 127939 traces tagged "wiener"
FrameSaver: q=3.51441e+06 n=1499069 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 30485 XUs and 25646 XVs -> 181 XUVs
C:0 T:1 52994 XUs and 46301 XVs -> 3066 XUVs
C:0 T:2 60163 XUs and 79262 XVs -> 2558 XUVs
C:0 T:3 34281 XUs and 35706 XVs -> 238 XUVs
C:0 T:4 11895 XUs and 9843 XVs -> 308 XUVs
C:0 T:5 47553 XUs and 28760 XVs -> 4968 XUVs
C:0 T:6 100275 XUs and 118513 XVs -> 4347 XUVs
C:0 T:7 41373 XUs and 50592 XVs -> 360 XUVs
C:0 T:8 9282 XUs and 7527 XVs -> 70 XUVs
C:0 T:9 60789 XUs and 61230 XVs -> 4272 XUVs
C:0 T:10 25564 XUs and 21115 XVs -> 2627 XUVs
C:0 T:11 205 XUs and 126 XVs -> 21 XUVs
23016 XUVs total
10441 collection wire objects
21327 potential space points
Neighbour search...
1113185 tests to find 550474 neighbours
Iterating with no regularization...
Begin: 6.41659e+07
0 5.52381e+07
1 5.47406e+07
2 5.46833e+07
3 5.46705e+07
Now with regularization...
Begin: 4.55662e+07
0 4.5566e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410494876
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410494876
fLifetime: 30000 [us]
14-Nov-2025 02:57:25 UTC Closed output file "reco_stage1.root"
14-Nov-2025 02:57:25 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 146.828 180.101 229.727 175.23 25.1161 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000890074 0.00273358 0.0043397 0.0028608 0.00107755 10
reco:ophit:OpHitFinder 0.17116 0.190733 0.220533 0.185868 0.0155791 10
reco:opflash:OpFlashFinder 0.0957979 0.116565 0.153737 0.114484 0.0161666 10
reco:opslicer:OpSlicer 0.338319 0.393868 0.473004 0.389174 0.0449752 10
reco:caldata:DataPrepModule 3.28657 3.3838 3.61484 3.34958 0.0940151 10
reco:wclsdatasp:WireCellToolkit 20.8988 21.7444 22.6918 21.6868 0.538942 10
reco:gaushit:GausHitFinder 0.535017 0.640335 0.847955 0.618679 0.0887426 10
reco:nhitsfilter:NumberOfHitsFilter 0.000251371 0.000341558 0.00058518 0.000286268 0.000111926 10
reco:reco3d:SpacePointSolver 3.98693 8.95299 20.6768 7.7675 4.35171 10
reco:hitpdune:DisambigFromSpacePoints 0.650816 0.825498 1.24784 0.751087 0.18114 10
reco:pandora:StandardPandora 10.0379 14.1375 23.0036 12.2836 3.71701 10
reco:pandoraWriter:StandardPandora 0.176423 0.217571 0.267253 0.213956 0.0335846 10
reco:pandoraTrack:LArPandoraTrackCreation 1.14175 1.68067 2.46577 1.56986 0.436481 10
reco:pandoraShower:LArPandoraShowerCreation 1.31513 1.87273 2.68511 1.8952 0.40672 10
reco:pandoracalo:Calorimetry 0.694477 1.02522 1.50915 0.958844 0.269525 10
reco:pandoracalonosce:Calorimetry 0.6244 0.942608 1.41324 0.87992 0.259481 10
reco:pandorapid:Chi2ParticleID 0.00254221 0.00308799 0.00499005 0.00267102 0.000744251 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0237 0.0280954 0.0350827 0.0272486 0.00361533 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00240292 0.00272259 0.00350261 0.00255534 0.000363093 10
reco:pandoraShowercalo:ShowerCalorimetry 1.35127 2.07944 3.03571 2.16777 0.535813 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.30808 2.02461 3.00816 2.09784 0.532497 10
reco:emtrkmichelid:EmTrackMichelId 83.7595 99.3537 123.518 96.3044 11.7603 10
reco:crttag:SingleCRTMatchingProducer 0.00451579 0.00697858 0.0127258 0.00614559 0.00221991 10
reco:crtreco:TwoCRTMatchingProducer 0.00355802 0.00428144 0.0056883 0.00399951 0.000718285 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.364821 0.491265 0.718007 0.491366 0.0990199 10
reco:pandora2Track:LArPandoraTrackCreation 3.7906 5.37947 7.85312 5.35262 1.22752 10
reco:pandora2calo:Calorimetry 1.94257 2.92772 4.34179 2.97722 0.739455 10
reco:pandora2calonosce:Calorimetry 1.84177 2.79112 4.14293 2.85271 0.710568 10
reco:pandora2pid:Chi2ParticleID 0.00603513 0.00705805 0.00898027 0.00683391 0.000851852 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0279752 0.0344302 0.0447655 0.0340529 0.00517811 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0059861 0.00691913 0.00895639 0.00678399 0.00085216 10
reco:pandora2Shower:LArPandoraShowerCreation 1.46087 2.06591 2.83525 2.11646 0.419605 10
reco:pandora2Showercalo:ShowerCalorimetry 1.71174 2.60347 3.78747 2.68687 0.656411 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.62141 2.43372 3.47444 2.52411 0.600757 10
[art]:TriggerResults:TriggerResultInserter 2.2723e-05 6.27802e-05 0.000363756 3.11745e-05 0.000100476 10
end_path:out1:RootOutput 9.95e-06 1.2586e-05 2.0208e-05 1.2193e-05 2.79074e-06 10
end_path:out1:RootOutput(write) 1.40105 1.68414 2.09737 1.61177 0.213315 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4839.83 MB
Peak resident set size usage (VmHWM): 4026.68 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9353956
-rw-r--r-- 1 dunegli fnalgrid 2229868710 Nov 14 02:26 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2117853511 Nov 14 02:25 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1891072411 Nov 14 02:57 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1670501418 Nov 14 01:17 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1599941996 Nov 14 01:10 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 68583480 Nov 14 02:55 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242844 Nov 14 02:57 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 02:57 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 02:57 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 02:57 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 02:26 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 01:17 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 02:57 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 01:01 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 02:57 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 02:29 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 02:26 debugprod.log
