Jobsub ID 253288.0@dunegpschedd01.fnal.gov
| Jobsub ID | 253288.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10291 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-17 13:30:08 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-17 17:05:07 |
| From worker node | Hostname | dunegli-7633259-0-fnpc19133.fnal.gov |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-17 13:31:31 |
| Input files | monte-carlo-010291-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12777s) |
| CPU time | 2h (10595s = 82%) |
| Max RSS bytes | 4148826112 (3956 MiB) |
| Outputting started | 2025-11-17 17:04:28 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10291/1/001/reco_stage1.root
|
| Finished | 2025-11-17 17:05:07 |
| Saved logs | justin-logs:253288.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
e:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 97962 traces, 0 summary
Retagger: tagging trace set: gauss with 74461 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 74461 traces tagged "gauss"
FrameSaver: q=2.40964e+06 n=1313029 tag=gauss
wclsFrameSaver: saving 97962 traces tagged "wiener"
FrameSaver: q=2.54757e+06 n=1151067 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 17456 XUs and 14073 XVs -> 77 XUVs
C:0 T:1 27774 XUs and 24891 XVs -> 1320 XUVs
C:0 T:2 84097 XUs and 92019 XVs -> 5518 XUVs
C:0 T:3 40688 XUs and 36844 XVs -> 530 XUVs
C:0 T:4 8766 XUs and 7060 XVs -> 38 XUVs
C:0 T:5 26787 XUs and 18426 XVs -> 1768 XUVs
C:0 T:6 143285 XUs and 134241 XVs -> 9515 XUVs
C:0 T:7 52301 XUs and 48472 XVs -> 620 XUVs
C:0 T:8 6293 XUs and 4986 XVs -> 44 XUVs
C:0 T:9 35789 XUs and 40216 XVs -> 3372 XUVs
C:0 T:10 14760 XUs and 73368 XVs -> 4538 XUVs
C:0 T:11 171 XUs and 159 XVs -> 23 XUVs
27363 XUVs total
9426 collection wire objects
24864 potential space points
Neighbour search...
1938906 tests to find 1019404 neighbours
Iterating with no regularization...
Begin: 5.11081e+07
0 3.5575e+07
1 3.50315e+07
2 3.49374e+07
3 3.49048e+07
Now with regularization...
Begin: 2.87401e+07
0 2.87292e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410567205
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410567205
fLifetime: 30000 [us]
17-Nov-2025 17:04:26 UTC Closed output file "reco_stage1.root"
17-Nov-2025 17:04:26 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 273.548 488.435 1152.37 424.293 234.534 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000725166 0.0040807 0.00767544 0.00426612 0.00201626 10
reco:ophit:OpHitFinder 0.263737 0.371284 0.575691 0.315356 0.106947 10
reco:opflash:OpFlashFinder 0.13178 0.210564 0.362605 0.17255 0.0766435 10
reco:opslicer:OpSlicer 0.566812 0.787207 0.985864 0.766223 0.125496 10
reco:caldata:DataPrepModule 4.9373 6.76622 10.4704 5.82552 1.86221 10
reco:wclsdatasp:WireCellToolkit 30.2833 48.9061 77.7891 44.1039 15.3273 10
reco:gaushit:GausHitFinder 0.995143 1.70394 2.57389 1.56803 0.527501 10
reco:nhitsfilter:NumberOfHitsFilter 0.000486054 0.000566551 0.000707286 0.000533604 7.5853e-05 10
reco:reco3d:SpacePointSolver 13.3906 21.1377 43.039 17.0837 9.71154 10
reco:hitpdune:DisambigFromSpacePoints 1.21859 3.14567 14.41 1.89714 3.79098 10
reco:pandora:StandardPandora 21.8898 68.3246 327.571 40.8841 87.7408 10
reco:pandoraWriter:StandardPandora 0.316299 1.23291 7.82133 0.498702 2.2001 10
reco:pandoraTrack:LArPandoraTrackCreation 1.8035 10.4707 62.1554 4.87992 17.3809 10
reco:pandoraShower:LArPandoraShowerCreation 1.79779 6.82246 16.553 5.05574 4.30412 10
reco:pandoracalo:Calorimetry 0.9885 3.0332 5.94413 2.54103 1.60631 10
reco:pandoracalonosce:Calorimetry 0.859054 2.30067 4.28356 1.79553 1.0152 10
reco:pandorapid:Chi2ParticleID 0.00401036 0.00609174 0.0102692 0.00556863 0.0016625 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0409114 0.0691819 0.109072 0.0628099 0.0210729 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00399101 0.0063861 0.0165371 0.00521642 0.00349541 10
reco:pandoraShowercalo:ShowerCalorimetry 1.94413 5.33454 9.0318 5.03505 2.14538 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.08387 5.59209 12.5189 5.20128 2.76973 10
reco:emtrkmichelid:EmTrackMichelId 147.436 254.593 550.598 214.237 106.647 10
reco:crttag:SingleCRTMatchingProducer 0.00802681 0.018172 0.0314463 0.0170573 0.00690024 10
reco:crtreco:TwoCRTMatchingProducer 0.00577415 0.00932544 0.0162303 0.00809091 0.00341992 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.610665 0.959267 1.36946 0.933946 0.251979 10
reco:pandora2Track:LArPandoraTrackCreation 5.82315 13.438 22.9716 14.1518 4.91062 10
reco:pandora2calo:Calorimetry 2.63495 6.4172 9.58504 6.63545 2.10059 10
reco:pandora2calonosce:Calorimetry 2.45117 6.64636 10.4287 6.76511 2.54652 10
reco:pandora2pid:Chi2ParticleID 0.00992491 0.0173119 0.0262653 0.0159006 0.00546451 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0509382 0.0921147 0.18485 0.0852555 0.0377744 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0101221 0.0197883 0.0509499 0.0147071 0.0115453 10
reco:pandora2Shower:LArPandoraShowerCreation 2.18867 5.57814 8.78697 5.68101 2.13609 10
reco:pandora2Showercalo:ShowerCalorimetry 2.23129 5.59833 7.73367 6.32932 1.83966 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.05845 4.89065 7.15999 5.11009 1.59502 10
[art]:TriggerResults:TriggerResultInserter 4.3871e-05 6.40397e-05 0.000106191 6.0065e-05 1.73264e-05 10
end_path:out1:RootOutput 9.83e-06 1.27302e-05 1.815e-05 1.16e-05 2.50139e-06 10
end_path:out1:RootOutput(write) 2.32444 3.59563 5.33195 3.56037 0.868891 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4957.54 MB
Peak resident set size usage (VmHWM): 4148.83 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10073308
-rw-r--r-- 1 dunegli fnalgrid 2371993544 Nov 17 15:40 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2256893762 Nov 17 15:38 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2050808611 Nov 17 17:04 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1817862457 Nov 17 13:57 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1744353024 Nov 17 13:45 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 72535230 Nov 17 17:01 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243038 Nov 17 17:04 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 17 17:04 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 17 17:04 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 17 17:04 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 17 15:40 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 17 13:57 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 17 17:04 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 17 13:41 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 17 17:04 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 17 15:46 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 17 15:40 debugprod.log
