Jobsub ID 249112.1@dunegpschedd01.fnal.gov
| Jobsub ID | 249112.1@dunegpschedd01.fnal.gov |
| Workflow ID | 10161 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-13 19:32:50 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 04:02:54 |
| From worker node | Hostname | dunegli-7743933-0-fnpc23015.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 01:55:22 |
| Input files | monte-carlo-010161-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7638s) |
| CPU time | 2h (7532s = 98%) |
| Max RSS bytes | 4221927424 (4026 MiB) |
| Outputting started | 2025-11-14 04:02:41 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10161/1/001/reco_stage1.root
|
| Finished | 2025-11-14 04:02:54 |
| Saved logs | justin-logs:249112.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
lBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 129965 traces, 0 summary
Retagger: tagging trace set: gauss with 98341 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 98341 traces tagged "gauss"
FrameSaver: q=3.24023e+06 n=1741429 tag=gauss
wclsFrameSaver: saving 129965 traces tagged "wiener"
FrameSaver: q=3.42568e+06 n=1523778 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 37056 XUs and 34746 XVs -> 462 XUVs
C:0 T:1 89754 XUs and 100570 XVs -> 12480 XUVs
C:0 T:2 78439 XUs and 139562 XVs -> 6435 XUVs
C:0 T:3 36158 XUs and 51135 XVs -> 371 XUVs
C:0 T:4 11960 XUs and 10125 XVs -> 82 XUVs
C:0 T:5 56393 XUs and 55871 XVs -> 7639 XUVs
C:0 T:6 67052 XUs and 66036 XVs -> 3995 XUVs
C:0 T:7 24550 XUs and 24889 XVs -> 212 XUVs
C:0 T:8 8744 XUs and 8583 XVs -> 124 XUVs
C:0 T:9 58445 XUs and 75490 XVs -> 5333 XUVs
C:0 T:10 57500 XUs and 28636 XVs -> 4669 XUVs
C:0 T:11 440 XUs and 271 XVs -> 39 XUVs
41841 XUVs total
12685 collection wire objects
38399 potential space points
Neighbour search...
4808195 tests to find 2271244 neighbours
Iterating with no regularization...
Begin: 7.17104e+07
0 5.57509e+07
1 5.47962e+07
2 5.46688e+07
3 5.4628e+07
Now with regularization...
Begin: 4.56744e+07
0 4.56339e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
run: 1 ; subrun: 0 ; event: 10
evttime: 410494864
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410494864
fLifetime: 30000 [us]
14-Nov-2025 04:02:40 UTC Closed output file "reco_stage1.root"
14-Nov-2025 04:02:40 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 140.865 222.494 332.996 212.8 49.0705 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000726333 0.00277012 0.00438839 0.0028368 0.00118232 10
reco:ophit:OpHitFinder 0.183783 0.215019 0.266649 0.208737 0.0235285 10
reco:opflash:OpFlashFinder 0.10065 0.133616 0.186128 0.133218 0.024171 10
reco:opslicer:OpSlicer 0.390802 0.47786 0.638214 0.453011 0.0766217 10
reco:caldata:DataPrepModule 3.52422 3.67499 3.97495 3.6526 0.110963 10
reco:wclsdatasp:WireCellToolkit 23.0998 23.7708 25.1174 23.7053 0.529467 10
reco:gaushit:GausHitFinder 0.513277 0.78739 1.01429 0.805287 0.13132 10
reco:nhitsfilter:NumberOfHitsFilter 0.000209279 0.000335111 0.000498931 0.000316959 7.55361e-05 10
reco:reco3d:SpacePointSolver 5.27269 10.4136 21.9491 9.40373 4.41425 10
reco:hitpdune:DisambigFromSpacePoints 0.547316 1.11624 2.0235 1.09011 0.362346 10
reco:pandora:StandardPandora 7.81354 23.5963 44.369 20.9032 11.0693 10
reco:pandoraWriter:StandardPandora 0.165087 0.273298 0.384132 0.262915 0.0626791 10
reco:pandoraTrack:LArPandoraTrackCreation 1.35767 2.23457 3.67661 1.96394 0.734676 10
reco:pandoraShower:LArPandoraShowerCreation 0.964305 2.43968 4.81634 2.27438 0.951756 10
reco:pandoracalo:Calorimetry 0.789472 1.35652 2.13881 1.22428 0.390572 10
reco:pandoracalonosce:Calorimetry 0.720584 1.25324 1.99054 1.12693 0.37015 10
reco:pandorapid:Chi2ParticleID 0.00305809 0.00376649 0.00571077 0.00350202 0.000733821 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0234179 0.0336136 0.0422951 0.0327291 0.00470543 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00281093 0.00337152 0.00446808 0.00320714 0.000559217 10
reco:pandoraShowercalo:ShowerCalorimetry 0.990082 2.75248 5.33387 2.64315 1.05124 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.9727 2.69403 5.25352 2.58688 1.03735 10
reco:emtrkmichelid:EmTrackMichelId 80.6656 118.177 161.031 115.07 20.025 10
reco:crttag:SingleCRTMatchingProducer 0.00436745 0.00904827 0.0152135 0.00824619 0.00294876 10
reco:crtreco:TwoCRTMatchingProducer 0.00348454 0.00524716 0.00669757 0.00540807 0.000835972 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.321087 0.612738 0.917402 0.597385 0.150574 10
reco:pandora2Track:LArPandoraTrackCreation 3.21102 7.18249 13.5706 6.52971 2.62979 10
reco:pandora2calo:Calorimetry 1.70975 3.93334 7.14468 3.6936 1.34596 10
reco:pandora2calonosce:Calorimetry 1.60611 3.77157 6.92529 3.5308 1.31709 10
reco:pandora2pid:Chi2ParticleID 0.00591891 0.00840938 0.0112679 0.00804217 0.00143935 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0260493 0.0415327 0.0570623 0.0401418 0.00755835 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0057219 0.00813323 0.0111298 0.00781078 0.00144507 10
reco:pandora2Shower:LArPandoraShowerCreation 1.27246 2.72153 5.10254 2.48026 0.970588 10
reco:pandora2Showercalo:ShowerCalorimetry 1.49877 3.49854 6.42453 3.25646 1.21918 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.41482 3.23907 5.90213 3.02347 1.11305 10
[art]:TriggerResults:TriggerResultInserter 2.7152e-05 4.2517e-05 9.8838e-05 3.67205e-05 1.9465e-05 10
end_path:out1:RootOutput 6.933e-06 8.5774e-06 1.2324e-05 8.3155e-06 1.43285e-06 10
end_path:out1:RootOutput(write) 1.32202 1.99188 2.83578 1.9219 0.372767 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5034.56 MB
Peak resident set size usage (VmHWM): 4221.93 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9922208
-rw-r--r-- 1 dunegli fnalgrid 2351104598 Nov 14 03:24 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2232910160 Nov 14 03:23 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2042632364 Nov 14 04:02 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1762010557 Nov 14 02:05 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1694440288 Nov 14 01:58 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 76622390 Nov 14 04:00 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243056 Nov 14 04:02 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 04:02 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 04:02 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 04:02 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 03:24 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 02:05 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 04:02 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 01:55 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 04:02 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 03:28 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 03:24 debugprod.log
