Jobsub ID 241093.0@dunegpschedd01.fnal.gov
| Jobsub ID | 241093.0@dunegpschedd01.fnal.gov |
| Workflow ID | 9484 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-30 18:27:58 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-10-30 21:20:52 |
| From worker node | Hostname | dunegli-7579704-0-fnpc9002.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-30 18:29:45 |
| Input files | monte-carlo-009484-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10250s) |
| CPU time | 2h (10136s = 98%) |
| Max RSS bytes | 4186599424 (3992 MiB) |
| Outputting started | 2025-10-30 21:20:35 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09484/1/001/reco_stage1.root
|
| Finished | 2025-10-30 21:20:52 |
| Saved logs | justin-logs:241093.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 105953 traces, 0 summary
Retagger: tagging trace set: gauss with 79769 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 79769 traces tagged "gauss"
FrameSaver: q=2.86616e+06 n=1407113 tag=gauss
wclsFrameSaver: saving 105953 traces tagged "wiener"
FrameSaver: q=3.05022e+06 n=1253376 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 19776 XUs and 28680 XVs -> 305 XUVs
C:0 T:1 58984 XUs and 60298 XVs -> 9296 XUVs
C:0 T:2 54543 XUs and 40152 XVs -> 2361 XUVs
C:0 T:3 22249 XUs and 16986 XVs -> 115 XUVs
C:0 T:5 39950 XUs and 31877 XVs -> 4605 XUVs
C:0 T:6 101511 XUs and 87629 XVs -> 5140 XUVs
C:0 T:7 42061 XUs and 36790 XVs -> 317 XUVs
C:0 T:8 6836 XUs and 7812 XVs -> 150 XUVs
C:0 T:9 47811 XUs and 65149 XVs -> 3709 XUVs
C:0 T:10 40525 XUs and 26614 XVs -> 4155 XUVs
C:0 T:11 102 XUs and 62 XVs -> 13 XUVs
30166 XUVs total
9381 collection wire objects
28182 potential space points
Neighbour search...
2624590 tests to find 1196614 neighbours
Iterating with no regularization...
Begin: 6.76636e+07
0 5.88953e+07
1 5.82206e+07
2 5.81199e+07
3 5.80945e+07
Now with regularization...
Begin: 4.87821e+07
0 4.87748e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410212056
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410212056
fLifetime: 30000 [us]
30-Oct-2025 21:20:33 UTC Closed output file "reco_stage1.root"
30-Oct-2025 21:20:33 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 263.321 358.397 454.125 363.876 65.7416 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000848985 0.00333893 0.00478383 0.0037492 0.00129325 10
reco:ophit:OpHitFinder 0.194423 0.24645 0.294287 0.25236 0.0355389 10
reco:opflash:OpFlashFinder 0.111836 0.166861 0.231114 0.174368 0.0386685 10
reco:opslicer:OpSlicer 0.42144 0.574229 0.721024 0.58796 0.0997978 10
reco:caldata:DataPrepModule 4.80615 5.08882 5.5014 4.92143 0.266031 10
reco:wclsdatasp:WireCellToolkit 37.4496 40.4236 44.5434 40.4855 2.08872 10
reco:gaushit:GausHitFinder 0.971736 1.2291 1.47891 1.28077 0.152005 10
reco:nhitsfilter:NumberOfHitsFilter 0.000242946 0.0003523 0.000528573 0.000366528 8.50776e-05 10
reco:reco3d:SpacePointSolver 7.72373 13.4344 18.9056 12.8349 3.97576 10
reco:hitpdune:DisambigFromSpacePoints 1.47189 2.33305 3.21472 2.35532 0.544318 10
reco:pandora:StandardPandora 29.4556 47.3778 105.616 40.2493 22.1301 10
reco:pandoraWriter:StandardPandora 0.306777 0.408273 0.498154 0.42055 0.069091 10
reco:pandoraTrack:LArPandoraTrackCreation 3.07502 4.52875 5.94347 4.67319 1.00382 10
reco:pandoraShower:LArPandoraShowerCreation 2.70995 4.59964 7.02017 4.8803 1.25229 10
reco:pandoracalo:Calorimetry 1.49488 2.40576 3.11231 2.62545 0.532715 10
reco:pandoracalonosce:Calorimetry 1.36337 2.22171 2.87379 2.44674 0.510688 10
reco:pandorapid:Chi2ParticleID 0.00462413 0.00592021 0.00817278 0.00576611 0.00100425 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0471485 0.0653717 0.0783336 0.0658926 0.0086695 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00419357 0.00542398 0.00656591 0.00577838 0.00080173 10
reco:pandoraShowercalo:ShowerCalorimetry 2.36208 4.94033 7.74489 5.29995 1.55715 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.25506 4.79444 7.51858 5.07105 1.51447 10
reco:emtrkmichelid:EmTrackMichelId 135.304 174.128 208.029 179.339 24.4939 10
reco:crttag:SingleCRTMatchingProducer 0.0115493 0.0185509 0.0253342 0.0180847 0.00391125 10
reco:crtreco:TwoCRTMatchingProducer 0.00763219 0.0103492 0.0137676 0.0107426 0.00169934 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.49105 1.76188 2.22471 1.68732 0.246507 10
reco:pandora2Track:LArPandoraTrackCreation 8.07156 14.4626 21.9888 14.889 3.97253 10
reco:pandora2calo:Calorimetry 3.56759 6.83658 10.3602 7.09921 1.96464 10
reco:pandora2calonosce:Calorimetry 3.50267 6.56 10.0317 6.86184 1.90123 10
reco:pandora2pid:Chi2ParticleID 0.0115045 0.013843 0.0171846 0.0133004 0.0017554 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0622518 0.0781604 0.0987645 0.0768831 0.00951014 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0105485 0.0131519 0.0166366 0.0128385 0.00188764 10
reco:pandora2Shower:LArPandoraShowerCreation 3.2121 5.16843 7.56543 5.312 1.32059 10
reco:pandora2Showercalo:ShowerCalorimetry 3.22938 6.15484 9.20984 6.4487 1.75826 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.9787 5.74974 8.51249 6.06415 1.63861 10
[art]:TriggerResults:TriggerResultInserter 3.5671e-05 5.19901e-05 0.000118963 4.57335e-05 2.25624e-05 10
end_path:out1:RootOutput 7.04e-06 8.7058e-06 1.3554e-05 8.178e-06 1.71663e-06 10
end_path:out1:RootOutput(write) 1.87393 2.52334 3.2748 2.61852 0.434697 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5000.28 MB
Peak resident set size usage (VmHWM): 4186.6 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9942636
-rw-r--r-- 1 dunegli fnalgrid 2352985882 Oct 30 20:18 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2229763910 Oct 30 20:16 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2054026215 Oct 30 21:20 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1771137985 Oct 30 18:46 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1693796920 Oct 30 18:34 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 78936020 Oct 30 21:17 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242842 Oct 30 21:20 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Oct 30 21:20 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Oct 30 21:20 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Oct 30 21:20 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 30 20:18 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 30 18:46 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 30 21:20 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Oct 30 18:29 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Oct 30 21:20 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 30 20:25 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 30 20:19 debugprod.log
