Jobsub ID 254795.0@dunegpschedd01.fnal.gov
| Jobsub ID | 254795.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10449 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-21 10:38:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-21 18:22:26 |
| From worker node | Hostname | dunegli-7677187-0-fnpc18001.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-21 10:39:06 |
| Input files | monte-carlo-010449-000001
|
| Jobscript | Exit code | 0 |
| Real time | 7h (26247s) |
| CPU time | 6h (24815s = 94%) |
| Max RSS bytes | 4063457280 (3875 MiB) |
| Outputting started | 2025-11-21 17:56:34 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10449/1/001/reco_stage1.root
|
| Finished | 2025-11-21 18:22:26 |
| Saved logs | justin-logs:254795.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
lFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 113282 traces, 0 summary
Retagger: tagging trace set: gauss with 88323 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88323 traces tagged "gauss"
FrameSaver: q=3.19507e+06 n=1596831 tag=gauss
wclsFrameSaver: saving 113282 traces tagged "wiener"
FrameSaver: q=3.37492e+06 n=1418433 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 20258 XUs and 17168 XVs -> 206 XUVs
C:0 T:1 29406 XUs and 27746 XVs -> 1977 XUVs
C:0 T:2 145265 XUs and 139977 XVs -> 7594 XUVs
C:0 T:3 63414 XUs and 50450 XVs -> 409 XUVs
C:0 T:4 11257 XUs and 14669 XVs -> 81 XUVs
C:0 T:5 44207 XUs and 44720 XVs -> 3935 XUVs
C:0 T:6 124969 XUs and 99935 XVs -> 8676 XUVs
C:0 T:8 5373 XUs and 4574 XVs -> 74 XUVs
C:0 T:9 27509 XUs and 36918 XVs -> 2535 XUVs
C:0 T:10 31752 XUs and 22275 XVs -> 3972 XUVs
C:0 T:11 230 XUs and 231 XVs -> 69 XUVs
29528 XUVs total
10997 collection wire objects
26236 potential space points
Neighbour search...
1765188 tests to find 751772 neighbours
Iterating with no regularization...
Begin: 6.68832e+07
0 5.34927e+07
1 5.25438e+07
2 5.24146e+07
3 5.2379e+07
Now with regularization...
Begin: 4.19315e+07
0 4.18615e+07
1 4.18404e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410648361
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410648361
fLifetime: 30000 [us]
21-Nov-2025 17:47:37 UTC Closed output file "reco_stage1.root"
21-Nov-2025 17:47:37 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 382.138 647.788 832.489 670.309 149.886 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00290493 0.00506894 0.00717275 0.00564586 0.0014441 10
reco:ophit:OpHitFinder 0.317475 0.400852 0.460138 0.407893 0.0431736 10
reco:opflash:OpFlashFinder 0.169803 0.276248 0.611038 0.228019 0.126963 10
reco:opslicer:OpSlicer 0.834007 1.09961 1.48921 1.0895 0.177277 10
reco:caldata:DataPrepModule 6.64318 8.58287 11.0863 8.85852 1.52458 10
reco:wclsdatasp:WireCellToolkit 43.1169 56.2852 81.2574 57.5645 10.4367 10
reco:gaushit:GausHitFinder 1.19851 1.90484 2.81884 1.85007 0.458645 10
reco:nhitsfilter:NumberOfHitsFilter 0.000649184 0.00103671 0.00139159 0.00104953 0.000207629 10
reco:reco3d:SpacePointSolver 11.3831 22.0704 28.5013 24.7499 6.22168 10
reco:hitpdune:DisambigFromSpacePoints 1.23112 2.45085 3.64962 2.62732 0.718977 10
reco:pandora:StandardPandora 35.8023 64.8545 100.308 62.6107 21.2561 10
reco:pandoraWriter:StandardPandora 0.51298 0.746504 0.977618 0.710723 0.13528 10
reco:pandoraTrack:LArPandoraTrackCreation 6.67739 12.0906 16.048 11.9271 3.01445 10
reco:pandoraShower:LArPandoraShowerCreation 6.81561 13.357 20.5923 13.8513 3.79087 10
reco:pandoracalo:Calorimetry 3.19735 6.70056 8.24552 7.27989 1.69409 10
reco:pandoracalonosce:Calorimetry 3.22214 6.21064 7.57096 6.84584 1.50573 10
reco:pandorapid:Chi2ParticleID 0.0073936 0.0104357 0.0140868 0.0103372 0.00211249 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0560149 0.0904932 0.135119 0.0889512 0.0281872 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00703316 0.00984738 0.0122584 0.00983334 0.00180534 10
reco:pandoraShowercalo:ShowerCalorimetry 6.00409 13.3837 23.6823 13.4065 5.05285 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.8194 13.0865 22.955 13.6036 5.36859 10
reco:emtrkmichelid:EmTrackMichelId 193.332 307.92 409.632 331.073 77.9426 10
reco:crttag:SingleCRTMatchingProducer 0.020831 0.0379483 0.0523514 0.0377313 0.0103582 10
reco:crtreco:TwoCRTMatchingProducer 0.0158703 0.0274137 0.038979 0.0296988 0.00805919 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.851027 1.45486 1.94628 1.49899 0.372128 10
reco:pandora2Track:LArPandoraTrackCreation 15.8132 34.7776 54.0666 36.2023 10.5697 10
reco:pandora2calo:Calorimetry 7.07762 17.8809 31.0574 17.1868 6.56576 10
reco:pandora2calonosce:Calorimetry 6.00878 17.1542 29.2102 16.848 6.69303 10
reco:pandora2pid:Chi2ParticleID 0.0156971 0.0244837 0.0420242 0.0216656 0.00798564 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0645569 0.110593 0.189011 0.0886025 0.042887 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0149423 0.0228085 0.0366224 0.020502 0.0064694 10
reco:pandora2Shower:LArPandoraShowerCreation 6.45098 12.6066 21.7354 12.715 4.16611 10
reco:pandora2Showercalo:ShowerCalorimetry 5.40742 14.0627 25.6202 14.4475 5.70037 10
reco:pandora2Showercalonosce:ShowerCalorimetry 5.04619 13.4609 31.8869 13.2497 7.20042 10
[art]:TriggerResults:TriggerResultInserter 6.4942e-05 0.000111293 0.000317489 7.91495e-05 7.44351e-05 10
end_path:out1:RootOutput 1.2413e-05 1.68156e-05 2.8614e-05 1.5354e-05 4.41112e-06 10
end_path:out1:RootOutput(write) 2.6612 4.3503 7.06764 4.1259 1.23927 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4878.78 MB
Peak resident set size usage (VmHWM): 4063.46 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.36 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.40 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9621288
-rw-r--r-- 1 dunegli fnalgrid 2292325141 Nov 21 15:54 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2177209867 Nov 21 15:48 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1977830306 Nov 21 17:47 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1707783040 Nov 21 11:36 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1621660860 Nov 21 10:52 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 74771640 Nov 21 17:39 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242863 Nov 21 17:47 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 21 17:47 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 21 17:47 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 21 17:47 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 15:54 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 11:36 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 17:47 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 21 10:39 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 21 17:47 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 16:05 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 15:54 debugprod.log
