Jobsub ID 232181.1@dunegpschedd02.fnal.gov
| Jobsub ID | 232181.1@dunegpschedd02.fnal.gov |
| Workflow ID | 9277 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-22 21:28:56 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-10-23 02:06:40 |
| From worker node | Hostname | dunegli-7312581-0-fnpc8001.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-22 21:29:42 |
| Input files | monte-carlo-009277-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16595s) |
| CPU time | 4h (16023s = 96%) |
| Max RSS bytes | 4506337280 (4297 MiB) |
| Outputting started | 2025-10-23 02:06:18 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09277/1/001/reco_stage1.root
|
| Finished | 2025-10-23 02:06:40 |
| Saved logs | justin-logs:232181.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 137132 traces, 0 summary
Retagger: tagging trace set: gauss with 103846 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 103846 traces tagged "gauss"
FrameSaver: q=3.61557e+06 n=1824656 tag=gauss
wclsFrameSaver: saving 137132 traces tagged "wiener"
FrameSaver: q=3.83709e+06 n=1622074 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 48994 XUs and 39729 XVs -> 1312 XUVs
C:0 T:1 101842 XUs and 85737 XVs -> 15559 XUVs
C:0 T:2 76255 XUs and 109382 XVs -> 7165 XUVs
C:0 T:3 35588 XUs and 41742 XVs -> 188 XUVs
C:0 T:4 8955 XUs and 7460 XVs -> 77 XUVs
C:0 T:5 28903 XUs and 17977 XVs -> 3826 XUVs
C:0 T:6 80815 XUs and 78886 XVs -> 3359 XUVs
C:0 T:7 37982 XUs and 34569 XVs -> 420 XUVs
C:0 T:8 10116 XUs and 7991 XVs -> 206 XUVs
C:0 T:9 75958 XUs and 78703 XVs -> 8496 XUVs
C:0 T:10 46349 XUs and 27000 XVs -> 4001 XUVs
C:0 T:11 263 XUs and 174 XVs -> 14 XUVs
44623 XUVs total
11588 collection wire objects
40228 potential space points
Neighbour search...
4653850 tests to find 2359476 neighbours
Iterating with no regularization...
Begin: 8.18617e+07
0 7.11101e+07
1 7.03396e+07
2 7.0219e+07
3 7.01808e+07
Now with regularization...
Begin: 5.93208e+07
0 5.92711e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410053954
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410053954
fLifetime: 30000 [us]
23-Oct-2025 02:06:15 UTC Closed output file "reco_stage1.root"
23-Oct-2025 02:06:15 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 329.692 490.287 671.485 460.14 102.358 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000995362 0.00402664 0.00777 0.0040615 0.00211772 10
reco:ophit:OpHitFinder 0.255331 0.325108 0.382774 0.330613 0.033015 10
reco:opflash:OpFlashFinder 0.153735 0.237612 0.327027 0.238492 0.0478599 10
reco:opslicer:OpSlicer 0.561195 0.858314 1.00182 0.866391 0.120336 10
reco:caldata:DataPrepModule 6.02732 6.30799 6.52213 6.29088 0.143563 10
reco:wclsdatasp:WireCellToolkit 45.972 60.7763 67.4705 63.1812 7.07922 10
reco:gaushit:GausHitFinder 1.23825 1.83468 2.23972 1.75825 0.313016 10
reco:nhitsfilter:NumberOfHitsFilter 0.000445638 0.00067432 0.000877777 0.000671378 0.000113645 10
reco:reco3d:SpacePointSolver 9.2674 19.025 33.1265 16.8782 7.42351 10
reco:hitpdune:DisambigFromSpacePoints 1.78878 3.20993 4.81009 2.85424 0.890411 10
reco:pandora:StandardPandora 26.2964 59.9002 92.6173 51.6302 22.8465 10
reco:pandoraWriter:StandardPandora 0.381656 0.541751 0.716161 0.508115 0.0958258 10
reco:pandoraTrack:LArPandoraTrackCreation 3.30505 7.07023 11.5921 6.52856 2.34243 10
reco:pandoraShower:LArPandoraShowerCreation 2.97551 7.3557 14.7254 6.25851 3.20373 10
reco:pandoracalo:Calorimetry 1.82934 3.54446 6.2103 3.2173 1.18327 10
reco:pandoracalonosce:Calorimetry 1.62616 3.26822 5.75826 3.12866 1.1079 10
reco:pandorapid:Chi2ParticleID 0.00573258 0.00752738 0.00975535 0.00734198 0.00108602 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0633427 0.0860515 0.121553 0.0831499 0.0156445 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00556112 0.00718848 0.00974075 0.00717678 0.00106739 10
reco:pandoraShowercalo:ShowerCalorimetry 3.00618 7.43425 13.5968 6.93337 2.80889 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.90852 7.3682 14.1026 6.75311 2.95081 10
reco:emtrkmichelid:EmTrackMichelId 167.393 228.5 298.921 216.414 37.6151 10
reco:crttag:SingleCRTMatchingProducer 0.0163046 0.0213147 0.0272658 0.020915 0.00319313 10
reco:crtreco:TwoCRTMatchingProducer 0.0101022 0.0136731 0.019109 0.0138196 0.00257495 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.61618 2.10435 2.94207 2.06775 0.359803 10
reco:pandora2Track:LArPandoraTrackCreation 10.2716 22.7829 41.267 20.7017 8.20596 10
reco:pandora2calo:Calorimetry 4.68192 10.1448 17.5438 9.61078 3.40989 10
reco:pandora2calonosce:Calorimetry 4.36427 9.58281 16.531 9.08235 3.21538 10
reco:pandora2pid:Chi2ParticleID 0.0124044 0.0188812 0.0275983 0.0182733 0.00375454 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0752451 0.10977 0.15401 0.104027 0.0215228 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0120276 0.0184399 0.0265654 0.0176185 0.00362049 10
reco:pandora2Shower:LArPandoraShowerCreation 3.50323 7.4519 12.4411 6.97991 2.41137 10
reco:pandora2Showercalo:ShowerCalorimetry 3.99931 8.84065 14.7807 8.48539 2.86618 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.69231 8.09039 13.6556 7.82261 2.63107 10
[art]:TriggerResults:TriggerResultInserter 4.3598e-05 6.18368e-05 0.000130891 5.5512e-05 2.35395e-05 10
end_path:out1:RootOutput 7.384e-06 1.04495e-05 1.4572e-05 1.06305e-05 1.83295e-06 10
end_path:out1:RootOutput(write) 2.39676 3.3391 4.58706 3.08145 0.628303 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5314.84 MB
Peak resident set size usage (VmHWM): 4506.34 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11092344
-rw-r--r-- 1 dunegli fnalgrid 2574503359 Oct 23 00:41 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2441961822 Oct 23 00:37 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2292930056 Oct 23 02:06 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2028465152 Oct 22 22:04 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1937501163 Oct 22 21:39 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 82582520 Oct 23 02:01 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242893 Oct 23 02:06 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Oct 23 02:06 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Oct 23 02:06 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Oct 23 02:06 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 23 00:41 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 22 22:04 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 23 02:06 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Oct 22 21:29 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Oct 23 02:06 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 23 00:47 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 23 00:41 debugprod.log
