Jobsub ID 240145.0@dunegpschedd01.fnal.gov
| Jobsub ID | 240145.0@dunegpschedd01.fnal.gov |
| Workflow ID | 9433 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-10-29 11:24:20 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-10-29 13:40:47 |
| From worker node | Hostname | dunegli-7564414-0-fnpc22007.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-10-29 11:36:37 |
| Input files | monte-carlo-009433-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6511s) |
| CPU time | 1h (6439s = 98%) |
| Max RSS bytes | 4192509952 (3998 MiB) |
| Outputting started | 2025-10-29 13:25:08 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09433/1/001/reco_stage1.root
|
| Finished | 2025-10-29 13:40:47 |
| Saved logs | justin-logs:240145.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ervice:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 86537 traces, 0 summary
Retagger: tagging trace set: gauss with 68922 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 68922 traces tagged "gauss"
FrameSaver: q=2.40148e+06 n=1260237 tag=gauss
wclsFrameSaver: saving 86537 traces tagged "wiener"
FrameSaver: q=2.52833e+06 n=1133275 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 14252 XUs and 14251 XVs -> 52 XUVs
C:0 T:1 21472 XUs and 19688 XVs -> 1256 XUVs
C:0 T:2 77111 XUs and 126594 XVs -> 4539 XUVs
C:0 T:3 39339 XUs and 53767 XVs -> 285 XUVs
C:0 T:4 5877 XUs and 6872 XVs -> 40 XUVs
C:0 T:5 15367 XUs and 13647 XVs -> 2136 XUVs
C:0 T:6 40968 XUs and 56016 XVs -> 1861 XUVs
C:0 T:7 18345 XUs and 25309 XVs -> 250 XUVs
C:0 T:8 7870 XUs and 9175 XVs -> 96 XUVs
C:0 T:9 50473 XUs and 62192 XVs -> 3799 XUVs
C:0 T:10 22200 XUs and 15807 XVs -> 2791 XUVs
C:0 T:11 277 XUs and 95 XVs -> 30 XUVs
17135 XUVs total
7392 collection wire objects
16210 potential space points
Neighbour search...
910658 tests to find 379240 neighbours
Iterating with no regularization...
Begin: 4.33722e+07
0 3.71599e+07
1 3.66894e+07
2 3.66261e+07
3 3.66078e+07
Now with regularization...
Begin: 2.95399e+07
0 2.9519e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410186285
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410186285
fLifetime: 30000 [us]
29-Oct-2025 13:25:07 UTC Closed output file "reco_stage1.root"
29-Oct-2025 13:25:07 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 137.316 182.719 230.629 178.335 32.5156 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000758334 0.00277688 0.00479442 0.00311458 0.00123554 10
reco:ophit:OpHitFinder 0.155813 0.194506 0.226701 0.19572 0.0216893 10
reco:opflash:OpFlashFinder 0.0795576 0.12988 0.177444 0.133559 0.0274 10
reco:opslicer:OpSlicer 0.269343 0.390854 0.475521 0.403327 0.0590469 10
reco:caldata:DataPrepModule 3.31097 3.40126 3.5544 3.38979 0.0748563 10
reco:wclsdatasp:WireCellToolkit 21.4764 22.3757 23 22.4133 0.499439 10
reco:gaushit:GausHitFinder 0.487341 0.684485 0.875743 0.67188 0.106372 10
reco:nhitsfilter:NumberOfHitsFilter 0.000215146 0.000295544 0.000362716 0.000305402 4.06908e-05 10
reco:reco3d:SpacePointSolver 4.78925 7.31046 10.5589 7.02074 1.82259 10
reco:hitpdune:DisambigFromSpacePoints 0.543878 0.848822 1.2065 0.83292 0.23164 10
reco:pandora:StandardPandora 8.34305 17.695 28.7649 14.4766 6.9676 10
reco:pandoraWriter:StandardPandora 0.169406 0.228092 0.289472 0.224228 0.0397098 10
reco:pandoraTrack:LArPandoraTrackCreation 1.14299 1.8047 2.45425 1.85731 0.415546 10
reco:pandoraShower:LArPandoraShowerCreation 1.08475 1.95582 3.08131 1.91756 0.660577 10
reco:pandoracalo:Calorimetry 0.675094 1.09029 1.53504 1.14199 0.280153 10
reco:pandoracalonosce:Calorimetry 0.607947 0.996197 1.39602 1.05253 0.258989 10
reco:pandorapid:Chi2ParticleID 0.00252065 0.00334771 0.00403457 0.00337217 0.000414346 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0238055 0.0286552 0.0335092 0.0285817 0.00356918 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00232118 0.00296852 0.00338974 0.00300572 0.000338924 10
reco:pandoraShowercalo:ShowerCalorimetry 1.1553 2.16807 3.43362 2.18169 0.795676 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.13068 2.11518 3.34315 2.13771 0.781228 10
reco:emtrkmichelid:EmTrackMichelId 77.6018 98.1167 119.557 96.7023 14.2201 10
reco:crttag:SingleCRTMatchingProducer 0.00518025 0.00702298 0.00875358 0.00749893 0.00112628 10
reco:crtreco:TwoCRTMatchingProducer 0.00326695 0.00427512 0.00512337 0.00427255 0.000634093 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.411141 0.531041 0.646449 0.547146 0.0768285 10
reco:pandora2Track:LArPandoraTrackCreation 3.36207 5.68599 8.24934 5.77672 1.74173 10
reco:pandora2calo:Calorimetry 1.7322 3.09149 4.4683 3.26922 1.02456 10
reco:pandora2calonosce:Calorimetry 1.63423 2.94159 4.29059 3.05273 0.998008 10
reco:pandora2pid:Chi2ParticleID 0.00597603 0.00762288 0.0097082 0.00745526 0.00119799 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0274639 0.0360808 0.0433161 0.0355526 0.00515611 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0055415 0.00736244 0.00929348 0.00732622 0.00117121 10
reco:pandora2Shower:LArPandoraShowerCreation 1.29424 2.07062 2.98213 2.04034 0.621138 10
reco:pandora2Showercalo:ShowerCalorimetry 1.53503 2.65106 3.89312 2.72373 0.871232 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.43958 2.42698 3.52214 2.46484 0.801418 10
[art]:TriggerResults:TriggerResultInserter 3.1389e-05 4.37089e-05 9.2285e-05 3.7977e-05 1.71966e-05 10
end_path:out1:RootOutput 8.245e-06 9.1492e-06 1.067e-05 8.9115e-06 7.73181e-07 10
end_path:out1:RootOutput(write) 1.27614 1.66144 2.08491 1.63011 0.280979 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5006.92 MB
Peak resident set size usage (VmHWM): 4192.51 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9994596
-rw-r--r-- 1 dunegli fnalgrid 2359965870 Oct 29 12:53 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2246692201 Oct 29 12:52 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2016690183 Oct 29 13:25 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1807116546 Oct 29 11:46 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1735455955 Oct 29 11:39 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 67916990 Oct 29 13:23 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243092 Oct 29 13:25 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Oct 29 13:25 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Oct 29 13:25 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Oct 29 13:25 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 29 12:53 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 29 11:46 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Oct 29 13:25 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Oct 29 11:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Oct 29 13:25 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 29 12:56 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Oct 29 12:53 debugprod.log