Jobsub ID 267295.0@dunegpschedd01.fnal.gov
| Jobsub ID | 267295.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11154 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 09:47:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 14:58:31 |
| From worker node | Hostname | dunegli-7890432-0-fnpc23039.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:36:19 |
| Input files | monte-carlo-011154-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12088s) |
| CPU time | 3h (11995s = 99%) |
| Max RSS bytes | 4523442176 (4313 MiB) |
| Outputting started | 2025-12-12 14:57:48 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11154/1/001/reco_stage1.root
|
| Finished | 2025-12-12 14:58:31 |
| Saved logs | justin-logs:267295.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
sedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 162195 traces, 0 summary
Retagger: tagging trace set: gauss with 126595 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 126595 traces tagged "gauss"
FrameSaver: q=4.3214e+06 n=2266899 tag=gauss
wclsFrameSaver: saving 162195 traces tagged "wiener"
FrameSaver: q=4.59869e+06 n=2026442 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 34168 XUs and 42697 XVs -> 556 XUVs
C:0 T:1 64807 XUs and 88220 XVs -> 6273 XUVs
C:0 T:2 76201 XUs and 122774 XVs -> 6779 XUVs
C:0 T:3 38045 XUs and 42087 XVs -> 318 XUVs
C:0 T:4 22812 XUs and 23562 XVs -> 295 XUVs
C:0 T:5 119912 XUs and 126186 XVs -> 12842 XUVs
C:0 T:6 102302 XUs and 110152 XVs -> 7647 XUVs
C:0 T:7 44457 XUs and 40172 XVs -> 338 XUVs
C:0 T:8 9497 XUs and 12877 XVs -> 164 XUVs
C:0 T:9 85510 XUs and 178510 XVs -> 13597 XUVs
C:0 T:10 61487 XUs and 29566 XVs -> 5239 XUVs
C:0 T:11 217 XUs and 181 XVs -> 30 XUVs
54078 XUVs total
15415 collection wire objects
49567 potential space points
Neighbour search...
6514513 tests to find 3110450 neighbours
Iterating with no regularization...
Begin: 7.39763e+07
0 5.80647e+07
1 5.70462e+07
2 5.6875e+07
3 5.68118e+07
4 5.67799e+07
Now with regularization...
Begin: 4.55997e+07
0 4.55288e+07
1 4.54781e+07
2 4.54398e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411068698
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411068698
fLifetime: 30000 [us]
12-Dec-2025 14:57:45 UTC Closed output file "reco_stage1.root"
12-Dec-2025 14:57:45 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 247.986 427.515 630.181 419.293 114.595 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00152581 0.00679443 0.0108501 0.00720629 0.00283426 10
reco:ophit:OpHitFinder 0.219994 0.275128 0.336918 0.272295 0.0289409 10
reco:opflash:OpFlashFinder 0.120386 0.180363 0.226148 0.179057 0.0295105 10
reco:opslicer:OpSlicer 0.464203 0.542594 0.622438 0.549948 0.0551975 10
reco:caldata:DataPrepModule 4.58431 4.87912 5.34718 4.81364 0.22987 10
reco:wclsdatasp:WireCellToolkit 46.9622 51.875 60.6978 51.0728 4.13973 10
reco:gaushit:GausHitFinder 0.724955 1.12082 1.37755 1.19094 0.197151 10
reco:nhitsfilter:NumberOfHitsFilter 0.00198521 0.00316333 0.00405223 0.00325533 0.000724742 10
reco:reco3d:SpacePointSolver 7.44037 20.7335 51.8516 17.9287 11.9256 10
reco:hitpdune:DisambigFromSpacePoints 0.837799 1.77362 2.64983 1.84547 0.519577 10
reco:pandora:StandardPandora 15.2723 36.8604 60.311 37.0647 13.6259 10
reco:pandoraWriter:StandardPandora 0.530832 0.800537 1.05306 0.828861 0.158714 10
reco:pandoraTrack:LArPandoraTrackCreation 3.14654 15.2572 30.9556 15.2752 8.5523 10
reco:pandoraShower:LArPandoraShowerCreation 1.93742 16.0659 39.9272 10.6668 13.0717 10
reco:pandoracalo:Calorimetry 1.06982 4.41271 10.2014 4.10941 2.62109 10
reco:pandoracalonosce:Calorimetry 0.870431 3.80734 9.57799 3.7586 2.39202 10
reco:pandorapid:Chi2ParticleID 0.00411949 0.00613606 0.0108181 0.00580766 0.00175536 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0381661 0.0518536 0.0628597 0.052877 0.0084071 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00443857 0.00577577 0.00728519 0.00586041 0.000936405 10
reco:pandoraShowercalo:ShowerCalorimetry 1.53105 7.24818 31.1379 4.69183 8.16132 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.4632 6.1823 19.5329 4.53501 4.91291 10
reco:emtrkmichelid:EmTrackMichelId 137.352 190.96 246.681 191.435 37.0316 10
reco:crttag:SingleCRTMatchingProducer 0.0160455 0.034959 0.0636461 0.0322759 0.0153838 10
reco:crtreco:TwoCRTMatchingProducer 0.00787652 0.0201907 0.0438973 0.0164645 0.0120396 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.56931 0.810504 1.13157 0.833787 0.167755 10
reco:pandora2Track:LArPandoraTrackCreation 8.02018 29.9823 71.8458 26.7926 17.0018 10
reco:pandora2calo:Calorimetry 2.40189 7.48328 16.583 7.45536 3.7536 10
reco:pandora2calonosce:Calorimetry 2.16672 6.49992 11.9633 6.68852 2.71772 10
reco:pandora2pid:Chi2ParticleID 0.00912888 0.0129751 0.0160378 0.0131247 0.00240942 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0469883 0.0683204 0.0853375 0.069329 0.0124845 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00829459 0.0138455 0.0218022 0.0128631 0.00393835 10
reco:pandora2Shower:LArPandoraShowerCreation 1.8203 4.8591 8.5191 4.73919 1.97585 10
reco:pandora2Showercalo:ShowerCalorimetry 2.00927 5.71226 9.74357 6.27144 2.20094 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.82578 5.64118 14.7906 5.51261 3.39697 10
[art]:TriggerResults:TriggerResultInserter 8.8048e-05 0.000115701 0.000254754 0.000100906 4.6981e-05 10
end_path:out1:RootOutput 1.548e-05 2.17172e-05 3.2632e-05 2.1055e-05 4.94411e-06 10
end_path:out1:RootOutput(write) 1.91104 2.97517 4.25054 2.99515 0.675661 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5333.69 MB
Peak resident set size usage (VmHWM): 4523.44 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.30 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.46 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11707028
-rw-r--r-- 1 dunegli fnalgrid 2683351005 Dec 12 13:44 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2548795906 Dec 12 13:42 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2420059705 Dec 12 14:57 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2170148909 Dec 12 11:52 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2078226566 Dec 12 11:40 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 86803440 Dec 12 14:51 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242900 Dec 12 14:57 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 14:57 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 14:57 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 14:57 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 13:44 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 11:52 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 14:57 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 14:57 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:51 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 13:44 debugprod.log
