Jobsub ID 249113.0@dunegpschedd01.fnal.gov
| Jobsub ID | 249113.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10162 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-13 19:32:50 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-14 04:03:19 |
| From worker node | Hostname | dunegli-7587394-0-fnpc23042.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-14 01:55:38 |
| Input files | monte-carlo-010162-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7647s) |
| CPU time | 1h (7003s = 91%) |
| Max RSS bytes | 4393005056 (4189 MiB) |
| Outputting started | 2025-11-14 04:03:05 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10162/1/001/reco_stage1.root
|
| Finished | 2025-11-14 04:03:19 |
| Saved logs | justin-logs:249113.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ce:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 139895 traces, 0 summary
Retagger: tagging trace set: gauss with 109527 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109527 traces tagged "gauss"
FrameSaver: q=3.79873e+06 n=1996915 tag=gauss
wclsFrameSaver: saving 139895 traces tagged "wiener"
FrameSaver: q=4.01016e+06 n=1789576 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33487 XUs and 37427 XVs -> 360 XUVs
C:0 T:1 66039 XUs and 68474 XVs -> 3608 XUVs
C:0 T:2 109115 XUs and 114725 XVs -> 5081 XUVs
C:0 T:3 51395 XUs and 47805 XVs -> 379 XUVs
C:0 T:4 14995 XUs and 16579 XVs -> 149 XUVs
C:0 T:5 60607 XUs and 58255 XVs -> 3978 XUVs
C:0 T:6 152594 XUs and 140345 XVs -> 7469 XUVs
C:0 T:7 58846 XUs and 54938 XVs -> 551 XUVs
C:0 T:8 7683 XUs and 10469 XVs -> 58 XUVs
C:0 T:9 47951 XUs and 80594 XVs -> 4329 XUVs
C:0 T:10 41172 XUs and 18410 XVs -> 5221 XUVs
C:0 T:11 319 XUs and 148 XVs -> 32 XUVs
31215 XUVs total
13053 collection wire objects
28662 potential space points
Neighbour search...
1701222 tests to find 862894 neighbours
Iterating with no regularization...
Begin: 7.58066e+07
0 6.46459e+07
1 6.37632e+07
2 6.36455e+07
3 6.36116e+07
Now with regularization...
Begin: 5.29139e+07
0 5.28888e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410494829
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410494829
fLifetime: 30000 [us]
14-Nov-2025 04:03:04 UTC Closed output file "reco_stage1.root"
14-Nov-2025 04:03:04 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 141.402 201.682 274.577 194.545 35.7253 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000672269 0.00274114 0.00418866 0.0027883 0.00121345 10
reco:ophit:OpHitFinder 0.168974 0.19528 0.224256 0.190786 0.0187108 10
reco:opflash:OpFlashFinder 0.0919833 0.122834 0.162934 0.115065 0.0222623 10
reco:opslicer:OpSlicer 0.362383 0.430866 0.509738 0.445182 0.0482808 10
reco:caldata:DataPrepModule 3.28106 3.38575 3.56647 3.38052 0.0761604 10
reco:wclsdatasp:WireCellToolkit 21.2815 21.7826 22.3467 21.7359 0.371434 10
reco:gaushit:GausHitFinder 0.608069 0.771484 0.969555 0.747849 0.101841 10
reco:nhitsfilter:NumberOfHitsFilter 0.000255021 0.000324757 0.000431555 0.000314674 5.34434e-05 10
reco:reco3d:SpacePointSolver 4.80975 8.49112 13.2373 8.3431 2.42219 10
reco:hitpdune:DisambigFromSpacePoints 0.614893 1.00704 1.33699 1.00108 0.21883 10
reco:pandora:StandardPandora 8.68319 21.3406 45.4915 18.0675 9.64612 10
reco:pandoraWriter:StandardPandora 0.179339 0.239013 0.309844 0.236043 0.039475 10
reco:pandoraTrack:LArPandoraTrackCreation 1.01897 2.04232 3.52867 1.78352 0.700835 10
reco:pandoraShower:LArPandoraShowerCreation 1.06628 2.2799 3.94541 1.97915 0.822123 10
reco:pandoracalo:Calorimetry 0.619912 1.24113 2.04886 1.10933 0.391089 10
reco:pandoracalonosce:Calorimetry 0.553138 1.14829 1.92354 1.01974 0.376329 10
reco:pandorapid:Chi2ParticleID 0.00239426 0.00335573 0.00452601 0.00308734 0.000631828 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0244705 0.0306543 0.0374434 0.0306488 0.00332328 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0022446 0.00310404 0.00415084 0.00291107 0.00055932 10
reco:pandoraShowercalo:ShowerCalorimetry 1.09723 2.6192 4.41907 2.3405 0.941775 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.06015 2.562 4.32494 2.27248 0.931023 10
reco:emtrkmichelid:EmTrackMichelId 83.6643 107.201 127.072 106.427 12.3985 10
reco:crttag:SingleCRTMatchingProducer 0.0047868 0.00762301 0.0113773 0.00715495 0.0021525 10
reco:crtreco:TwoCRTMatchingProducer 0.00354778 0.00448561 0.00530801 0.00446542 0.000531627 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.443135 0.565925 0.735553 0.56035 0.0838709 10
reco:pandora2Track:LArPandoraTrackCreation 3.13523 6.54119 10.9331 5.74679 2.20712 10
reco:pandora2calo:Calorimetry 1.63218 3.67685 6.13131 3.27036 1.25712 10
reco:pandora2calonosce:Calorimetry 1.53869 3.51772 5.86833 3.12811 1.21523 10
reco:pandora2pid:Chi2ParticleID 0.00523696 0.00804945 0.0118986 0.00749946 0.00193947 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0278575 0.0381627 0.0502299 0.0376091 0.00569528 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00514868 0.00789936 0.0118452 0.00726863 0.00194648 10
reco:pandora2Shower:LArPandoraShowerCreation 1.24134 2.40983 3.76797 2.13369 0.726326 10
reco:pandora2Showercalo:ShowerCalorimetry 1.42713 3.22454 5.19766 2.90974 1.06184 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.32584 2.9687 4.72666 2.68423 0.961929 10
[art]:TriggerResults:TriggerResultInserter 2.5599e-05 3.64707e-05 8.3487e-05 3.1915e-05 1.6194e-05 10
end_path:out1:RootOutput 3.516e-06 6.4158e-06 1.11e-05 6.6375e-06 2.16356e-06 10
end_path:out1:RootOutput(write) 1.35279 1.76372 2.13743 1.75421 0.21009 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5206 MB
Peak resident set size usage (VmHWM): 4393.01 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10207400
-rw-r--r-- 1 dunegli fnalgrid 2400179845 Nov 14 03:28 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2283045527 Nov 14 03:26 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2081497930 Nov 14 04:03 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1841542598 Nov 14 02:06 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1770833799 Nov 14 01:59 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 74652400 Nov 14 04:00 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242920 Nov 14 04:03 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 14 04:03 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 14 04:03 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 14 04:03 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 03:28 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 02:06 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 14 04:03 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 14 01:55 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 14 04:03 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 03:31 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 14 03:28 debugprod.log
