Jobsub ID 261925.1@dunegpschedd02.fnal.gov
| Jobsub ID | 261925.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11206 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-13 04:58:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-13 07:27:05 |
| From worker node | Hostname | dunegli-7890493-0-fnpc22024.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-13 04:58:47 |
| Input files | monte-carlo-011206-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8858s) |
| CPU time | 2h (8484s = 95%) |
| Max RSS bytes | 4520910848 (4311 MiB) |
| Outputting started | 2025-12-13 07:26:26 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11206/1/001/reco_stage1.root
|
| Finished | 2025-12-13 07:27:05 |
| Saved logs | justin-logs:261925.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
repService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 117734 traces, 0 summary
Retagger: tagging trace set: gauss with 90038 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 90038 traces tagged "gauss"
FrameSaver: q=3.10118e+06 n=1586171 tag=gauss
wclsFrameSaver: saving 117734 traces tagged "wiener"
FrameSaver: q=3.27901e+06 n=1411691 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35416 XUs and 26359 XVs -> 257 XUVs
C:0 T:1 55123 XUs and 43784 XVs -> 4215 XUVs
C:0 T:2 98623 XUs and 136661 XVs -> 8050 XUVs
C:0 T:3 52466 XUs and 57687 XVs -> 802 XUVs
C:0 T:4 5640 XUs and 6152 XVs -> 62 XUVs
C:0 T:5 15417 XUs and 12822 XVs -> 2203 XUVs
C:0 T:6 128387 XUs and 152810 XVs -> 5743 XUVs
C:0 T:7 48323 XUs and 56949 XVs -> 606 XUVs
C:0 T:8 6337 XUs and 6329 XVs -> 77 XUVs
C:0 T:9 27327 XUs and 35140 XVs -> 2005 XUVs
C:0 T:10 39430 XUs and 48813 XVs -> 12505 XUVs
C:0 T:11 24 XUs and 17 XVs -> 4 XUVs
36529 XUVs total
9418 collection wire objects
33999 potential space points
Neighbour search...
4696127 tests to find 2218484 neighbours
Iterating with no regularization...
Begin: 5.36896e+07
0 4.61695e+07
1 4.562e+07
2 4.55488e+07
3 4.55288e+07
Now with regularization...
Begin: 3.69372e+07
0 3.69196e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411086070
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411086070
fLifetime: 30000 [us]
13-Dec-2025 07:26:25 UTC Closed output file "reco_stage1.root"
13-Dec-2025 07:26:25 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 196.168 271.355 375.7 253.965 53.9535 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0012404 0.0040314 0.00667596 0.00432608 0.00170139 10
reco:ophit:OpHitFinder 0.194694 0.231735 0.259852 0.235496 0.0189644 10
reco:opflash:OpFlashFinder 0.132582 0.155947 0.168086 0.162358 0.0124065 10
reco:opslicer:OpSlicer 0.372443 0.478615 0.568445 0.485093 0.0584925 10
reco:caldata:DataPrepModule 3.70518 4.24433 7.59234 3.81972 1.1425 10
reco:wclsdatasp:WireCellToolkit 27.3656 31.9764 48.8587 28.622 7.49107 10
reco:gaushit:GausHitFinder 0.496357 0.786538 1.0096 0.780858 0.134169 10
reco:nhitsfilter:NumberOfHitsFilter 0.000646572 0.00121662 0.00246834 0.00110377 0.000459119 10
reco:reco3d:SpacePointSolver 6.60462 10.8741 15.8085 9.90383 2.55412 10
reco:hitpdune:DisambigFromSpacePoints 0.577967 1.13493 1.581 1.07811 0.276549 10
reco:pandora:StandardPandora 10.9201 21.8098 35.8175 20.5867 6.23525 10
reco:pandoraWriter:StandardPandora 0.231472 0.416191 0.670524 0.399739 0.106859 10
reco:pandoraTrack:LArPandoraTrackCreation 1.42886 3.85383 11.2695 3.23343 2.60796 10
reco:pandoraShower:LArPandoraShowerCreation 1.15555 4.22585 11.6202 3.34122 2.75424 10
reco:pandoracalo:Calorimetry 0.793135 2.02878 5.8555 1.77218 1.32427 10
reco:pandoracalonosce:Calorimetry 0.720598 2.02046 6.05266 1.55345 1.42853 10
reco:pandorapid:Chi2ParticleID 0.0029951 0.00434661 0.00830287 0.003944 0.00141924 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0266394 0.0417343 0.0948142 0.0360415 0.0184224 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00264771 0.00536754 0.0180743 0.00396901 0.00433657 10
reco:pandoraShowercalo:ShowerCalorimetry 1.14617 4.78474 15.871 3.73816 3.90156 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.11962 5.51472 15.6342 3.44145 4.59069 10
reco:emtrkmichelid:EmTrackMichelId 107.522 134.165 172.447 131.513 19.2363 10
reco:crttag:SingleCRTMatchingProducer 0.0107393 0.0212528 0.0425386 0.0178841 0.0106013 10
reco:crtreco:TwoCRTMatchingProducer 0.00668785 0.009908 0.0211984 0.00906944 0.00400849 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.503755 0.69628 1.04282 0.65556 0.1426 10
reco:pandora2Track:LArPandoraTrackCreation 6.93588 13.5566 25.9201 12.6597 5.03866 10
reco:pandora2calo:Calorimetry 1.86486 5.69001 9.11297 5.04524 2.31073 10
reco:pandora2calonosce:Calorimetry 1.75516 5.03689 8.30494 4.87523 1.82575 10
reco:pandora2pid:Chi2ParticleID 0.00633143 0.0102855 0.0222429 0.00875361 0.00424788 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0331897 0.0508906 0.0979426 0.0471741 0.0168892 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00589573 0.0102757 0.0222974 0.00878795 0.00431347 10
reco:pandora2Shower:LArPandoraShowerCreation 1.48888 5.05433 17.2384 3.54098 4.24212 10
reco:pandora2Showercalo:ShowerCalorimetry 1.66808 5.46315 15.5949 4.44003 3.63628 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.56791 4.77407 13.7254 3.73252 3.19308 10
[art]:TriggerResults:TriggerResultInserter 3.3743e-05 9.18807e-05 0.000445141 5.29355e-05 0.000118186 10
end_path:out1:RootOutput 1.0229e-05 1.58319e-05 5.4092e-05 1.13815e-05 1.28001e-05 10
end_path:out1:RootOutput(write) 1.44841 2.05071 2.5022 1.99847 0.316018 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5329.95 MB
Peak resident set size usage (VmHWM): 4520.91 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.44 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10847552
-rw-r--r-- 1 dunegli fnalgrid 2521008541 Dec 13 06:39 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2393275047 Dec 13 06:37 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2210004865 Dec 13 07:26 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1990421230 Dec 13 05:12 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1917446866 Dec 13 05:03 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 75061050 Dec 13 07:23 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242898 Dec 13 07:26 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 13 07:26 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 13 07:26 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 13 07:26 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 06:39 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 05:12 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 07:26 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 13 04:58 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 13 07:26 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 13 06:45 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 13 06:39 debugprod.log
