Jobsub ID 261924.1@dunegpschedd02.fnal.gov
| Jobsub ID | 261924.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11205 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-13 04:58:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-13 08:24:40 |
| From worker node | Hostname | dunegli-8047068-0-fnpc9107.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-13 04:59:20 |
| Input files | monte-carlo-011205-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12302s) |
| CPU time | 3h (12133s = 98%) |
| Max RSS bytes | 4261470208 (4064 MiB) |
| Outputting started | 2025-12-13 08:24:22 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11205/1/001/reco_stage1.root
|
| Finished | 2025-12-13 08:24:40 |
| Saved logs | justin-logs:261924.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 137514 traces, 0 summary
Retagger: tagging trace set: gauss with 107311 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 107311 traces tagged "gauss"
FrameSaver: q=3.80837e+06 n=1977836 tag=gauss
wclsFrameSaver: saving 137514 traces tagged "wiener"
FrameSaver: q=4.01695e+06 n=1778021 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 31558 XUs and 26345 XVs -> 199 XUVs
C:0 T:1 51435 XUs and 41355 XVs -> 3898 XUVs
C:0 T:2 180411 XUs and 136136 XVs -> 31495 XUVs
C:0 T:3 42597 XUs and 39068 XVs -> 1573 XUVs
C:0 T:4 11427 XUs and 11908 XVs -> 63 XUVs
C:0 T:5 41879 XUs and 33363 XVs -> 3793 XUVs
C:0 T:6 183261 XUs and 162669 XVs -> 6322 XUVs
C:0 T:7 70292 XUs and 58340 XVs -> 806 XUVs
C:0 T:8 9861 XUs and 10732 XVs -> 164 XUVs
C:0 T:9 74686 XUs and 86057 XVs -> 7441 XUVs
C:0 T:10 51098 XUs and 56220 XVs -> 11761 XUVs
C:0 T:11 201 XUs and 282 XVs -> 41 XUVs
67556 XUVs total
12121 collection wire objects
60254 potential space points
Neighbour search...
13346086 tests to find 5656432 neighbours
Iterating with no regularization...
Begin: 6.73099e+07
0 5.69437e+07
1 5.62614e+07
2 5.61644e+07
3 5.61347e+07
Now with regularization...
Begin: 4.6035e+07
0 4.59826e+07
1 4.59369e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411086082
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411086082
fLifetime: 30000 [us]
13-Dec-2025 08:24:20 UTC Closed output file "reco_stage1.root"
13-Dec-2025 08:24:20 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 328.14 446.976 554.026 458.197 69.5677 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000975755 0.00359554 0.00563321 0.00378214 0.00149987 10
reco:ophit:OpHitFinder 0.250882 0.283474 0.320034 0.275989 0.0240547 10
reco:opflash:OpFlashFinder 0.16627 0.203998 0.2462 0.198963 0.0260769 10
reco:opslicer:OpSlicer 0.566073 0.688377 0.823373 0.704049 0.0697179 10
reco:caldata:DataPrepModule 5.45232 5.59522 5.85998 5.5794 0.112097 10
reco:wclsdatasp:WireCellToolkit 43.7215 47.7325 49.8092 48.4019 1.96023 10
reco:gaushit:GausHitFinder 1.16363 1.43897 1.81389 1.39359 0.207963 10
reco:nhitsfilter:NumberOfHitsFilter 0.000627924 0.000844745 0.00107164 0.000865402 0.000113388 10
reco:reco3d:SpacePointSolver 8.38666 18.9542 28.4296 19.542 5.77284 10
reco:hitpdune:DisambigFromSpacePoints 1.65906 2.58727 3.75611 2.65071 0.597908 10
reco:pandora:StandardPandora 22.7468 43.6393 57.3649 46.8774 10.3168 10
reco:pandoraWriter:StandardPandora 0.393906 0.499059 0.595906 0.508166 0.0620412 10
reco:pandoraTrack:LArPandoraTrackCreation 6.09405 9.51933 12.2417 9.99407 1.61898 10
reco:pandoraShower:LArPandoraShowerCreation 5.99059 10.9101 14.7861 11.2808 2.73697 10
reco:pandoracalo:Calorimetry 2.63959 4.28992 5.67664 4.48975 0.828166 10
reco:pandoracalonosce:Calorimetry 2.42387 4.01845 5.20519 4.2582 0.778843 10
reco:pandorapid:Chi2ParticleID 0.00514424 0.00637928 0.00856143 0.00628846 0.000856152 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.057344 0.0738828 0.0920225 0.0751191 0.00971496 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00496598 0.0060734 0.00678516 0.00615398 0.000465288 10
reco:pandoraShowercalo:ShowerCalorimetry 4.50152 9.28643 13.0583 9.69039 2.61699 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.35251 8.96406 12.5302 9.20609 2.52009 10
reco:emtrkmichelid:EmTrackMichelId 153.373 189.818 230.906 191.624 23.316 10
reco:crttag:SingleCRTMatchingProducer 0.0175112 0.0260257 0.0309816 0.0269126 0.00425589 10
reco:crtreco:TwoCRTMatchingProducer 0.0153619 0.0214265 0.0250966 0.0222884 0.00314952 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.5071 1.8672 2.35626 1.85895 0.265501 10
reco:pandora2Track:LArPandoraTrackCreation 18.3404 30.1302 38.3456 31.2021 6.70519 10
reco:pandora2calo:Calorimetry 6.97769 12.6556 17.2187 13.44 3.20734 10
reco:pandora2calonosce:Calorimetry 6.5438 12.0053 16.2662 12.6708 3.02396 10
reco:pandora2pid:Chi2ParticleID 0.0120997 0.0149543 0.0176269 0.0146631 0.00170122 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.071033 0.0901745 0.111295 0.0931233 0.0118637 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0122455 0.0148804 0.0176059 0.0146179 0.00167731 10
reco:pandora2Shower:LArPandoraShowerCreation 5.11843 9.30242 12.4459 9.76065 2.05347 10
reco:pandora2Showercalo:ShowerCalorimetry 5.61409 10.2793 14.2859 11.0833 2.77871 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.78766 9.12971 12.8006 9.7944 2.46724 10
[art]:TriggerResults:TriggerResultInserter 4.8345e-05 6.45054e-05 0.000147898 5.61155e-05 2.81655e-05 10
end_path:out1:RootOutput 7.672e-06 9.6095e-06 1.4889e-05 9.28e-06 1.98256e-06 10
end_path:out1:RootOutput(write) 2.16985 2.76575 3.54085 2.82723 0.397629 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5073.25 MB
Peak resident set size usage (VmHWM): 4261.47 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.49 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10170276
-rw-r--r-- 1 dunegli fnalgrid 2380545994 Dec 13 07:07 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2255044994 Dec 13 07:05 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2071361748 Dec 13 08:24 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1857284556 Dec 13 05:27 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1773913445 Dec 13 05:06 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 75579810 Dec 13 08:17 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242896 Dec 13 08:24 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 13 08:24 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 13 08:24 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 13 08:24 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 07:07 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 05:27 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 08:24 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 13 04:59 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 13 08:24 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 13 07:15 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 13 07:07 debugprod.log