Jobsub ID 271383.1@dunegpschedd01.fnal.gov
| Jobsub ID | 271383.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11484 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-03 04:03:16 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2026-01-03 06:16:01 |
| From worker node | Hostname | dunegli-49757-0-cmswn4075.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-03 04:30:02 |
| Input files | monte-carlo-011484-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6345s) |
| CPU time | 1h (6302s = 99%) |
| Max RSS bytes | 3992121344 (3807 MiB) |
| Outputting started | 2026-01-03 06:15:47 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11484/1/001/reco_stage1.root
|
| Finished | 2026-01-03 06:16:01 |
| Saved logs | justin-logs:271383.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ce:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 128676 traces, 0 summary
Retagger: tagging trace set: gauss with 94886 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 94886 traces tagged "gauss"
FrameSaver: q=3.30637e+06 n=1625750 tag=gauss
wclsFrameSaver: saving 128676 traces tagged "wiener"
FrameSaver: q=3.53155e+06 n=1426339 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 45265 XUs and 39714 XVs -> 2211 XUVs
C:0 T:1 113459 XUs and 111083 XVs -> 32579 XUVs
C:0 T:2 68589 XUs and 72245 XVs -> 3382 XUVs
C:0 T:3 28319 XUs and 33993 XVs -> 99 XUVs
C:0 T:4 17573 XUs and 20943 XVs -> 173 XUVs
C:0 T:5 90503 XUs and 97935 XVs -> 11681 XUVs
C:0 T:6 34058 XUs and 48163 XVs -> 1233 XUVs
C:0 T:7 15113 XUs and 22236 XVs -> 74 XUVs
C:0 T:8 4967 XUs and 6135 XVs -> 129 XUVs
C:0 T:9 53579 XUs and 132698 XVs -> 15390 XUVs
C:0 T:10 18367 XUs and 12170 XVs -> 2270 XUVs
C:0 T:11 224 XUs and 160 XVs -> 35 XUVs
69256 XUVs total
11655 collection wire objects
62772 potential space points
Neighbour search...
14292464 tests to find 6119276 neighbours
Iterating with no regularization...
Begin: 6.17409e+07
0 4.94205e+07
1 4.86413e+07
2 4.85151e+07
3 4.8473e+07
Now with regularization...
Begin: 3.8743e+07
0 3.8648e+07
1 3.85768e+07
2 3.85172e+07
3 3.8466e+07
4 3.84243e+07
5 3.83889e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411507803
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411507803
fLifetime: 30000 [us]
03-Jan-2026 06:15:47 UTC Closed output file "reco_stage1.root"
03-Jan-2026 06:15:47 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 130.684 175.52 253.16 173.577 32.0317 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000658683 0.00245261 0.00390582 0.00260223 0.00102815 10
reco:ophit:OpHitFinder 0.148833 0.184334 0.238579 0.183404 0.0231772 10
reco:opflash:OpFlashFinder 0.0730373 0.112535 0.166963 0.111287 0.0236074 10
reco:opslicer:OpSlicer 0.301949 0.374561 0.501089 0.364122 0.0577218 10
reco:caldata:DataPrepModule 3.2634 3.36327 3.51254 3.35932 0.0672457 10
reco:wclsdatasp:WireCellToolkit 21.2105 22.2839 23.6169 22.2922 0.672342 10
reco:gaushit:GausHitFinder 0.468131 0.63484 0.900906 0.617607 0.108559 10
reco:nhitsfilter:NumberOfHitsFilter 0.000213403 0.000318273 0.000636492 0.000287512 0.000112582 10
reco:reco3d:SpacePointSolver 4.76642 8.76833 18.3173 7.16033 4.57286 10
reco:hitpdune:DisambigFromSpacePoints 0.500402 0.81272 1.48976 0.78483 0.254042 10
reco:pandora:StandardPandora 7.50321 13.7646 27.6269 12.9237 5.20199 10
reco:pandoraWriter:StandardPandora 0.154841 0.207788 0.310107 0.203581 0.0401548 10
reco:pandoraTrack:LArPandoraTrackCreation 0.984732 1.54378 2.1257 1.5765 0.349023 10
reco:pandoraShower:LArPandoraShowerCreation 0.900608 1.6838 2.84437 1.7018 0.508466 10
reco:pandoracalo:Calorimetry 0.598734 0.955287 1.35832 0.98441 0.233651 10
reco:pandoracalonosce:Calorimetry 0.54203 0.873133 1.24436 0.90209 0.221343 10
reco:pandorapid:Chi2ParticleID 0.00231801 0.00294633 0.00421968 0.00290071 0.000526198 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0212963 0.0285078 0.0371173 0.0288519 0.00409825 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00215505 0.00263415 0.00304775 0.00274315 0.000268909 10
reco:pandoraShowercalo:ShowerCalorimetry 0.932868 1.88121 3.28441 1.9448 0.644642 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.907414 1.83492 3.22993 1.89057 0.637545 10
reco:emtrkmichelid:EmTrackMichelId 74.0597 97.1463 133.335 97.4383 14.888 10
reco:crttag:SingleCRTMatchingProducer 0.0039483 0.00679145 0.00982397 0.00704193 0.00181712 10
reco:crtreco:TwoCRTMatchingProducer 0.00316209 0.00426563 0.0055481 0.00428671 0.000663601 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.439321 0.563466 0.686136 0.556558 0.0908045 10
reco:pandora2Track:LArPandoraTrackCreation 2.81454 4.94154 8.02126 4.90821 1.40503 10
reco:pandora2calo:Calorimetry 1.46671 2.69301 4.42363 2.74872 0.834706 10
reco:pandora2calonosce:Calorimetry 1.39219 2.56549 4.23157 2.62556 0.803559 10
reco:pandora2pid:Chi2ParticleID 0.00510345 0.00661432 0.00839454 0.00663294 0.000940811 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0249932 0.0341235 0.0459102 0.0335041 0.00530608 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00512328 0.00640891 0.00805781 0.00651863 0.00084437 10
reco:pandora2Shower:LArPandoraShowerCreation 1.10916 1.90635 3.01925 1.8717 0.51749 10
reco:pandora2Showercalo:ShowerCalorimetry 1.29609 2.40051 3.9553 2.46039 0.755456 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.219 2.24745 3.69333 2.27559 0.711275 10
[art]:TriggerResults:TriggerResultInserter 2.1751e-05 3.51916e-05 0.000121209 2.5158e-05 2.87944e-05 10
end_path:out1:RootOutput 5.029e-06 9.2094e-06 1.5329e-05 9.4475e-06 2.76967e-06 10
end_path:out1:RootOutput(write) 1.24311 1.63824 2.3338 1.60638 0.279285 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4814.75 MB
Peak resident set size usage (VmHWM): 3992.12 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9406172
-rw-r--r-- 1 dunegli fnalgrid 2227445779 Jan 3 05:45 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2117975711 Jan 3 05:44 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1883851837 Jan 3 06:15 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1703966963 Jan 3 04:39 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1630828229 Jan 3 04:32 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 67237630 Jan 3 06:13 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242730 Jan 3 06:15 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 3 06:15 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 3 06:15 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 3 06:15 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 3 05:45 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 3 04:39 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 3 06:15 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 3 04:30 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 3 06:15 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 3 05:48 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 3 05:45 debugprod.log
