Jobsub ID 270216.0@dunegpschedd01.fnal.gov
| Jobsub ID | 270216.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11338 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-26 09:05:18 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2025-12-26 14:21:00 |
| From worker node | Hostname | mh-7662-9.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-26 09:16:30 |
| Input files | monte-carlo-011338-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (18211s) |
| CPU time | 4h (16624s = 91%) |
| Max RSS bytes | 4457103360 (4250 MiB) |
| Outputting started | 2025-12-26 14:20:02 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11338/1/001/reco_stage1.root
|
| Finished | 2025-12-26 14:21:00 |
| Saved logs | justin-logs:270216.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Adc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 154913 traces, 0 summary
Retagger: tagging trace set: gauss with 118905 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 118905 traces tagged "gauss"
FrameSaver: q=4.32358e+06 n=2132898 tag=gauss
wclsFrameSaver: saving 154913 traces tagged "wiener"
FrameSaver: q=4.58906e+06 n=1904898 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 40807 XUs and 35387 XVs -> 405 XUVs
C:0 T:1 51509 XUs and 47737 XVs -> 3132 XUVs
C:0 T:2 220679 XUs and 236203 XVs -> 20668 XUVs
C:0 T:3 67924 XUs and 71169 XVs -> 1013 XUVs
C:0 T:4 15545 XUs and 19299 XVs -> 359 XUVs
C:0 T:5 84713 XUs and 96043 XVs -> 13590 XUVs
C:0 T:6 200806 XUs and 209821 XVs -> 20502 XUVs
C:0 T:7 55069 XUs and 68062 XVs -> 964 XUVs
C:0 T:8 5830 XUs and 7638 XVs -> 75 XUVs
C:0 T:9 37754 XUs and 65592 XVs -> 5132 XUVs
C:0 T:10 40413 XUs and 25185 XVs -> 6428 XUVs
C:0 T:11 66 XUs and 62 XVs -> 7 XUVs
72275 XUVs total
13665 collection wire objects
65640 potential space points
Neighbour search...
13410448 tests to find 5576172 neighbours
Iterating with no regularization...
Begin: 1.07177e+08
0 8.43405e+07
1 8.24473e+07
2 8.2137e+07
3 8.20379e+07
4 8.19935e+07
Now with regularization...
Begin: 6.83078e+07
0 6.8213e+07
1 6.81577e+07
Failure in algorithm Alg0061, LArCosmicRayTrackRecovery, STATUS_CODE_FAILURE
run: 1 ; subrun: 0 ; event: 10
evttime: 411351109
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411351109
fLifetime: 30000 [us]
26-Dec-2025 06:19:59 PST Closed output file "reco_stage1.root"
26-Dec-2025 06:19:59 PST Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 368.204 617.611 906.211 589.842 139.178 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00163222 0.00520563 0.00883262 0.00550535 0.00222786 10
reco:ophit:OpHitFinder 0.364296 0.460575 0.609384 0.453123 0.074462 10
reco:opflash:OpFlashFinder 0.215172 0.30308 0.423399 0.295578 0.0595402 10
reco:opslicer:OpSlicer 0.787418 1.12229 1.58783 1.10534 0.257568 10
reco:caldata:DataPrepModule 6.46991 7.80413 9.50063 7.5473 1.12099 10
reco:wclsdatasp:WireCellToolkit 42.1841 50.1075 62.3785 48.4602 5.81494 10
reco:gaushit:GausHitFinder 1.38874 1.87154 2.86688 1.65671 0.507136 10
reco:nhitsfilter:NumberOfHitsFilter 0.000639346 0.00091734 0.00131229 0.000921644 0.000180023 10
reco:reco3d:SpacePointSolver 11.5634 25.442 44.6931 24.1244 10.8027 10
reco:hitpdune:DisambigFromSpacePoints 1.62211 2.53367 3.32201 2.90437 0.628482 10
reco:pandora:StandardPandora 25.0343 62.2577 111.17 49.6459 25.3516 10
reco:pandoraWriter:StandardPandora 0.495058 0.672895 0.901075 0.647361 0.123224 10
reco:pandoraTrack:LArPandoraTrackCreation 4.09313 7.44037 12.7054 6.65351 2.59859 10
reco:pandoraShower:LArPandoraShowerCreation 3.54541 9.09174 15.395 8.4534 3.70819 10
reco:pandoracalo:Calorimetry 2.15295 4.59388 7.32253 4.58918 1.65104 10
reco:pandoracalonosce:Calorimetry 1.95841 3.98866 5.91841 3.673 1.38138 10
reco:pandorapid:Chi2ParticleID 0.00620746 0.00999774 0.0157788 0.00921469 0.00262279 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0604238 0.0943851 0.133336 0.0931034 0.0234533 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00584553 0.0098204 0.0134544 0.00977228 0.00226334 10
reco:pandoraShowercalo:ShowerCalorimetry 3.28525 8.90225 13.7869 8.48811 3.46306 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.23139 8.48604 17.5246 7.85111 3.73952 10
reco:emtrkmichelid:EmTrackMichelId 225.801 340.778 479.083 338.172 63.61 10
reco:crttag:SingleCRTMatchingProducer 0.0148558 0.0212447 0.030291 0.0196031 0.00474872 10
reco:crtreco:TwoCRTMatchingProducer 0.0113893 0.0160702 0.024314 0.0151241 0.0036086 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.963683 1.38483 2.10525 1.24466 0.33852 10
reco:pandora2Track:LArPandoraTrackCreation 11.6337 25.2988 44.9644 21.5534 9.43554 10
reco:pandora2calo:Calorimetry 5.23281 12.4358 22.3712 12.3236 4.287 10
reco:pandora2calonosce:Calorimetry 3.45552 10.9963 16.5778 10.0779 3.60374 10
reco:pandora2pid:Chi2ParticleID 0.0138056 0.0230274 0.0286288 0.0245855 0.00423401 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.057782 0.111846 0.141081 0.12109 0.0247481 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0138645 0.0228234 0.0291176 0.024215 0.00429589 10
reco:pandora2Shower:LArPandoraShowerCreation 3.18905 9.30657 16.5406 9.43816 3.37565 10
reco:pandora2Showercalo:ShowerCalorimetry 3.01668 8.79554 14.6587 8.20758 3.03784 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.66388 8.16751 11.6708 8.25939 2.65833 10
[art]:TriggerResults:TriggerResultInserter 5.2932e-05 0.000100339 0.000222855 7.8852e-05 5.02499e-05 10
end_path:out1:RootOutput 9.57e-06 1.50913e-05 2.5931e-05 1.44105e-05 3.96645e-06 10
end_path:out1:RootOutput(write) 2.71882 4.86078 6.40799 4.81483 0.946805 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5312.88 MB
Peak resident set size usage (VmHWM): 4457.1 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.33 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.92 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11194320
-rw-r--r--. 1 cuser cuser 2599840820 Dec 26 04:33 detsim_stage2.root
-rw-r--r--. 1 cuser cuser 2469387286 Dec 26 04:29 detsim_stage1.root
-rw-r--r--. 1 cuser cuser 2309985610 Dec 26 06:19 reco_stage1.root
-rw-r--r--. 1 cuser cuser 2052441984 Dec 26 01:45 g4_stage2.root
-rw-r--r--. 1 cuser cuser 1949550454 Dec 26 01:26 g4_stage1.root
-rw-r--r--. 1 cuser cuser 81160110 Dec 26 06:11 Pandora_Events.pndr
-rw-r--r--. 1 cuser cuser 242978 Dec 26 06:20 jobscript.log
-rw-r--r--. 1 cuser cuser 217088 Dec 26 06:19 mem.db
-rw-r--r--. 1 cuser cuser 62376 Dec 26 06:19 Pandora_Geometry.xml
-rw-r--r--. 1 cuser cuser 36864 Dec 26 06:19 time.db
-rw-r--r--. 1 cuser cuser 519 Dec 26 04:33 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 cuser cuser 519 Dec 26 01:45 g4_protoDUNE_hist.root
-rw-r--r--. 1 cuser cuser 519 Dec 26 06:19 protoDUNE_reco1_hist.root
-rw-r--r--. 1 cuser cuser 52 Dec 26 01:16 all-input-dids.txt
-rw-r--r--. 1 cuser cuser 7 Dec 26 06:20 justin-processed-pfns.txt
-rw-r--r--. 1 cuser cuser 0 Dec 26 04:43 ProtoDUNE.log
-rw-r--r--. 1 cuser cuser 0 Dec 26 04:33 debugprod.log
