Jobsub ID 261531.0@dunegpschedd02.fnal.gov
| Jobsub ID | 261531.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11156 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 09:47:15 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 19:59:43 |
| From worker node | Hostname | dunegli-8047050-0-fnpc17109.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:37:10 |
| Input files | monte-carlo-011156-000001
|
| Jobscript | Exit code | 0 |
| Real time | 8h (30099s) |
| CPU time | 8h (29835s = 99%) |
| Max RSS bytes | 4286963712 (4088 MiB) |
| Outputting started | 2025-12-12 19:58:50 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11156/1/001/reco_stage1.root
|
| Finished | 2025-12-12 19:59:43 |
| Saved logs | justin-logs:261531.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 169981 traces, 0 summary
Retagger: tagging trace set: gauss with 125550 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 125550 traces tagged "gauss"
FrameSaver: q=4.54325e+06 n=2185077 tag=gauss
wclsFrameSaver: saving 169981 traces tagged "wiener"
FrameSaver: q=4.82256e+06 n=1919123 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 37253 XUs and 40075 XVs -> 687 XUVs
C:0 T:1 60338 XUs and 60602 XVs -> 8989 XUVs
C:0 T:2 127686 XUs and 154058 XVs -> 7028 XUVs
C:0 T:3 65176 XUs and 62222 XVs -> 390 XUVs
C:0 T:4 15276 XUs and 13238 XVs -> 285 XUVs
C:0 T:5 209562 XUs and 115986 XVs -> 46101 XUVs
C:0 T:6 75636 XUs and 90626 XVs -> 3883 XUVs
C:0 T:7 30614 XUs and 35035 XVs -> 256 XUVs
C:0 T:8 8119 XUs and 5840 XVs -> 102 XUVs
C:0 T:9 83084 XUs and 63421 XVs -> 12235 XUVs
C:0 T:10 124892 XUs and 105987 XVs -> 17587 XUVs
C:0 T:11 330 XUs and 246 XVs -> 18 XUVs
97561 XUVs total
14273 collection wire objects
93641 potential space points
Neighbour search...
25681451 tests to find 10164600 neighbours
Iterating with no regularization...
Begin: 8.31189e+07
0 6.72521e+07
1 6.60871e+07
2 6.59221e+07
3 6.5874e+07
Now with regularization...
Begin: 5.344e+07
0 5.33723e+07
1 5.33236e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411058640
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058640
fLifetime: 30000 [us]
12-Dec-2025 19:58:46 UTC Closed output file "reco_stage1.root"
12-Dec-2025 19:58:46 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 882.115 1429.82 1931.7 1344.91 327.529 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00278833 0.0104101 0.0241053 0.00807738 0.00721663 10
reco:ophit:OpHitFinder 0.344236 0.48372 0.646608 0.464837 0.108158 10
reco:opflash:OpFlashFinder 0.26057 0.561543 0.982653 0.536877 0.235223 10
reco:opslicer:OpSlicer 0.867216 1.18817 1.6427 1.22245 0.252501 10
reco:caldata:DataPrepModule 7.26398 9.77029 11.7122 10.0631 1.43498 10
reco:wclsdatasp:WireCellToolkit 83.1203 116.07 153.796 111.469 24.9333 10
reco:gaushit:GausHitFinder 1.98501 2.93505 4.22487 2.75266 0.722371 10
reco:nhitsfilter:NumberOfHitsFilter 0.00181103 0.00286898 0.00437531 0.00274877 0.000884684 10
reco:reco3d:SpacePointSolver 22.6773 38.1882 81.0928 30.9995 16.8509 10
reco:hitpdune:DisambigFromSpacePoints 3.31994 6.22177 12.0392 5.46369 2.94556 10
reco:pandora:StandardPandora 73.4377 132.186 223.454 121.52 48.4314 10
reco:pandoraWriter:StandardPandora 0.863066 1.34221 1.94809 1.27518 0.324235 10
reco:pandoraTrack:LArPandoraTrackCreation 26.598 39.8829 53.798 38.8689 8.92107 10
reco:pandoraShower:LArPandoraShowerCreation 29.6487 51.6502 72.0757 48.9176 12.8861 10
reco:pandoracalo:Calorimetry 12.2871 20.513 29.5222 18.8393 5.60867 10
reco:pandoracalonosce:Calorimetry 11.8556 20.2194 29.9166 18.8486 5.74966 10
reco:pandorapid:Chi2ParticleID 0.00947864 0.016834 0.0224508 0.0180699 0.00429009 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0931555 0.140636 0.200075 0.137985 0.0329609 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00844529 0.014767 0.0195274 0.0147331 0.00359352 10
reco:pandoraShowercalo:ShowerCalorimetry 32.5399 56.9993 87.7395 52.4609 17.7938 10
reco:pandoraShowercalonosce:ShowerCalorimetry 31.446 54.9815 89.3947 52.1614 16.4163 10
reco:emtrkmichelid:EmTrackMichelId 241.597 390.289 495.613 397.677 74.8484 10
reco:crttag:SingleCRTMatchingProducer 0.0692541 0.101502 0.148102 0.0978407 0.021196 10
reco:crtreco:TwoCRTMatchingProducer 0.0629198 0.0903951 0.124594 0.0877373 0.0179959 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.73564 3.60117 5.35283 3.39457 1.24141 10
reco:pandora2Track:LArPandoraTrackCreation 76.5327 153.649 215.824 146.114 40.6387 10
reco:pandora2calo:Calorimetry 32.3041 78.9507 128.595 75.452 25.5609 10
reco:pandora2calonosce:Calorimetry 30.5965 78.5502 124.242 71.1201 24.9423 10
reco:pandora2pid:Chi2ParticleID 0.0184433 0.0437782 0.0572245 0.0443589 0.0101601 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.102322 0.204119 0.250705 0.204679 0.0408283 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0173636 0.0381363 0.0485225 0.0401404 0.00955508 10
reco:pandora2Shower:LArPandoraShowerCreation 25.6202 44.3801 56.1427 45.5643 9.26261 10
reco:pandora2Showercalo:ShowerCalorimetry 28.5998 65.6477 91.1933 67.872 18.1287 10
reco:pandora2Showercalonosce:ShowerCalorimetry 26.2217 54.842 88.3194 52.2774 16.2881 10
[art]:TriggerResults:TriggerResultInserter 0.000118837 0.000188491 0.000383 0.000151535 7.59854e-05 10
end_path:out1:RootOutput 1.8822e-05 3.10285e-05 4.7717e-05 3.00985e-05 9.51402e-06 10
end_path:out1:RootOutput(write) 3.07869 5.49403 7.46849 5.49399 1.22724 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5317.59 MB
Peak resident set size usage (VmHWM): 4286.96 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.24 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.44 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.72 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.29 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11472812
-rw-r--r-- 1 dunegli fnalgrid 2649646887 Dec 12 15:56 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2512470412 Dec 12 15:51 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2401153749 Dec 12 19:58 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2085402705 Dec 12 12:12 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2008626989 Dec 12 11:43 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 90225320 Dec 12 19:36 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243022 Dec 12 19:58 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 19:58 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 19:58 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 19:58 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 15:56 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 12:12 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 19:58 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:37 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 19:58 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 16:11 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 15:56 debugprod.log