Jobsub ID 252107.1@dunegpschedd01.fnal.gov
| Jobsub ID | 252107.1@dunegpschedd01.fnal.gov |
| Workflow ID | 10218 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-15 17:20:00 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-15 19:24:27 |
| From worker node | Hostname | dunegli-7611514-0-fnpc23038.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-15 17:32:14 |
| Input files | monte-carlo-010218-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6719s) |
| CPU time | 1h (6649s = 98%) |
| Max RSS bytes | 4066025472 (3877 MiB) |
| Outputting started | 2025-11-15 19:24:13 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10218/1/001/reco_stage1.root
|
| Finished | 2025-11-15 19:24:27 |
| Saved logs | justin-logs:252107.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 109112 traces, 0 summary
Retagger: tagging trace set: gauss with 84479 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 84479 traces tagged "gauss"
FrameSaver: q=2.88288e+06 n=1510486 tag=gauss
wclsFrameSaver: saving 109112 traces tagged "wiener"
FrameSaver: q=3.06425e+06 n=1345993 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22591 XUs and 20786 XVs -> 209 XUVs
C:0 T:1 38539 XUs and 33877 XVs -> 2828 XUVs
C:0 T:2 190321 XUs and 147158 XVs -> 10168 XUVs
C:0 T:3 59221 XUs and 56542 XVs -> 532 XUVs
C:0 T:4 9281 XUs and 5839 XVs -> 40 XUVs
C:0 T:5 38378 XUs and 15776 XVs -> 2754 XUVs
C:0 T:6 83738 XUs and 77630 XVs -> 4704 XUVs
C:0 T:7 32936 XUs and 29989 XVs -> 254 XUVs
C:0 T:8 9269 XUs and 6869 XVs -> 72 XUVs
C:0 T:9 59773 XUs and 56275 XVs -> 3679 XUVs
C:0 T:10 37514 XUs and 20480 XVs -> 3576 XUVs
C:0 T:11 1381 XUs and 881 XVs -> 146 XUVs
28962 XUVs total
9508 collection wire objects
26394 potential space points
Neighbour search...
2075238 tests to find 996666 neighbours
Iterating with no regularization...
Begin: 6.44214e+07
0 4.75707e+07
1 4.66195e+07
2 4.64658e+07
3 4.64127e+07
4 4.63872e+07
Now with regularization...
Begin: 3.89251e+07
0 3.89028e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410532752
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410532752
fLifetime: 30000 [us]
15-Nov-2025 19:24:12 UTC Closed output file "reco_stage1.root"
15-Nov-2025 19:24:12 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 125.34 184.41 228.993 181.138 31.7268 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000715271 0.00252682 0.004173 0.00247541 0.00108978 10
reco:ophit:OpHitFinder 0.165579 0.192828 0.221696 0.194683 0.0163146 10
reco:opflash:OpFlashFinder 0.0943208 0.114242 0.130466 0.116957 0.0132839 10
reco:opslicer:OpSlicer 0.337891 0.435584 0.526578 0.430065 0.0533563 10
reco:caldata:DataPrepModule 3.32775 3.44665 3.7152 3.43802 0.102098 10
reco:wclsdatasp:WireCellToolkit 22.2169 23.1482 24.1254 23.2405 0.632074 10
reco:gaushit:GausHitFinder 0.477889 0.680945 0.845942 0.669716 0.114747 10
reco:nhitsfilter:NumberOfHitsFilter 0.000188168 0.000297446 0.000430879 0.000287371 6.27211e-05 10
reco:reco3d:SpacePointSolver 3.25457 7.2631 10.8569 7.34584 2.42134 10
reco:hitpdune:DisambigFromSpacePoints 0.438182 0.875941 1.22521 0.859137 0.249218 10
reco:pandora:StandardPandora 7.95588 16.0555 22.8683 15.1015 4.76622 10
reco:pandoraWriter:StandardPandora 0.157842 0.222296 0.294719 0.21247 0.0409454 10
reco:pandoraTrack:LArPandoraTrackCreation 1.02475 1.62693 2.12095 1.75312 0.325948 10
reco:pandoraShower:LArPandoraShowerCreation 1.00226 1.97605 2.8994 1.92172 0.581636 10
reco:pandoracalo:Calorimetry 0.597111 1.0174 1.34762 1.09132 0.229486 10
reco:pandoracalonosce:Calorimetry 0.544543 0.934293 1.25001 1.00191 0.216044 10
reco:pandorapid:Chi2ParticleID 0.00246156 0.00308184 0.00391343 0.00311601 0.000425975 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0183844 0.0287336 0.0348593 0.029986 0.00479703 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00224757 0.00274188 0.0030436 0.00282322 0.000252461 10
reco:pandoraShowercalo:ShowerCalorimetry 1.05295 2.26054 3.44383 2.2326 0.771985 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.02489 2.20048 3.36008 2.18066 0.75393 10
reco:emtrkmichelid:EmTrackMichelId 69.741 100.414 119.997 99.3555 15.5365 10
reco:crttag:SingleCRTMatchingProducer 0.00441465 0.00738199 0.0132384 0.00712572 0.00225098 10
reco:crtreco:TwoCRTMatchingProducer 0.00290547 0.00440149 0.0052532 0.0046255 0.000775105 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.328778 0.534864 0.765468 0.521686 0.120984 10
reco:pandora2Track:LArPandoraTrackCreation 2.96121 5.61326 8.01071 5.68296 1.53601 10
reco:pandora2calo:Calorimetry 1.53571 3.1126 4.56399 3.19951 0.949552 10
reco:pandora2calonosce:Calorimetry 1.45899 2.96918 4.36517 3.05534 0.913892 10
reco:pandora2pid:Chi2ParticleID 0.00574044 0.00730142 0.00895525 0.00765142 0.00100201 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0257876 0.0365805 0.0436953 0.0370826 0.00557639 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00556835 0.00701712 0.00833068 0.00726714 0.000901284 10
reco:pandora2Shower:LArPandoraShowerCreation 1.14957 2.12514 3.00115 2.14682 0.551585 10
reco:pandora2Showercalo:ShowerCalorimetry 1.38119 2.77516 4.07497 2.86956 0.854384 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.28522 2.58375 3.81716 2.66835 0.800783 10
[art]:TriggerResults:TriggerResultInserter 2.9906e-05 3.9539e-05 9.5601e-05 3.413e-05 1.88354e-05 10
end_path:out1:RootOutput 8.316e-06 9.7838e-06 1.4007e-05 9.0025e-06 1.68442e-06 10
end_path:out1:RootOutput(write) 1.15465 1.68127 2.01937 1.67901 0.276166 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4881.81 MB
Peak resident set size usage (VmHWM): 4066.03 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9627400
-rw-r--r-- 1 dunegli fnalgrid 2276749710 Nov 15 18:52 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2164455173 Nov 15 18:51 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1935543306 Nov 15 19:24 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1740392686 Nov 15 17:41 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1672228848 Nov 15 17:35 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 68473700 Nov 15 19:22 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242786 Nov 15 19:24 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 15 19:24 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 15 19:24 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 15 19:24 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 18:52 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 17:41 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 19:24 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 15 17:32 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 15 19:24 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 15 18:55 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 15 18:52 debugprod.log
