Jobsub ID 293440.1@dunegpschedd02.fnal.gov
| Jobsub ID | 293440.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12215 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-22 08:02:45 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-22 10:23:18 |
| From worker node | Hostname | dunegli-8397091-0-fnpc22032.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-22 08:03:55 |
| Input files | monte-carlo-012215-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8349s) |
| CPU time | 2h (8233s = 98%) |
| Max RSS bytes | 4485357568 (4277 MiB) |
| Outputting started | 2026-01-22 10:23:05 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12215/1/001/reco_stage1.root
|
| Finished | 2026-01-22 10:23:18 |
| Saved logs | justin-logs:293440.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
PrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 105284 traces, 0 summary
Retagger: tagging trace set: gauss with 79017 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 79017 traces tagged "gauss"
FrameSaver: q=2.55864e+06 n=1326487 tag=gauss
wclsFrameSaver: saving 105284 traces tagged "wiener"
FrameSaver: q=2.71922e+06 n=1163493 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 9624 XUs and 17372 XVs -> 152 XUVs
C:0 T:1 26307 XUs and 44427 XVs -> 5757 XUVs
C:0 T:2 26786 XUs and 31362 XVs -> 886 XUVs
C:0 T:3 17140 XUs and 15837 XVs -> 61 XUVs
C:0 T:4 11763 XUs and 14546 XVs -> 98 XUVs
C:0 T:5 43836 XUs and 46576 XVs -> 5045 XUVs
C:0 T:6 38530 XUs and 63530 XVs -> 2592 XUVs
C:0 T:7 15869 XUs and 25560 XVs -> 114 XUVs
C:0 T:8 9560 XUs and 8648 XVs -> 66 XUVs
C:0 T:9 59345 XUs and 78862 XVs -> 7058 XUVs
C:0 T:10 63594 XUs and 32178 XVs -> 5788 XUVs
C:0 T:11 772 XUs and 271 XVs -> 54 XUVs
27671 XUVs total
8777 collection wire objects
26116 potential space points
Neighbour search...
2547864 tests to find 1283890 neighbours
Iterating with no regularization...
Begin: 4.68658e+07
0 4.06673e+07
1 4.0174e+07
2 4.01042e+07
3 4.00839e+07
Now with regularization...
Begin: 3.30785e+07
0 3.30578e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411893345
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411893345
fLifetime: 30000 [us]
22-Jan-2026 10:23:04 UTC Closed output file "reco_stage1.root"
22-Jan-2026 10:23:04 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 156.308 247.456 357.613 251.602 52.4798 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000837602 0.00307174 0.00475204 0.00323607 0.00132535 10
reco:ophit:OpHitFinder 0.205649 0.232541 0.255321 0.236854 0.0167346 10
reco:opflash:OpFlashFinder 0.128119 0.168351 0.215866 0.166971 0.0265688 10
reco:opslicer:OpSlicer 0.359211 0.500545 0.603642 0.510926 0.0705337 10
reco:caldata:DataPrepModule 3.56847 3.6808 3.75897 3.69257 0.0614155 10
reco:wclsdatasp:WireCellToolkit 23.9585 25.0265 26.5006 24.9828 0.692311 10
reco:gaushit:GausHitFinder 0.554545 0.853448 1.14464 0.886216 0.161718 10
reco:nhitsfilter:NumberOfHitsFilter 0.000340663 0.000427243 0.000519942 0.000430139 6.22808e-05 10
reco:reco3d:SpacePointSolver 3.82395 11.819 25.2009 10.4504 5.2849 10
reco:hitpdune:DisambigFromSpacePoints 0.657431 1.30744 2.30132 1.29609 0.442956 10
reco:pandora:StandardPandora 11.597 25.4322 47.0901 24.4854 10.0025 10
reco:pandoraWriter:StandardPandora 0.208433 0.317656 0.417351 0.324222 0.0539488 10
reco:pandoraTrack:LArPandoraTrackCreation 1.82025 2.9449 4.46819 3.08704 0.764366 10
reco:pandoraShower:LArPandoraShowerCreation 1.45484 3.59864 6.68358 3.34665 1.48288 10
reco:pandoracalo:Calorimetry 1.02363 1.75764 2.52232 1.7829 0.473829 10
reco:pandoracalonosce:Calorimetry 0.931881 1.60532 2.26398 1.65325 0.424359 10
reco:pandorapid:Chi2ParticleID 0.00329909 0.00403728 0.00456811 0.00411789 0.000468835 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0262416 0.0360508 0.0462514 0.036128 0.00554944 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00305801 0.00382491 0.00467362 0.00370546 0.000437337 10
reco:pandoraShowercalo:ShowerCalorimetry 1.44672 3.79481 6.91204 3.87709 1.39676 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.41403 3.74079 6.7137 3.82507 1.36791 10
reco:emtrkmichelid:EmTrackMichelId 86.6035 125.902 166.455 128.309 21.4162 10
reco:crttag:SingleCRTMatchingProducer 0.00790708 0.011524 0.0165909 0.0104887 0.00297825 10
reco:crtreco:TwoCRTMatchingProducer 0.00426621 0.00633049 0.00797906 0.00648136 0.00105983 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.513774 0.737444 0.970809 0.705942 0.153993 10
reco:pandora2Track:LArPandoraTrackCreation 4.52922 9.84185 16.5937 9.83462 3.30786 10
reco:pandora2calo:Calorimetry 2.19431 5.20385 7.86575 5.31182 1.58431 10
reco:pandora2calonosce:Calorimetry 2.07476 4.93486 7.47459 5.04194 1.49652 10
reco:pandora2pid:Chi2ParticleID 0.00736719 0.00960738 0.0127013 0.00983555 0.00163399 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0320049 0.0454853 0.0583477 0.0467198 0.00743485 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00687572 0.00935492 0.0121181 0.00956871 0.00159482 10
reco:pandora2Shower:LArPandoraShowerCreation 1.6129 3.37458 5.33018 3.41506 1.04035 10
reco:pandora2Showercalo:ShowerCalorimetry 1.84804 4.33298 6.65922 4.5327 1.2998 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.67564 3.95286 6.08527 3.98542 1.18686 10
[art]:TriggerResults:TriggerResultInserter 3.189e-05 4.67133e-05 9.509e-05 4.04915e-05 1.7154e-05 10
end_path:out1:RootOutput 9.248e-06 1.13024e-05 1.5159e-05 1.1256e-05 1.57928e-06 10
end_path:out1:RootOutput(write) 1.46868 2.17953 3.0372 2.12438 0.408522 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5299.41 MB
Peak resident set size usage (VmHWM): 4485.36 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.16 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.31 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10845460
-rw-r--r-- 1 dunegli fnalgrid 2524708192 Jan 22 09:40 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2393046833 Jan 22 09:39 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2241940438 Jan 22 10:23 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1971782166 Jan 22 08:16 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1891171918 Jan 22 08:07 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 82419940 Jan 22 10:21 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242890 Jan 22 10:23 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 22 10:23 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 22 10:23 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 22 10:23 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 22 09:40 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 22 08:16 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 22 10:23 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 22 08:03 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 22 10:23 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 22 09:44 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 22 09:40 debugprod.log
