Jobsub ID 14222.0@dunegpschedd02.fnal.gov
| Jobsub ID | 14222.0@dunegpschedd02.fnal.gov |
| Workflow ID | 279 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-08-03 20:18:57 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-08-03 22:04:04 |
| From worker node | Hostname | dunegli-6302047-0-fnpc22036.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-08-03 20:20:40 |
| Input files | monte-carlo-000279-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6191s) |
| CPU time | 1h (6120s = 98%) |
| Max RSS bytes | 4107149312 (3916 MiB) |
| Outputting started | 2025-08-03 22:03:52 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00279/1/001/reco_stage1.root
|
| Finished | 2025-08-03 22:04:04 |
| Saved logs | justin-logs:14222.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ervice:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120209 traces, 0 summary
Retagger: tagging trace set: gauss with 93193 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 93193 traces tagged "gauss"
FrameSaver: q=3.28009e+06 n=1676477 tag=gauss
wclsFrameSaver: saving 120209 traces tagged "wiener"
FrameSaver: q=3.45744e+06 n=1490049 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 27784 XUs and 29663 XVs -> 280 XUVs
C:0 T:1 52971 XUs and 52453 XVs -> 2631 XUVs
C:0 T:2 102717 XUs and 78968 XVs -> 3915 XUVs
C:0 T:3 49027 XUs and 28683 XVs -> 319 XUVs
C:0 T:4 14218 XUs and 14242 XVs -> 90 XUVs
C:0 T:5 51812 XUs and 40168 XVs -> 3489 XUVs
C:0 T:6 117163 XUs and 100477 XVs -> 7411 XUVs
C:0 T:7 46388 XUs and 38790 XVs -> 454 XUVs
C:0 T:8 5595 XUs and 6728 XVs -> 35 XUVs
C:0 T:9 36777 XUs and 55867 XVs -> 4572 XUVs
C:0 T:10 40282 XUs and 18977 XVs -> 6181 XUVs
C:0 T:11 66 XUs and 27 XVs -> 10 XUVs
29387 XUVs total
10582 collection wire objects
27275 potential space points
Neighbour search...
1933667 tests to find 1031264 neighbours
Iterating with no regularization...
Begin: 7.35335e+07
0 6.20947e+07
1 6.12302e+07
2 6.11294e+07
3 6.11069e+07
Now with regularization...
Begin: 5.12425e+07
0 5.12017e+07
Failure in algorithm Alg0003, LArMaster, STATUS_CODE_NOT_INITIALIZED
run: 1 ; subrun: 0 ; event: 10
evttime: 408442941
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 408442941
fLifetime: 30000 [us]
03-Aug-2025 22:03:51 UTC Closed output file "reco_stage1.root"
03-Aug-2025 22:03:51 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 130.339 176.811 223.622 184.849 32.633 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000623639 0.00265669 0.00385546 0.00264806 0.00105398 10
reco:ophit:OpHitFinder 0.151355 0.17832 0.217564 0.183293 0.0215644 10
reco:opflash:OpFlashFinder 0.0706483 0.103867 0.145548 0.105268 0.0255117 10
reco:opslicer:OpSlicer 0.261018 0.364659 0.498642 0.381384 0.0740827 10
reco:caldata:DataPrepModule 3.28569 3.43367 3.65647 3.42314 0.0933003 10
reco:wclsdatasp:WireCellToolkit 22.6949 23.3818 24.122 23.541 0.457827 10
reco:gaushit:GausHitFinder 0.434555 0.614805 0.783149 0.631006 0.112778 10
reco:nhitsfilter:NumberOfHitsFilter 0.000240255 0.000349312 0.00047056 0.000362375 7.08581e-05 10
reco:reco3d:SpacePointSolver 3.66197 6.57342 9.21401 6.77036 2.20341 10
reco:hitpdune:DisambigFromSpacePoints 0.506815 0.80491 1.26108 0.840542 0.227995 10
reco:pandora:StandardPandora 7.23368 14.8507 23.6223 14.4515 5.50049 10
reco:pandoraWriter:StandardPandora 0.153504 0.225133 0.277682 0.247251 0.0434353 10
reco:pandoraTrack:LArPandoraTrackCreation 0.855257 1.77622 2.8092 1.7428 0.596898 10
reco:pandoraShower:LArPandoraShowerCreation 0.975337 1.78422 2.57651 1.90601 0.612623 10
reco:pandoracalo:Calorimetry 0.525034 1.04827 1.60133 1.08448 0.323389 10
reco:pandoracalonosce:Calorimetry 0.470352 1.01189 1.58573 1.02405 0.359587 10
reco:pandorapid:Chi2ParticleID 0.00225664 0.00310694 0.00377074 0.0030305 0.000518384 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.020446 0.028854 0.0360204 0.029865 0.00457627 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00212564 0.00291301 0.00384562 0.00275824 0.000567361 10
reco:pandoraShowercalo:ShowerCalorimetry 1.00492 2.03136 3.03011 2.16337 0.797213 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.983532 1.98023 2.9753 2.11101 0.784208 10
reco:emtrkmichelid:EmTrackMichelId 73.4717 96.4213 120.858 101.053 15.3929 10
reco:crttag:SingleCRTMatchingProducer 0.0050021 0.0069811 0.00939735 0.00704594 0.00143353 10
reco:crtreco:TwoCRTMatchingProducer 0.00315662 0.00446972 0.00554551 0.00456282 0.000780331 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.384687 0.551646 0.669598 0.568068 0.0806232 10
reco:pandora2Track:LArPandoraTrackCreation 2.85622 5.33788 7.80978 5.679 1.75337 10
reco:pandora2calo:Calorimetry 1.52193 2.88211 4.13792 3.09266 0.990459 10
reco:pandora2calonosce:Calorimetry 1.43041 2.73445 4.0011 2.94197 0.961682 10
reco:pandora2pid:Chi2ParticleID 0.0052331 0.00690984 0.00927967 0.00706606 0.00122894 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0241177 0.0343493 0.0437104 0.0361911 0.00616581 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00507474 0.00679302 0.00947465 0.00684356 0.00130772 10
reco:pandora2Shower:LArPandoraShowerCreation 1.1033 2.02247 2.95194 2.16834 0.648537 10
reco:pandora2Showercalo:ShowerCalorimetry 1.32695 2.53736 3.5377 2.75688 0.882536 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.22006 2.3701 3.43509 2.56637 0.831808 10
[art]:TriggerResults:TriggerResultInserter 3.163e-05 4.20006e-05 8.6484e-05 3.61935e-05 1.52992e-05 10
end_path:out1:RootOutput 6.402e-06 9.0832e-06 1.2363e-05 9.383e-06 1.90158e-06 10
end_path:out1:RootOutput(write) 1.20747 1.63607 2.09857 1.73371 0.279804 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4915.29 MB
Peak resident set size usage (VmHWM): 4107.15 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 8993252
-rw-r--r-- 1 dunegli fnalgrid 2161191229 Aug 3 21:33 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2056498410 Aug 3 21:32 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1807977945 Aug 3 22:03 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1591373893 Aug 3 20:29 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1525572067 Aug 3 20:23 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 65860870 Aug 3 22:01 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242735 Aug 3 22:03 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Aug 3 22:03 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Aug 3 22:03 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Aug 3 22:03 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Aug 3 21:33 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Aug 3 20:29 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Aug 3 22:03 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Aug 3 20:20 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Aug 3 22:03 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Aug 3 21:36 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Aug 3 21:33 debugprod.log
