justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 21447.1@dunegpschedd01.fnal.gov

Jobsub ID21447.1@dunegpschedd01.fnal.gov
Workflow ID608
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-08-07 02:43:08
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2025-08-07 04:48:14
From worker nodeHostnamenode2b08.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-07 02:45:06
Input filesmonte-carlo-000608-000001
JobscriptExit code0
Real time2h (7288s)
CPU time1h (7137s = 97%)
Max RSS bytes4005126144 (3819 MiB)
Outputting started2025-08-07 04:46:34
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/00608/1/001/reco_stage1.root
Finished2025-08-07 04:48:14
Saved logsjustin-logs:21447.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

awDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 140184 traces, 0 summary
Retagger: tagging trace set: gauss with 109083 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109083 traces tagged "gauss"
FrameSaver: q=3.66607e+06 n=1961435 tag=gauss
wclsFrameSaver: saving 140184 traces tagged "wiener"
FrameSaver: q=3.86321e+06 n=1739285 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 58889 XUs and 45752 XVs -> 851 XUVs
C:0 T:1 122499 XUs and 109023 XVs -> 8417 XUVs
C:0 T:2 152001 XUs and 198233 XVs -> 5711 XUVs
C:0 T:3 69911 XUs and 79249 XVs -> 654 XUVs
C:0 T:4 11693 XUs and 11115 XVs -> 96 XUVs
C:0 T:5 44594 XUs and 38409 XVs -> 4765 XUVs
C:0 T:6 135712 XUs and 126706 XVs -> 5019 XUVs
C:0 T:7 49367 XUs and 44842 XVs -> 456 XUVs
C:0 T:8 6160 XUs and 6056 XVs -> 49 XUVs
C:0 T:9 31101 XUs and 38667 XVs -> 2497 XUVs
C:0 T:10 14290 XUs and 10281 XVs -> 1957 XUVs
C:0 T:11 370 XUs and 270 XVs -> 56 XUVs
30528 XUVs total
12879 collection wire objects
27697 potential space points
Neighbour search...
1543599 tests to find 780782 neighbours
Iterating with no regularization...
Begin: 7.12671e+07
0 5.72708e+07
1 5.65879e+07
2 5.65135e+07
3 5.64959e+07
Now with regularization...
Begin: 4.73628e+07
0 4.73541e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 408508983
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 408508983
fLifetime: 30000 [us]
07-Aug-2025 05:46:32 BST  Closed output file "reco_stage1.root"
07-Aug-2025 05:46:32 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          122.921       259.719       311.572       276.015       53.3595        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000669908   0.00273978    0.00442505    0.00283315    0.00117736       10     
reco:ophit:OpHitFinder                              0.14463      0.213696      0.235416      0.225276      0.0274162       10     
reco:opflash:OpFlashFinder                         0.0783483     0.141974      0.175573      0.149143      0.0287745       10     
reco:opslicer:OpSlicer                             0.229464      0.420659      0.522278      0.426525      0.0798746       10     
reco:caldata:DataPrepModule                         4.19292       4.45548       4.70746       4.46188      0.117439        10     
reco:wclsdatasp:WireCellToolkit                     35.1501       36.7298       37.9801       37.0616      0.953349        10     
reco:gaushit:GausHitFinder                         0.472023       1.09398       1.37146       1.18294      0.239421        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000246218   0.00051869    0.000653151   0.000536531   0.000117218      10     
reco:reco3d:SpacePointSolver                        2.95719       10.7411       18.3222       11.2585       4.25723        10     
reco:hitpdune:DisambigFromSpacePoints              0.358561       1.15349       1.57579       1.22408      0.338665        10     
reco:pandora:StandardPandora                        5.06923       25.7918       38.9157       27.8726       9.15396        10     
reco:pandoraWriter:StandardPandora                  0.15888      0.334906      0.395538      0.345612      0.0644928       10     
reco:pandoraTrack:LArPandoraTrackCreation          0.901188       3.00056       3.72134       3.23895      0.801212        10     
reco:pandoraShower:LArPandoraShowerCreation        0.718692       3.61572       5.07062       3.97307       1.18049        10     
reco:pandoracalo:Calorimetry                       0.503266       1.67673       2.09743       1.82951      0.466145        10     
reco:pandoracalonosce:Calorimetry                  0.434488       1.51786       1.98338       1.6662       0.429843        10     
reco:pandorapid:Chi2ParticleID                    0.00229291    0.00419453    0.00520895    0.00425911    0.000790353      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0200265     0.0391217     0.0525868     0.0400384    0.00825672       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00219587    0.00404552    0.00536873    0.00413063    0.000792915      10     
reco:pandoraShowercalo:ShowerCalorimetry           0.653722       3.64637       5.11913       4.06403       1.27029        10     
reco:pandoraShowercalonosce:ShowerCalorimetry      0.631954       3.52166       4.97388       3.99414       1.22438        10     
reco:emtrkmichelid:EmTrackMichelId                  61.8822       126.112       149.286       133.614       24.5988        10     
reco:crttag:SingleCRTMatchingProducer             0.00614978     0.0135446     0.0158766     0.0142253     0.0026275       10     
reco:crtreco:TwoCRTMatchingProducer                0.004276     0.00803984    0.00979004     0.0085109    0.00150477       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.433814      0.845758       1.05124      0.930762      0.178983        10     
reco:pandora2Track:LArPandoraTrackCreation          2.19009       10.3665       13.5366       11.3271       3.2571         10     
reco:pandora2calo:Calorimetry                       1.07481       5.01901       6.72225       5.49002       1.62132        10     
reco:pandora2calonosce:Calorimetry                 0.992217       4.78883       6.24114       5.35036       1.55968        10     
reco:pandora2pid:Chi2ParticleID                   0.00477285     0.0108466     0.0146987     0.0111484    0.00246725       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0221179     0.049244      0.0607241     0.0516775     0.0106098       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00467925     0.0107748     0.0138092     0.0114361    0.00234517       10     
reco:pandora2Shower:LArPandoraShowerCreation       0.877324       3.7939        4.79559       4.33171       1.1497         10     
reco:pandora2Showercalo:ShowerCalorimetry          0.922719       4.44854       5.86936       4.90968       1.43924        10     
reco:pandora2Showercalonosce:ShowerCalorimetry     0.852793       4.08858       5.31871       4.58887       1.33714        10     
[art]:TriggerResults:TriggerResultInserter        2.7529e-05    3.61075e-05   7.1176e-05    3.37215e-05   1.19797e-05      10     
end_path:out1:RootOutput                           5.494e-06    6.2874e-06     9.218e-06     5.973e-06    1.00027e-06      10     
end_path:out1:RootOutput(write)                    0.921072       1.98039       2.44251       2.11352      0.412557        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4810.87 MB
  Peak resident set size usage (VmHWM): 4005.13 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.80 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.12 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9387748
-rw-r--r-- 1 gl05pi6 eddie_users 2237989470 Aug  7 05:01 detsim_stage2.root
-rw-r--r-- 1 gl05pi6 eddie_users 2130959379 Aug  7 05:00 detsim_stage1.root
-rw-r--r-- 1 gl05pi6 eddie_users 1910815159 Aug  7 05:46 reco_stage1.root
-rw-r--r-- 1 gl05pi6 eddie_users 1665121406 Aug  7 03:58 g4_stage2.root
-rw-r--r-- 1 gl05pi6 eddie_users 1595344724 Aug  7 03:50 g4_stage1.root
-rw-r--r-- 1 gl05pi6 eddie_users   71948380 Aug  7 05:42 Pandora_Events.pndr
-rw-r--r-- 1 gl05pi6 eddie_users     491391 Aug  7 05:46 jobscript.log
-rw-r--r-- 1 gl05pi6 eddie_users     217088 Aug  7 05:46 mem.db
-rw-r--r-- 1 gl05pi6 eddie_users      62376 Aug  7 05:46 Pandora_Geometry.xml
-rw-r--r-- 1 gl05pi6 eddie_users      36864 Aug  7 05:46 time.db
-rw-r--r-- 1 gl05pi6 eddie_users        519 Aug  7 05:01 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi6 eddie_users        519 Aug  7 03:58 g4_protoDUNE_hist.root
-rw-r--r-- 1 gl05pi6 eddie_users        519 Aug  7 05:46 protoDUNE_reco1_hist.root
-rw-r--r-- 1 gl05pi6 eddie_users         52 Aug  7 03:45 all-input-dids.txt
-rw-r--r-- 1 gl05pi6 eddie_users          7 Aug  7 05:46 justin-processed-pfns.txt
-rw-r--r-- 1 gl05pi6 eddie_users          0 Aug  7 05:06 ProtoDUNE.log
-rw-r--r-- 1 gl05pi6 eddie_users          0 Aug  7 05:01 debugprod.log
justIN time: 2025-09-18 23:20:49 UTC       justIN version: 01.05.00