justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 234199.0@dunegpschedd01.fnal.gov

Jobsub ID234199.0@dunegpschedd01.fnal.gov
Workflow ID9016
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-15 08:19:10
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2025-10-15 10:46:10
From worker nodeHostnamen265.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 9534 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-15 08:20:35
Input filesmonte-carlo-009016-000001
JobscriptExit code0
Real time2h (8644s)
CPU time2h (8443s = 97%)
Max RSS bytes4402089984 (4198 MiB)
Outputting started2025-10-15 10:44:40
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09016/1/001/reco_stage1.root
Finished2025-10-15 10:46:10
Saved logsjustin-logs:234199.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

adcKeepAllSignalFinder
ToolBasedRawDigitPrepService:prepare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 139034 traces, 0 summary
Retagger: tagging trace set: gauss with 105535 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 105535 traces tagged "gauss"
FrameSaver: q=3.59475e+06 n=1827039 tag=gauss
wclsFrameSaver: saving 139034 traces tagged "wiener"
FrameSaver: q=3.8131e+06 n=1613568 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 42656 XUs and 34877 XVs -> 561 XUVs
C:0 T:1 65658 XUs and 55810 XVs -> 4426 XUVs
C:0 T:2 99626 XUs and 169642 XVs -> 12625 XUVs
C:0 T:3 47640 XUs and 53201 XVs -> 513 XUVs
C:0 T:4 13128 XUs and 12553 XVs -> 336 XUVs
C:0 T:5 37303 XUs and 28913 XVs -> 2873 XUVs
C:0 T:6 122517 XUs and 162593 XVs -> 6826 XUVs
C:0 T:7 42675 XUs and 57122 XVs -> 734 XUVs
C:0 T:8 5944 XUs and 6704 XVs -> 72 XUVs
C:0 T:9 28991 XUs and 41684 XVs -> 2192 XUVs
C:0 T:10 19989 XUs and 16292 XVs -> 2641 XUVs
C:0 T:11 385 XUs and 373 XVs -> 54 XUVs
33853 XUVs total
12407 collection wire objects
30332 potential space points
Neighbour search...
3236340 tests to find 1371962 neighbours
Iterating with no regularization...
Begin: 6.49864e+07
0 5.60211e+07
1 5.52435e+07
2 5.51532e+07
3 5.51315e+07
Now with regularization...
Begin: 4.43952e+07
0 4.43837e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 409901602
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 409901602
fLifetime: 30000 [us]
15-Oct-2025 11:44:38 BST  Closed output file "reco_stage1.root"
15-Oct-2025 11:44:38 BST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          173.239       251.14        361.268       242.652       48.4291        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.000802023   0.00340812    0.00512411    0.00363462    0.00128998       10     
reco:ophit:OpHitFinder                             0.199313       0.2335       0.279214      0.237163      0.0247222       10     
reco:opflash:OpFlashFinder                         0.124701      0.162835      0.199647      0.171335      0.0264564       10     
reco:opslicer:OpSlicer                             0.352944      0.459306       0.58232      0.457498      0.0654172       10     
reco:caldata:DataPrepModule                         3.53002       3.64898       4.05086       3.58325       0.14643        10     
reco:wclsdatasp:WireCellToolkit                     24.9458       25.4425       26.3219       25.3664      0.419003        10     
reco:gaushit:GausHitFinder                         0.551067      0.772603      0.964248      0.780889      0.114845        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000270861   0.000464237   0.000712823   0.000454712   0.000149678      10     
reco:reco3d:SpacePointSolver                        7.07376       11.3906       19.3948       11.6109       3.33945        10     
reco:hitpdune:DisambigFromSpacePoints              0.551437      0.983879       1.50574      0.947033      0.251306        10     
reco:pandora:StandardPandora                        13.1338       22.5875       45.5769       20.1008       8.66092        10     
reco:pandoraWriter:StandardPandora                  0.26391      0.358566      0.462486      0.346511      0.0614662       10     
reco:pandoraTrack:LArPandoraTrackCreation           1.61801       4.16425       7.84204       4.08622       1.68538        10     
reco:pandoraShower:LArPandoraShowerCreation         1.49023       4.33756       9.67393       3.68185       2.3001         10     
reco:pandoracalo:Calorimetry                       0.900123       2.1487        3.24479       2.02325      0.750364        10     
reco:pandoracalonosce:Calorimetry                  0.963236       2.10357       3.3773        2.03127      0.746511        10     
reco:pandorapid:Chi2ParticleID                    0.00268691    0.00390262    0.00647198    0.00362163    0.000986945      10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0276096     0.0355383     0.0450729     0.0345776    0.00475679       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00277957    0.00378926    0.00473555    0.00376354    0.000531312      10     
reco:pandoraShowercalo:ShowerCalorimetry            1.44708       4.78984       10.423        4.13952       2.38651        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       1.41985       4.39772       8.90543       4.05536       1.93338        10     
reco:emtrkmichelid:EmTrackMichelId                  96.4538       123.028       160.119       121.613       16.3664        10     
reco:crttag:SingleCRTMatchingProducer              0.0077122     0.0128161     0.0230847     0.0118147    0.00424382       10     
reco:crtreco:TwoCRTMatchingProducer               0.00494696    0.00853859     0.0170173    0.00695898    0.00346188       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.425862       0.61805      0.794679      0.611733      0.103269        10     
reco:pandora2Track:LArPandoraTrackCreation          5.03771       12.2975       20.5346       10.7381       4.4571         10     
reco:pandora2calo:Calorimetry                       2.26497       6.12578       10.6669       5.88835       2.16601        10     
reco:pandora2calonosce:Calorimetry                   2.056        5.75202       11.0072       5.28904       2.24107        10     
reco:pandora2pid:Chi2ParticleID                   0.00576832    0.00818626     0.0101404    0.00802507    0.00130517       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.034141      0.0467184     0.0829273     0.0421569     0.0130464       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID         0.00594444    0.00812761     0.0101965    0.00812161    0.00119842       10     
reco:pandora2Shower:LArPandoraShowerCreation        1.81489       4.12692       6.16393       3.77992       1.28707        10     
reco:pandora2Showercalo:ShowerCalorimetry           2.02906       4.76787       6.57595       4.80371       1.23565        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      1.80767       4.04075       5.91398       3.94909       1.07126        10     
[art]:TriggerResults:TriggerResultInserter         4.025e-05    5.4056e-05     9.929e-05    5.00195e-05   1.56347e-05      10     
end_path:out1:RootOutput                           7.34e-06     8.4899e-06     1.111e-05     8.095e-06    1.0676e-06       10     
end_path:out1:RootOutput(write)                     1.5767        2.09309       2.76136       2.03931      0.305643        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5207.45 MB
  Peak resident set size usage (VmHWM): 4402.09 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.17 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.02 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.20 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.02 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10595012
-rw-r--r--. 1 dune004 dune 2469757329 Oct 15 11:01 detsim_stage2.root
-rw-r--r--. 1 dune004 dune 2343400913 Oct 15 10:59 detsim_stage1.root
-rw-r--r--. 1 dune004 dune 2167115215 Oct 15 11:44 reco_stage1.root
-rw-r--r--. 1 dune004 dune 1934211018 Oct 15 09:34 g4_stage2.root
-rw-r--r--. 1 dune004 dune 1856834913 Oct 15 09:25 g4_stage1.root
-rw-r--r--. 1 dune004 dune   77342340 Oct 15 11:41 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune     243007 Oct 15 11:44 jobscript.log
-rw-r--r--. 1 dune004 dune     217088 Oct 15 11:44 mem.db
-rw-r--r--. 1 dune004 dune      62376 Oct 15 11:44 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune      36864 Oct 15 11:44 time.db
-rw-r--r--. 1 dune004 dune        519 Oct 15 11:01 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 15 09:34 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune004 dune        519 Oct 15 11:44 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune004 dune         52 Oct 15 09:20 all-input-dids.txt
-rw-r--r--. 1 dune004 dune          7 Oct 15 11:44 justin-processed-pfns.txt
-rw-r--r--. 1 dune004 dune          0 Oct 15 11:05 ProtoDUNE.log
-rw-r--r--. 1 dune004 dune          0 Oct 15 11:01 debugprod.log
justIN time: 2025-11-03 18:40:50 UTC       justIN version: 01.05.01