justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 238435.1@dunegpschedd01.fnal.gov

Jobsub ID238435.1@dunegpschedd01.fnal.gov
Workflow ID9330
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-10-25 07:27:02
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce512
Last heartbeat2025-10-25 12:00:59
From worker nodeHostnameb9p29p2814.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-25 07:28:50
Input filesmonte-carlo-009330-000001
JobscriptExit code0
Real time4h (16222s)
CPU time4h (15425s = 95%)
Max RSS bytes4290990080 (4092 MiB)
Outputting started2025-10-25 11:59:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09330/1/001/reco_stage1.root
Finished2025-10-25 12:00:59
Saved logsjustin-logs:238435.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

epare:   Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 154005 traces, 0 summary
Retagger: tagging trace set: gauss with 119665 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 119665 traces tagged "gauss"
FrameSaver: q=4.11003e+06 n=2184418 tag=gauss
wclsFrameSaver: saving 154005 traces tagged "wiener"
FrameSaver: q=4.33564e+06 n=1952181 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38897 XUs and 39017 XVs -> 576 XUVs
C:0 T:1 135712 XUs and 96894 XVs -> 16698 XUVs
C:0 T:2 59491 XUs and 82256 XVs -> 3714 XUVs
C:0 T:3 29685 XUs and 37996 XVs -> 295 XUVs
C:0 T:4 10935 XUs and 12418 XVs -> 138 XUVs
C:0 T:5 42866 XUs and 39539 XVs -> 3502 XUVs
C:0 T:6 94924 XUs and 102643 XVs -> 3248 XUVs
C:0 T:7 40756 XUs and 41624 XVs -> 261 XUVs
C:0 T:8 10054 XUs and 11180 XVs -> 106 XUVs
C:0 T:9 62770 XUs and 84113 XVs -> 4564 XUVs
C:0 T:10 114248 XUs and 88999 XVs -> 9866 XUVs
C:0 T:11 480 XUs and 229 XVs -> 26 XUVs
42994 XUVs total
14659 collection wire objects
39474 potential space points
Neighbour search...
5305916 tests to find 2268212 neighbours
Iterating with no regularization...
Begin: 7.6476e+07
0 6.53962e+07
1 6.46452e+07
2 6.45412e+07
3 6.45119e+07
Now with regularization...
Begin: 5.4084e+07
0 5.4047e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410102360
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410102360
fLifetime: 30000 [us]
25-Oct-2025 13:59:10 CEST  Closed output file "reco_stage1.root"
25-Oct-2025 13:59:10 CEST  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          356.962       473.497       584.428       478.477       59.9602        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00115485    0.00417367    0.00731005    0.00408278    0.00188036       10     
reco:ophit:OpHitFinder                             0.270602       0.34858      0.395593      0.356151      0.0377116       10     
reco:opflash:OpFlashFinder                         0.125138      0.208097       0.2742       0.213354      0.039811        10     
reco:opslicer:OpSlicer                             0.666738      0.913036       1.11107      0.933882      0.127433        10     
reco:caldata:DataPrepModule                         6.07392       6.60326       7.11907       6.74755      0.345161        10     
reco:wclsdatasp:WireCellToolkit                     36.4977       41.5113       49.8351       40.5909       3.81011        10     
reco:gaushit:GausHitFinder                          1.20202       1.58759       1.83262       1.61111      0.196433        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000457707   0.000799593   0.00100802    0.000834722   0.000142324      10     
reco:reco3d:SpacePointSolver                        9.59264       16.5196       23.5912       16.8321       4.05045        10     
reco:hitpdune:DisambigFromSpacePoints               1.10031       2.11595       3.13174       2.21689      0.511931        10     
reco:pandora:StandardPandora                        27.3269       42.2464       61.2638       43.3511       10.2339        10     
reco:pandoraWriter:StandardPandora                 0.483754      0.572901      0.697961      0.550385      0.0743978       10     
reco:pandoraTrack:LArPandoraTrackCreation           2.72719       5.59595       8.13706       5.33501       1.40465        10     
reco:pandoraShower:LArPandoraShowerCreation         3.68037       6.08889       7.58254       6.10581       1.09133        10     
reco:pandoracalo:Calorimetry                        1.75714       2.9898        3.93227       3.1096       0.674764        10     
reco:pandoracalonosce:Calorimetry                   1.55809       2.6719        3.66649       2.56135      0.650384        10     
reco:pandorapid:Chi2ParticleID                    0.00528501    0.00720759     0.010127     0.00663973    0.00165688       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.052296      0.0722229     0.0941246     0.072171      0.0115437       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID           0.0052785    0.00732763    0.00952399    0.00751577    0.00113069       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.96311       5.71426       8.73053       5.38212       1.50099        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.76728       5.83308       8.88368       6.07432       1.59481        10     
reco:emtrkmichelid:EmTrackMichelId                  216.051       275.632       333.535       278.137       30.5989        10     
reco:crttag:SingleCRTMatchingProducer              0.0116254     0.0210107     0.0516995     0.018485      0.0108701       10     
reco:crtreco:TwoCRTMatchingProducer               0.00861904     0.011369      0.0164813     0.0108862    0.00221081       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.669789       1.09916       1.30451       1.13129      0.180949        10     
reco:pandora2Track:LArPandoraTrackCreation           11.86        17.3914       23.6453       17.7188       3.91647        10     
reco:pandora2calo:Calorimetry                       4.97993       7.63724       10.1948       7.77319       1.62333        10     
reco:pandora2calonosce:Calorimetry                  4.88964       7.62688       12.0606       7.48394       2.05017        10     
reco:pandora2pid:Chi2ParticleID                    0.0107334     0.0182695     0.0231709     0.0177969     0.0033418       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0553384     0.0955632     0.117086      0.0999642     0.0162657       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0107283     0.0180273     0.0218994     0.0183363    0.00300217       10     
reco:pandora2Shower:LArPandoraShowerCreation        4.16208       5.98109       8.94773       5.74681       1.30992        10     
reco:pandora2Showercalo:ShowerCalorimetry           2.99788       6.60152       8.30579       6.86561       1.52335        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      2.71839       5.90597       7.96194       6.00921       1.48796        10     
[art]:TriggerResults:TriggerResultInserter        4.5661e-05    6.73821e-05   0.000157403   5.9761e-05    3.10238e-05      10     
end_path:out1:RootOutput                           1.126e-05    1.37052e-05   2.0321e-05     1.289e-05    2.39341e-06      10     
end_path:out1:RootOutput(write)                      2.418        3.69078       4.55861       3.76007      0.583681        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5112.11 MB
  Peak resident set size usage (VmHWM): 4290.99 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.28 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.14 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.16 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10754504
-rw-r--r--. 1 duneprd np-comp 2503729086 Oct 25 12:36 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2378439589 Oct 25 12:32 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 2202332428 Oct 25 13:59 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 1960032840 Oct 25 09:51 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1889542305 Oct 25 09:37 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   77921270 Oct 25 13:51 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     243080 Oct 25 13:59 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Oct 25 13:59 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Oct 25 13:59 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Oct 25 13:59 time.db
-rw-r--r--. 1 duneprd np-comp        519 Oct 25 12:36 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Oct 25 09:51 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Oct 25 13:59 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Oct 25 09:28 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Oct 25 13:59 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Oct 25 12:45 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Oct 25 12:36 debugprod.log
justIN time: 2025-11-03 18:30:46 UTC       justIN version: 01.05.01