justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269210.1@dunegpschedd01.fnal.gov

Jobsub ID269210.1@dunegpschedd01.fnal.gov
Workflow ID11271
Stage ID1
User namepmelas@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-12-19 07:40:42
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce512
Last heartbeat2025-12-19 12:12:21
From worker nodeHostnameb9p24p4428.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-19 07:42:19
Input filesmonte-carlo-011271-000001
JobscriptExit code0
Real time4h (16109s)
CPU time4h (14643s = 90%)
Max RSS bytes4306452480 (4106 MiB)
Outputting started2025-12-19 12:10:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11271/1/001/reco_stage1.root
Finished2025-12-19 12:12:21
Saved logsjustin-logs:269210.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 160837 traces, 0 summary
Retagger: tagging trace set: gauss with 121024 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 121024 traces tagged "gauss"
FrameSaver: q=4.27248e+06 n=2140017 tag=gauss
wclsFrameSaver: saving 160837 traces tagged "wiener"
FrameSaver: q=4.52973e+06 n=1890767 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 44610 XUs and 39935 XVs -> 624 XUVs
C:0 T:1 109521 XUs and 88373 XVs -> 14251 XUVs
C:0 T:2 94283 XUs and 92650 XVs -> 5962 XUVs
C:0 T:3 45242 XUs and 41156 XVs -> 242 XUVs
C:0 T:4 10592 XUs and 10497 XVs -> 85 XUVs
C:0 T:5 57129 XUs and 45666 XVs -> 7656 XUVs
C:0 T:6 122390 XUs and 110137 XVs -> 7264 XUVs
C:0 T:7 46814 XUs and 42864 XVs -> 342 XUVs
C:0 T:8 12613 XUs and 11687 XVs -> 202 XUVs
C:0 T:9 102167 XUs and 113445 XVs -> 9485 XUVs
C:0 T:10 63317 XUs and 50853 XVs -> 4648 XUVs
C:0 T:11 729 XUs and 627 XVs -> 134 XUVs
50895 XUVs total
14328 collection wire objects
46520 potential space points
Neighbour search...
5140966 tests to find 2628654 neighbours
Iterating with no regularization...
Begin: 8.02347e+07
0 6.46605e+07
1 6.36564e+07
2 6.35024e+07
3 6.34536e+07
Now with regularization...
Begin: 5.13787e+07
0 5.13031e+07
1 5.12606e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411209136
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411209136
fLifetime: 30000 [us]
19-Dec-2025 13:10:46 CET  Closed output file "reco_stage1.root"
19-Dec-2025 13:10:46 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          339.177       414.151       510.147       414.947       49.3857        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00116345    0.00422761    0.00681238    0.00432369    0.00170357       10     
reco:ophit:OpHitFinder                             0.231531      0.313896      0.399901      0.312796      0.053959        10     
reco:opflash:OpFlashFinder                         0.138766      0.196109      0.252178       0.19857      0.0382986       10     
reco:opslicer:OpSlicer                             0.633825      0.852743       1.10556      0.849399      0.159496        10     
reco:caldata:DataPrepModule                         4.90852       5.95449       7.10897       6.01935      0.679141        10     
reco:wclsdatasp:WireCellToolkit                     31.3336       38.3809       48.9243       37.8081       4.5524         10     
reco:gaushit:GausHitFinder                         0.939379       1.16274       1.70894       1.11625       0.20297        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000480936   0.000644544   0.000918293   0.000609918   0.000119919      10     
reco:reco3d:SpacePointSolver                        9.37438       14.8788       19.786        14.7599       3.40666        10     
reco:hitpdune:DisambigFromSpacePoints               1.36268       1.79085       2.18442       1.73545      0.320393        10     
reco:pandora:StandardPandora                        21.4219       34.6063       45.4572       33.1763       7.10713        10     
reco:pandoraWriter:StandardPandora                 0.340969      0.506293      0.694416      0.465138      0.115719        10     
reco:pandoraTrack:LArPandoraTrackCreation           3.24593        4.441        5.5393        4.35758      0.850128        10     
reco:pandoraShower:LArPandoraShowerCreation         3.07428       4.64708       6.98996       4.3262        1.29168        10     
reco:pandoracalo:Calorimetry                         1.379        2.37276       3.30055       2.41116      0.660295        10     
reco:pandoracalonosce:Calorimetry                   1.36317       2.16078       2.86548       2.31239      0.522735        10     
reco:pandorapid:Chi2ParticleID                    0.00405977    0.00604655    0.00831359    0.00566327    0.00120938       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0396167     0.0601251     0.0898423     0.0550949     0.0166289       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00395038    0.00583032    0.00813614    0.00537061    0.00136737       10     
reco:pandoraShowercalo:ShowerCalorimetry            2.21459       4.36723       6.81741       4.36302       1.36466        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       2.17855       4.35723       7.06374       4.41344       1.36477        10     
reco:emtrkmichelid:EmTrackMichelId                  204.818       247.96        300.794       248.407       27.1418        10     
reco:crttag:SingleCRTMatchingProducer             0.00992085     0.0164578     0.0265153     0.0152253    0.00511637       10     
reco:crtreco:TwoCRTMatchingProducer               0.00692234     0.0101006     0.0170113    0.00987666    0.00288816       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.619754       1.04507       1.71718       1.05973      0.281966        10     
reco:pandora2Track:LArPandoraTrackCreation          9.41434       13.5465       19.118        13.0094        2.924         10     
reco:pandora2calo:Calorimetry                       4.23555       5.93733       9.26687       5.50259       1.58642        10     
reco:pandora2calonosce:Calorimetry                  3.98515       5.82232       9.80955       5.44442       1.75521        10     
reco:pandora2pid:Chi2ParticleID                    0.0113846     0.016265      0.0253015     0.014285     0.00477376       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0515713     0.0819067     0.130339      0.0751235     0.0248793       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.011204      0.0153666     0.0260562     0.0134723    0.00462615       10     
reco:pandora2Shower:LArPandoraShowerCreation        3.27158       4.75484       6.52376       4.70895      0.961408        10     
reco:pandora2Showercalo:ShowerCalorimetry           4.02843       5.20896       7.30892       5.14799      0.932441        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      3.95274       5.26645       7.7106        4.97729       1.20935        10     
[art]:TriggerResults:TriggerResultInserter        4.2531e-05    6.49351e-05   0.000150522   5.4071e-05    3.02456e-05      10     
end_path:out1:RootOutput                           8.57e-06     9.9221e-06     1.473e-05     9.475e-06    1.6969e-06       10     
end_path:out1:RootOutput(write)                     2.58586       3.27988       4.01422       3.27534      0.399061        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5128.47 MB
  Peak resident set size usage (VmHWM): 4306.45 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.08 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.25 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   3.70 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.14 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.05 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10927096
-rw-r--r--. 1 duneprd np-comp 2535083750 Dec 19 11:57 detsim_stage2.root
-rw-r--r--. 1 duneprd np-comp 2407570790 Dec 19 11:54 detsim_stage1.root
-rw-r--r--. 1 duneprd np-comp 2239922116 Dec 19 13:10 reco_stage1.root
-rw-r--r--. 1 duneprd np-comp 2006928264 Dec 19 09:19 g4_stage2.root
-rw-r--r--. 1 duneprd np-comp 1920128213 Dec 19 08:52 g4_stage1.root
-rw-r--r--. 1 duneprd np-comp   79103660 Dec 19 13:04 Pandora_Events.pndr
-rw-r--r--. 1 duneprd np-comp     243032 Dec 19 13:10 jobscript.log
-rw-r--r--. 1 duneprd np-comp     217088 Dec 19 13:10 mem.db
-rw-r--r--. 1 duneprd np-comp      62376 Dec 19 13:10 Pandora_Geometry.xml
-rw-r--r--. 1 duneprd np-comp      36864 Dec 19 13:10 time.db
-rw-r--r--. 1 duneprd np-comp        519 Dec 19 11:57 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Dec 19 09:19 g4_protoDUNE_hist.root
-rw-r--r--. 1 duneprd np-comp        519 Dec 19 13:10 protoDUNE_reco1_hist.root
-rw-r--r--. 1 duneprd np-comp         52 Dec 19 08:42 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp          7 Dec 19 13:10 justin-processed-pfns.txt
-rw-r--r--. 1 duneprd np-comp          0 Dec 19 12:06 ProtoDUNE.log
-rw-r--r--. 1 duneprd np-comp          0 Dec 19 11:57 debugprod.log
justIN time: 2025-12-20 13:40:40 UTC       justIN version: 01.05.03