Jobsub ID 256484.0@dunegpschedd01.fnal.gov
| Jobsub ID | 256484.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10623 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-24 20:39:32 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-25 02:07:45 |
| From worker node | Hostname | dunegli-7881354-0-fnpc17001.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-24 21:18:26 |
| Input files | monte-carlo-010623-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (17337s) |
| CPU time | 4h (17199s = 99%) |
| Max RSS bytes | 4279250944 (4081 MiB) |
| Outputting started | 2025-11-25 02:07:23 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10623/1/001/reco_stage1.root
|
| Finished | 2025-11-25 02:07:45 |
| Saved logs | justin-logs:256484.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 154962 traces, 0 summary
Retagger: tagging trace set: gauss with 112022 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 112022 traces tagged "gauss"
FrameSaver: q=4.07454e+06 n=1932918 tag=gauss
wclsFrameSaver: saving 154962 traces tagged "wiener"
FrameSaver: q=4.35418e+06 n=1698226 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 17062 XUs and 22834 XVs -> 181 XUVs
C:0 T:1 48420 XUs and 46131 XVs -> 5497 XUVs
C:0 T:2 66590 XUs and 127374 XVs -> 7746 XUVs
C:0 T:3 28554 XUs and 47655 XVs -> 867 XUVs
C:0 T:4 18363 XUs and 18485 XVs -> 223 XUVs
C:0 T:5 85582 XUs and 69111 XVs -> 10447 XUVs
C:0 T:6 190433 XUs and 183675 XVs -> 11438 XUVs
C:0 T:7 68582 XUs and 68116 XVs -> 903 XUVs
C:0 T:8 11024 XUs and 9740 XVs -> 194 XUVs
C:0 T:9 81182 XUs and 85301 XVs -> 12211 XUVs
C:0 T:10 28526 XUs and 13594 XVs -> 5779 XUVs
C:0 T:11 207 XUs and 130 XVs -> 32 XUVs
55518 XUVs total
12539 collection wire objects
50145 potential space points
Neighbour search...
5419099 tests to find 2812466 neighbours
Iterating with no regularization...
Begin: 7.63872e+07
0 6.54156e+07
1 6.43976e+07
2 6.42503e+07
3 6.42066e+07
Now with regularization...
Begin: 5.22444e+07
0 5.21862e+07
1 5.21439e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410717063
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410717063
fLifetime: 30000 [us]
25-Nov-2025 02:07:19 UTC Closed output file "reco_stage1.root"
25-Nov-2025 02:07:19 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 511.56 742.463 1158.79 651.832 234.331 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00179013 0.00455597 0.00770316 0.00436133 0.00176676 10
reco:ophit:OpHitFinder 0.271973 0.388099 0.472152 0.387395 0.0586324 10
reco:opflash:OpFlashFinder 0.162328 0.222668 0.311047 0.208775 0.0494515 10
reco:opslicer:OpSlicer 0.737257 1.07651 1.47857 1.00092 0.238834 10
reco:caldata:DataPrepModule 5.39645 7.75003 8.66099 7.92574 0.846542 10
reco:wclsdatasp:WireCellToolkit 46.3535 57.5025 63.5991 58.5023 5.83732 10
reco:gaushit:GausHitFinder 1.48729 2.1252 3.47543 1.81427 0.65943 10
reco:nhitsfilter:NumberOfHitsFilter 0.0007591 0.0010305 0.00154101 0.000932134 0.000239675 10
reco:reco3d:SpacePointSolver 9.27524 23.2702 42.4949 21.8314 10.9599 10
reco:hitpdune:DisambigFromSpacePoints 2.49626 4.22721 7.32095 3.13812 1.8091 10
reco:pandora:StandardPandora 38.8801 75.4907 159.489 52.1778 42.9833 10
reco:pandoraWriter:StandardPandora 0.562501 0.765295 1.03583 0.671656 0.181505 10
reco:pandoraTrack:LArPandoraTrackCreation 7.56909 15.5941 23.7737 13.7257 5.52933 10
reco:pandoraShower:LArPandoraShowerCreation 9.25172 19.3362 33.7049 15.623 8.73286 10
reco:pandoracalo:Calorimetry 3.76082 7.82604 11.7833 6.98137 2.91203 10
reco:pandoracalonosce:Calorimetry 3.36576 7.23145 11.4967 6.01327 2.77015 10
reco:pandorapid:Chi2ParticleID 0.00640361 0.0102598 0.0132138 0.0102061 0.00213824 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0725846 0.0998853 0.136482 0.0927807 0.0237789 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00589063 0.00993875 0.0128457 0.0098569 0.0019744 10
reco:pandoraShowercalo:ShowerCalorimetry 8.50037 19.6313 34.0105 16.4037 9.33566 10
reco:pandoraShowercalonosce:ShowerCalorimetry 8.09183 19.0567 31.9254 17.0773 8.91924 10
reco:emtrkmichelid:EmTrackMichelId 248.903 306.439 436.625 265.075 70.5601 10
reco:crttag:SingleCRTMatchingProducer 0.0241091 0.0414326 0.0519019 0.0455088 0.00912661 10
reco:crtreco:TwoCRTMatchingProducer 0.0199623 0.0335682 0.0419791 0.0372351 0.00747692 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.42107 2.13298 2.893 2.21763 0.47586 10
reco:pandora2Track:LArPandoraTrackCreation 26.4759 55.5515 87.8579 53.2607 22.6749 10
reco:pandora2calo:Calorimetry 10.5663 26.0283 48.917 23.2789 13.2244 10
reco:pandora2calonosce:Calorimetry 10.0313 24.481 49.3189 20.6085 12.9447 10
reco:pandora2pid:Chi2ParticleID 0.0150109 0.0268147 0.0400427 0.0255359 0.00890598 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0723103 0.135623 0.185972 0.135081 0.0378879 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0146754 0.0259774 0.0366211 0.0259814 0.00824236 10
reco:pandora2Shower:LArPandoraShowerCreation 9.59521 17.7736 26.3733 19.1275 6.35795 10
reco:pandora2Showercalo:ShowerCalorimetry 8.65749 22.0052 39.0352 21.1983 10.6427 10
reco:pandora2Showercalonosce:ShowerCalorimetry 7.00315 21.4396 36.4921 23.8128 10.1218 10
[art]:TriggerResults:TriggerResultInserter 6.6136e-05 9.26817e-05 0.000187693 8.12875e-05 3.26292e-05 10
end_path:out1:RootOutput 1.3583e-05 1.66699e-05 2.1825e-05 1.613e-05 2.78818e-06 10
end_path:out1:RootOutput(write) 2.12139 4.5296 6.00563 4.98821 1.26048 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5085.89 MB
Peak resident set size usage (VmHWM): 4279.25 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.12 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.32 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.77 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.25 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10690200
-rw-r--r-- 1 dunegli fnalgrid 2485677243 Nov 25 00:00 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2357774590 Nov 24 23:57 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2197028689 Nov 25 02:07 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1952741790 Nov 24 21:48 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1872018508 Nov 24 21:25 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 80898640 Nov 25 01:57 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243068 Nov 25 02:07 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 25 02:07 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 25 02:07 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 25 02:07 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 00:00 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 24 21:48 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 02:07 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 24 21:18 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 25 02:07 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 00:09 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 00:00 debugprod.log
