Jobsub ID 261514.1@dunegpschedd02.fnal.gov
| Jobsub ID | 261514.1@dunegpschedd02.fnal.gov |
| Workflow ID | 11178 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 08:07:10 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 20:43:09 |
| From worker node | Hostname | dunegli-8047001-0-fnpc19108.fnal.gov |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:36:24 |
| Input files | monte-carlo-011178-000001
|
| Jobscript | Exit code | 0 |
| Real time | 9h (32659s) |
| CPU time | 7h (25808s = 79%) |
| Max RSS bytes | 4730789888 (4511 MiB) |
| Outputting started | 2025-12-12 20:40:43 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11178/1/001/reco_stage1.root
|
| Finished | 2025-12-12 20:43:09 |
| Saved logs | justin-logs:261514.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ervice:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 143200 traces, 0 summary
Retagger: tagging trace set: gauss with 108668 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 108668 traces tagged "gauss"
FrameSaver: q=3.75573e+06 n=1903179 tag=gauss
wclsFrameSaver: saving 143200 traces tagged "wiener"
FrameSaver: q=3.97123e+06 n=1675138 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 35927 XUs and 40582 XVs -> 454 XUVs
C:0 T:1 75518 XUs and 74736 XVs -> 5690 XUVs
C:0 T:2 119556 XUs and 215074 XVs -> 9961 XUVs
C:0 T:3 54064 XUs and 70261 XVs -> 471 XUVs
C:0 T:4 15842 XUs and 14870 XVs -> 212 XUVs
C:0 T:5 61412 XUs and 50236 XVs -> 5900 XUVs
C:0 T:6 75388 XUs and 99515 XVs -> 3351 XUVs
C:0 T:7 30796 XUs and 41465 XVs -> 246 XUVs
C:0 T:8 7143 XUs and 7233 XVs -> 189 XUVs
C:0 T:9 34576 XUs and 38927 XVs -> 2329 XUVs
C:0 T:10 23768 XUs and 17629 XVs -> 3136 XUVs
C:0 T:11 95 XUs and 61 XVs -> 11 XUVs
31950 XUVs total
12340 collection wire objects
29398 potential space points
Neighbour search...
1875852 tests to find 929152 neighbours
Iterating with no regularization...
Begin: 7.13391e+07
0 6.014e+07
1 5.93882e+07
2 5.92885e+07
3 5.9261e+07
Now with regularization...
Begin: 4.81881e+07
0 4.81735e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411058677
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411058677
fLifetime: 30000 [us]
12-Dec-2025 20:40:35 UTC Closed output file "reco_stage1.root"
12-Dec-2025 20:40:35 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 1246.81 1847.15 2748.36 1877.1 417.262 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00610119 0.0150065 0.0367342 0.0095964 0.0100356 10
reco:ophit:OpHitFinder 0.365077 0.646357 0.916623 0.705692 0.204582 10
reco:opflash:OpFlashFinder 0.301246 0.579708 0.896373 0.539311 0.205161 10
reco:opslicer:OpSlicer 0.878033 1.40118 1.89408 1.51615 0.328119 10
reco:caldata:DataPrepModule 5.79652 9.30143 12.3479 10.2971 2.39103 10
reco:wclsdatasp:WireCellToolkit 79.0033 110.799 141.218 110.884 19.7839 10
reco:gaushit:GausHitFinder 1.75815 3.06518 4.25282 3.08592 0.795747 10
reco:nhitsfilter:NumberOfHitsFilter 0.0021761 0.00647064 0.0171969 0.00436952 0.00532349 10
reco:reco3d:SpacePointSolver 22.695 59.559 128.266 55.1471 29.2627 10
reco:hitpdune:DisambigFromSpacePoints 3.66342 7.02194 12.564 6.30027 2.96791 10
reco:pandora:StandardPandora 93.7233 244.498 436.353 197.479 112.861 10
reco:pandoraWriter:StandardPandora 1.30002 2.03257 2.4633 2.03603 0.397619 10
reco:pandoraTrack:LArPandoraTrackCreation 30.3933 51.256 70.9352 51.7635 14.9959 10
reco:pandoraShower:LArPandoraShowerCreation 40.6674 72.1724 115.161 67.2916 24.3775 10
reco:pandoracalo:Calorimetry 18.7649 28.602 46.7104 26.7986 7.71647 10
reco:pandoracalonosce:Calorimetry 13.389 27.7041 45.3159 26.3269 9.65316 10
reco:pandorapid:Chi2ParticleID 0.00827611 0.0193494 0.0310024 0.0199826 0.00700076 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0696442 0.132856 0.216843 0.124855 0.0491365 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00759049 0.0165897 0.0305736 0.0160948 0.00771026 10
reco:pandoraShowercalo:ShowerCalorimetry 30.857 86.264 165.956 81.5875 36.5131 10
reco:pandoraShowercalonosce:ShowerCalorimetry 52.9863 89.7308 177.148 91.6797 35.0748 10
reco:emtrkmichelid:EmTrackMichelId 404.151 493.339 648.456 475.96 68.6412 10
reco:crttag:SingleCRTMatchingProducer 0.054206 0.142792 0.284948 0.164897 0.0652649 10
reco:crtreco:TwoCRTMatchingProducer 0.0522958 0.108197 0.155878 0.115146 0.0390803 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.71564 3.40785 4.15157 3.74622 0.846682 10
reco:pandora2Track:LArPandoraTrackCreation 104.902 176.761 249.852 172.13 39.3031 10
reco:pandora2calo:Calorimetry 47.2407 83.5351 148.137 80.1517 32.7394 10
reco:pandora2calonosce:Calorimetry 29.5156 96.0324 200.939 82.6201 50.3416 10
reco:pandora2pid:Chi2ParticleID 0.0158837 0.0424285 0.0675059 0.0446256 0.0193372 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0782272 0.178298 0.252968 0.190459 0.0684529 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0146122 0.0372132 0.0662365 0.0337797 0.0162272 10
reco:pandora2Shower:LArPandoraShowerCreation 19.8035 51.7876 74.9575 55.836 17.4609 10
reco:pandora2Showercalo:ShowerCalorimetry 34.7032 74.5668 94.4542 81.7756 19.9255 10
reco:pandora2Showercalonosce:ShowerCalorimetry 42.031 64.6833 97.0299 67.3274 18.3912 10
[art]:TriggerResults:TriggerResultInserter 7.8361e-05 0.0014849 0.0132988 0.000161672 0.00393862 10
end_path:out1:RootOutput 1.8e-05 0.000212003 0.00150915 2.54755e-05 0.00044725 10
end_path:out1:RootOutput(write) 4.97383 6.69354 10.241 6.44453 1.66602 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5764.82 MB
Peak resident set size usage (VmHWM): 4730.79 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.38 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.56 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.82 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.22 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 12556568
-rw-r--r-- 1 dunegli fnalgrid 2878084589 Dec 12 15:26 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2727663815 Dec 12 15:19 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2670668423 Dec 12 20:40 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2283511466 Dec 12 11:57 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2196275769 Dec 12 11:41 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 101099040 Dec 12 20:24 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243096 Dec 12 20:40 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 20:40 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 20:40 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 20:40 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 15:26 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 11:57 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 20:40 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 20:40 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 15:53 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 15:27 debugprod.log
