justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 241874.5@dunegpschedd02.fnal.gov

Jobsub ID241874.5@dunegpschedd02.fnal.gov
Workflow ID9963
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-12 03:33:42
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-11-13 07:49:09
From worker nodeHostnamedunegli-7572241-0-fnpc19106.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2025-11-13 03:27:15
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T145610Z_gen_000444_supernova_g4stage1_g4stage2_detsim_reco_20250620T014813Z_reco2.root
JobscriptExit code0
Real time4h (15705s)
CPU time4h (15598s = 99%)
Max RSS bytes1917280256 (1828 MiB)
Outputting started2025-11-13 07:49:01
Output files
Finished2025-11-13 07:49:09
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

gen 17 Th232ChainGenInAnode
# of particles 1	from gen 18 Rn222ChainGenInPDS
# of particles 0	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 2	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 2	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 47	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 48	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 35	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 70	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 9	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 07:48:59 UTC run: 4899 subRun: 0 event: 4440

Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 52.45 MeV
Position (-227.56, -243.85, 369.90) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.01	(-507.19, 285.60, 368.31)	132641	132638
marley	-12		0.14	(-507.19, 285.60, 368.31)	132640	132638
marley	1000060140	0.04	(-507.19, 285.60, 368.31)	132638	132514
marley	2212		0.58	(-507.19, 285.60, 368.31)	132637	132514
marley	2212		0.00	(-498.21, 274.31, 363.45)	132610	132514
marley	2212		0.00	(-481.44, 248.42, 373.72)	132609	132514
marley	1000060120	0.00	(-482.67, 240.63, 386.03)	132608	132514
marley	2212		0.00	(-484.28, 238.06, 386.19)	132607	132514
marley	2212		0.00	(-484.15, 236.66, 385.33)	132606	132514
marley	2212		0.01	(-474.69, 224.52, 378.49)	132605	132514
marley	2212		0.05	(-455.41, 210.65, 387.67)	132604	132514
marley	2212		0.00	(-440.59, 204.49, 371.97)	132603	132514
marley	1000180400	0.01	(-373.10, 174.38, 302.44)	132602	132514
marley	1000180400	0.00	(-373.83, 173.89, 303.76)	132601	132514
marley	1000180400	0.00	(-373.67, 175.71, 304.74)	132600	132514
marley	1000180400	0.00	(-373.71, 175.73, 304.77)	132599	132514
marley	1000180400	0.00	(-373.61, 175.73, 304.97)	132598	132514
marley	1000180400	0.00	(-384.38, 168.12, 311.53)	132597	132514
marley	1000180400	0.00	(-381.22, 156.40, 302.93)	132596	132514
marley	1000180400	0.01	(-382.55, 162.31, 287.61)	132595	132514
marley	1000180400	0.00	(-386.39, 155.10, 286.56)	132594	132514
marley	1000180400	0.01	(-386.74, 151.87, 283.41)	132593	132514
marley	1000180400	0.00	(-379.38, 196.42, 275.51)	132592	132514
marley	1000180380	0.00	(-375.11, 196.83, 265.55)	132591	132514
marley	1000180360	0.01	(-374.02, 195.68, 264.68)	132590	132514
marley	1000180400	0.00	(-379.36, 202.75, 256.58)	132589	132514
marley	1000180400	0.00	(-396.82, 232.71, 245.43)	132588	132514
marley	1000180400	0.01	(-371.28, 292.06, 207.46)	132587	132514
marley	1000180400	0.00	(-381.62, 268.77, 190.69)	132586	132514
marley	1000180400	0.01	(-406.52, 248.73, 162.72)	132585	132514
marley	1000180360	0.00	(-409.03, 244.29, 165.92)	132584	132514
marley	1000060120	0.03	(-428.77, 241.28, 174.36)	132583	132514
marley	1000180400	0.01	(-342.89, 188.04, 333.21)	132582	132514
marley	1000180400	0.00	(-342.56, 187.12, 332.35)	132581	132514
marley	1000180400	0.02	(-339.67, 186.26, 330.60)	132580	132514
marley	1000180400	0.01	(-397.01, 173.93, 348.32)	132579	132514
marley	1000180400	0.00	(-375.96, 83.01, 325.85)	132578	132514
marley	1000180400	0.00	(-376.80, 59.79, 337.11)	132577	132514
marley	1000180400	0.01	(-374.42, 14.20, 404.43)	132576	132514
marley	1000180400	0.00	(-386.74, 5.74, 400.31)	132575	132514
marley	1000180400	0.02	(-389.34, 5.55, 399.98)	132574	132514
marley	1000180400	0.01	(-369.97, -3.82, 433.70)	132573	132514
marley	1000180400	0.03	(-349.06, -12.20, 418.11)	132572	132514
marley	1000180360	0.00	(-387.64, -8.88, 452.05)	132571	132514
marley	1000180400	0.03	(-388.70, -8.50, 453.83)	132570	132514
marley	1000180400	0.03	(-376.98, -15.87, 374.37)	132569	132514
marley	1000180400	0.03	(-378.19, -14.53, 381.09)	132568	132514
marley	1000180400	0.00	(-378.03, -20.29, 376.32)	132567	132514
marley	1000180400	0.02	(-378.04, -20.32, 376.14)	132566	132514
marley	1000180400	0.04	(-387.40, -21.43, 375.24)	132565	132514
marley	1000180400	0.00	(-374.70, -15.72, 372.35)	132564	132514
marley	1000180400	0.00	(-332.82, -5.22, 347.13)	132563	132514
marley	1000180400	0.03	(-330.19, -6.10, 344.05)	132562	132514
marley	1000180400	0.05	(-330.45, -25.16, 352.81)	132561	132514
marley	1000180400	0.05	(-334.16, -3.10, 339.48)	132560	132514
marley	1000180400	0.03	(-247.20, -147.93, 389.11)	132559	132514
marley	1000180400	0.01	(-252.60, -152.30, 386.18)	132558	132514
marley	1000180400	0.01	(-253.38, -156.38, 381.74)	132557	132514
marley	1000180400	0.06	(-254.37, -156.69, 380.51)	132556	132514
marley	1000180400	0.00	(-230.89, -145.45, 421.57)	132555	132514
marley	1000180400	0.00	(-228.47, -142.36, 428.00)	132554	132514
marley	1000180400	0.00	(-230.95, -134.23, 442.26)	132553	132514
marley	1000180400	0.00	(-233.56, -131.10, 445.06)	132552	132514
marley	1000180400	0.05	(-236.45, -127.05, 447.50)	132551	132514
marley	1000180400	0.03	(-266.06, -171.67, 411.91)	132550	132514
marley	1000180400	0.01	(-278.80, -169.01, 412.52)	132549	132514
marley	1000180400	0.08	(-356.35, -197.29, 445.36)	132548	132514
marley	1000180400	0.02	(-266.91, -157.67, 398.79)	132547	132514
marley	1000180400	0.01	(-249.30, -171.27, 396.30)	132546	132514
marley	1000180400	0.02	(-230.79, -208.66, 417.65)	132545	132514
marley	1000180400	0.00	(-229.18, -235.16, 405.59)	132544	132514
marley	1000180400	0.08	(-225.82, -247.79, 402.26)	132543	132514
marley	1000180400	0.06	(-225.87, -246.29, 404.42)	132542	132514
marley	1000180400	0.09	(-209.56, -247.32, 400.59)	132541	132514
marley	1000180400	0.02	(-228.10, -233.00, 390.76)	132540	132514
marley	1000180400	0.10	(-228.24, -232.64, 389.79)	132539	132514
marley	1000180400	0.05	(-236.19, -232.66, 397.46)	132538	132514
marley	1000180400	0.00	(-233.99, -231.66, 400.72)	132537	132514
marley	1000180400	0.13	(-233.81, -231.52, 401.06)	132536	132514
marley	22		1.46	(-241.45, -235.11, 397.04)	132516	132482
marley	1000180400	0.10	(-241.45, -235.11, 397.04)	132515	132482
marley	2112		1.45	(-241.45, -235.11, 397.04)	132514	132482
marley	22		5.31	(-227.56, -243.85, 369.90)	132483	0
marley	2112		3.01	(-227.56, -243.85, 369.90)	132482	0
marley	1000190390	0.13	(-227.56, -243.85, 369.90)	132481	0
marley	11		34.69	(-227.56, -243.85, 369.90)	132480	0
Signal Track IDs: 132480; 132481; 132482; 132483; 132514; 132515; 132516; 132536; 132537; 132538; 132539; 132540; 132541; 132542; 132543; 132544; 132545; 132546; 132547; 132548; 132549; 132550; 132551; 132552; 132553; 132554; 132555; 132556; 132557; 132558; 132559; 132560; 132561; 132562; 132563; 132564; 132565; 132566; 132567; 132568; 132569; 132570; 132571; 132572; 132573; 132574; 132575; 132576; 132577; 132578; 132579; 132580; 132581; 132582; 132583; 132584; 132585; 132586; 132587; 132588; 132589; 132590; 132591; 132592; 132593; 132594; 132595; 132596; 132597; 132598; 132599; 132600; 132601; 132602; 132603; 132604; 132605; 132606; 132607; 132608; 132609; 132610; 132637; 132638; 132640; 132641; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 07:48:59 UTC run: 4899 subRun: 0 event: 4440

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
13-Nov-2025 07:48:59 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f1/da/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T145610Z_gen_000444_supernova_g4stage1_g4stage2_detsim_reco_20250620T014813Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 07:48:59 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.880483       1565.44       2942.79       1908.41       1096.62        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000601645   0.00819054     0.0181533    0.00678369    0.00764406       10     
end_path:solarnuana:SolarNuAna     0.863553       1565.43       2942.79       1908.4        1096.62        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 07:48:59 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2538.08 MB
  Peak resident set size usage (VmHWM): 1917.28 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 15584.878757 Real = 15687.735332

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2538.08 VmHWM = 1917.28

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-10 06:21:22 UTC       justIN version: 01.06.00