justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 23211.0@dunegpschedd02.fnal.gov

Jobsub ID23211.0@dunegpschedd02.fnal.gov
Workflow ID1736
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-08-20 21:29:41
SiteCH_UNIBE-LHEP
EntryOSG_CH_UNIBE_LHEP_ce02
Last heartbeat2025-08-20 21:34:45
From worker nodeHostnamewn-1-10.local
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-08-20 21:30:52
Input filesmonte-carlo-001736-000178
JobscriptExit code0
Real time3m (200s)
CPU time2m (169s = 84%)
Max RSS bytes493187072 (470 MiB)
Outputting started2025-08-20 21:34:13
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/wirecell_sim_tracks/fnal/01736/1/001/bad_apa_23211_0.npz
Finished2025-08-20 21:34:45
Saved logsjustin-logs:23211.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1
Will use justin-get-file
PFN: 000178
PFN num: 177
jobsub_id: 23211_0
Good apa: false bad_apa_23211_0.npz
Doing tracks
root://fndca1.fnal.gov:1094//pnfs/fnal.gov/usr/dune/resilient/users/calcuttj/test_tracks
[23:31:19.830] D [  main  ] configuring component: "DepoFileSource":""
[23:31:19.833] D [   io   ] <DepoFileSource:> reading test_tracks_177.npz with scale=1 
[23:31:19.833] D [  main  ] configuring component: "Random":""
[23:31:19.833] D [  main  ] configuring component: "Drifter":""
[23:31:19.834] D [  gen   ] <Drifter:> time offset: 0 ms, drift speed: 1.565 mm/us 
[23:31:19.834] D [  main  ] configuring component: "DepoSetDrifter":""
[23:31:19.834] D [  main  ] configuring component: "WireSchemaFile":""
[23:31:19.891] I [  wct   ] loading compressed json file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/a86f07c7506a23a276258783e58616bd3d366426/protodunehd-wires-larsoft-v1.json.bz2
[23:31:26.723] D [  main  ] configuring component: "AnodePlane":"apa0"
[23:31:26.723] D [  geom  ] <AnodePlane:apa0> X planes: "cathode"@ -0.001587500000000091m, "response"@-3.4304650000000003m, "anode"@-3.520945m, dirx=1 
[23:31:26.725] D [  geom  ] <AnodePlane:apa0> face:0, plane:0, origin:(-3430.47 3071.4 1152.36) mm 
[23:31:26.727] D [  geom  ] <AnodePlane:apa0> face:0, plane:1, origin:(-3430.47 3069.72 1152.36) mm 
[23:31:26.728] D [  geom  ] <AnodePlane:apa0> face:0, plane:2, origin:(-3430.47 3068.05 1152.28) mm 
[23:31:26.728] D [  geom  ] <AnodePlane:apa0> face:0 with 3 planes and sensvol: [(-3520.95 76.1 2.34345) --> (-1.5875 6060 2302.36)] 
[23:31:26.729] D [  geom  ] <AnodePlane:apa0> X planes: "cathode"@ -7.1452124999999995m, "response"@-3.716335m, "anode"@-3.625855m, dirx=-1 
[23:31:26.730] D [  geom  ] <AnodePlane:apa0> face:1, plane:0, origin:(-3716.34 3071.4 1152.36) mm 
[23:31:26.732] D [  geom  ] <AnodePlane:apa0> face:1, plane:1, origin:(-3716.34 3069.72 1152.36) mm 
[23:31:26.733] D [  geom  ] <AnodePlane:apa0> face:1, plane:2, origin:(-3716.34 3068.05 1152.43) mm 
[23:31:26.733] D [  geom  ] <AnodePlane:apa0> face:1 with 3 planes and sensvol: [(-7145.21 76.1 2.35463) --> (-3625.86 6060 2302.38)] 
[23:31:26.734] D [  main  ] configuring component: "FftwDFT":""
[23:31:26.734] D [  main  ] configuring component: "FieldResponse":"field0"
[23:31:26.884] I [  wct   ] loading compressed json file: /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/a86f07c7506a23a276258783e58616bd3d366426/np04hd-garfield-6paths-mcmc-bestfit.json.bz2
[23:31:33.089] D [  main  ] configuring component: "ColdElecResponse":""
[23:31:33.090] D [  main  ] configuring component: "RCResponse":""
[23:31:33.091] D [  main  ] configuring component: "ResponseSys":""
[23:31:33.091] D [  main  ] configuring component: "PlaneImpactResponse":"PIRfield0plane0"
[23:31:33.092] D [  gen   ] <PlaneImpactResponse:PIRfield0plane0> short response ColdElecResponse has different number of samples (6128) than expected (200) 
[23:31:33.093] D [  gen   ] <PlaneImpactResponse:PIRfield0plane0> Nfr=1000 Nfr_slow=200 Nfr_ext=2000 Ner=200 Nfrxer=400 Tfr=100 Ter=500 FieldResponse:field0 
[23:31:33.143] D [  gen   ] <PlaneImpactResponse:PIRfield0plane0> fr=FieldResponse:field0 plane=0 short=100000 long=1500000 tick=500 nticks=6128 
[23:31:33.143] D [  main  ] configuring component: "PlaneImpactResponse":"PIRfield0plane1"
[23:31:33.143] D [  gen   ] <PlaneImpactResponse:PIRfield0plane1> short response ColdElecResponse has different number of samples (6128) than expected (200) 
[23:31:33.143] D [  gen   ] <PlaneImpactResponse:PIRfield0plane1> Nfr=1000 Nfr_slow=200 Nfr_ext=2000 Ner=200 Nfrxer=400 Tfr=100 Ter=500 FieldResponse:field0 
[23:31:33.192] D [  gen   ] <PlaneImpactResponse:PIRfield0plane1> fr=FieldResponse:field0 plane=1 short=100000 long=1500000 tick=500 nticks=6128 
[23:31:33.192] D [  main  ] configuring component: "PlaneImpactResponse":"PIRfield0plane2"
[23:31:33.193] D [  gen   ] <PlaneImpactResponse:PIRfield0plane2> short response ColdElecResponse has different number of samples (6128) than expected (200) 
[23:31:33.193] D [  gen   ] <PlaneImpactResponse:PIRfield0plane2> Nfr=1000 Nfr_slow=200 Nfr_ext=2000 Ner=200 Nfrxer=400 Tfr=100 Ter=500 FieldResponse:field0 
[23:31:33.238] D [  gen   ] <PlaneImpactResponse:PIRfield0plane2> fr=FieldResponse:field0 plane=2 short=100000 long=1500000 tick=500 nticks=6128 
[23:31:33.238] D [  main  ] configuring component: "DepoTransform":"depotransform-apa0"
[23:31:33.238] D [  gen   ] <DepoTransform:depotransform-apa0> tick=0.5 us, start=-313.89776357827475 us, readin=3064 us, drift_speed=1.565 mm/us 
[23:31:33.239] D [  main  ] configuring component: "Reframer":"reframer-apa0"
[23:31:33.239] D [  gen   ] <Reframer:reframer-apa0> using anode: "AnodePlane:apa0" 
[23:31:33.239] D [  main  ] configuring component: "FrameFileSink":"bad_apa_23211_0.npz"
[23:31:33.240] D [   io   ] <FrameFileSink:bad_apa_23211_0.npz> save * with baseline=0 scale=1 offset=0 digitize=false ch=[0,2560] tbin=[0,6000] to bad_apa_23211_0.npz 
[23:31:33.241] D [  main  ] configuring component: "Pgrapher":""
[23:31:33.241] D [ pgraph ] <Pgrapher:> connecting: 4 edges 
[23:31:33.241] D [ pgraph ] connect <Node  type:WireCell::Sio::DepoFileSource cat:1 sig:WireCell::IDepoSetSource inputs:[ ] outputs:[ WireCell::IDepoSet ]:(WireCell::IDepoSet:0) -> <Node  type:WireCell::Gen::DepoSetDrifter cat:3 sig:WireCell::IDepoSetFilter inputs:[ WireCell::IDepoSet ] outputs:[ WireCell::IDepoSet ](WireCell::IDepoSet:0)
[23:31:33.241] D [ pgraph ] connect <Node  type:WireCell::Gen::DepoSetDrifter cat:3 sig:WireCell::IDepoSetFilter inputs:[ WireCell::IDepoSet ] outputs:[ WireCell::IDepoSet ]:(WireCell::IDepoSet:0) -> <Node  type:WireCell::Gen::DepoTransform cat:3 sig:WireCell::IDepoFramer inputs:[ WireCell::IDepoSet ] outputs:[ WireCell::IFrame ](WireCell::IDepoSet:0)
[23:31:33.242] D [ pgraph ] connect <Node  type:WireCell::Gen::Reframer cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::Sio::FrameFileSink cat:2 sig:WireCell::IFrameSink inputs:[ WireCell::IFrame ] outputs:[ ](WireCell::IFrame:0)
[23:31:33.242] D [ pgraph ] connect <Node  type:WireCell::Gen::DepoTransform cat:3 sig:WireCell::IDepoFramer inputs:[ WireCell::IDepoSet ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::Gen::Reframer cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[23:31:33.242] D [  main  ] executing 1 apps, thread limit 0:
[23:31:33.242] D [  main  ] executing 1 apps, thread limit 0:
[23:31:33.242] D [  main  ] executing app: "Pgrapher"
[23:31:33.242] D [ pgraph ] <Pgrapher:> executing graph 
[23:31:33.242] D [ pgraph ] executing with 5 nodes
[23:31:33.377] D [   io   ] <DepoFileSource:> call=0 loaded 228976 active, 228976 total depos from ident 0 stream test_tracks_177.npz with 0 priors 
[23:31:34.662] D [  gen   ] <Drifter:> see EOS, ( dropped:13285 + drifted:215691 ) / total:228976 depos from stream, outside of all 2 drift xregions 
[23:31:34.703] D [  gen   ] <DepoSetDrifter:> call=0 drifted ndepos=215691 Qout=-1055048289 (92.15361339179653%) 
[23:32:25.514] D [  gen   ] <DepoTransform:depotransform-apa0> plane=0 face=0 depos=168129 total traces=1116 
[23:33:17.363] D [  gen   ] <DepoTransform:depotransform-apa0> plane=1 face=0 depos=168129 total traces=2264 
[23:34:04.218] D [  gen   ] <DepoTransform:depotransform-apa0> plane=2 face=0 depos=168129 total traces=2744 
[23:34:06.178] D [  gen   ] <DepoTransform:depotransform-apa0> plane=0 face=1 depos=8880 total traces=3544 
[23:34:08.021] D [  gen   ] <DepoTransform:depotransform-apa0> plane=1 face=1 depos=8880 total traces=4413 
[23:34:08.975] D [  gen   ] <DepoTransform:depotransform-apa0> plane=2 face=1 depos=8880 total traces=4681 
[23:34:08.988] D [  gen   ] <DepoTransform:depotransform-apa0> call=0 count=100 ndepos_in=215691 ndepos_used=177009 
[23:34:08.989] D [  gen   ] <DepoTransform:depotransform-apa0> output: frame: ident=100 time=-313898 tick=500 with 4681 traces.  frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] 
[23:34:09.384] D [  gen   ] <Reframer:reframer-apa0> input : frame: ident=100 time=-313898 tick=500 with 4681 traces.  frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] 
[23:34:09.384] D [  gen   ] <Reframer:reframer-apa0> output: frame: ident=100 time=-249898 tick=500 with 2560 traces.  frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] 
[23:34:09.388] D [   io   ] <FrameFileSink:bad_apa_23211_0.npz> input frame: frame: ident=100 time=-249898 tick=500 with 2560 traces.  frame tags:[ ] 0 tagged trace sets:[ ] cmm:[ ] 
[23:34:09.388] D [   io   ] <FrameFileSink:bad_apa_23211_0.npz> call=0 frame=100 ntraces=2560 tag="*" 
[23:34:12.448] D [   io   ] <FrameFileSink:bad_apa_23211_0.npz> no channel mask maps at call 0 
[23:34:12.463] D [   io   ] <DepoFileSource:> call=1, read1 depo stream EOF with file=test_tracks_177.npz 
[23:34:12.463] D [   io   ] <DepoFileSource:> EOS at call=1 
[23:34:12.463] D [  gen   ] <DepoSetDrifter:> EOS at call=1 
[23:34:12.463] D [  gen   ] <DepoTransform:depotransform-apa0> EOS at call=1 
[23:34:12.463] D [  gen   ] <Reframer:reframer-apa0> EOS at call=1 
[23:34:12.463] D [   io   ] <FrameFileSink:bad_apa_23211_0.npz> EOS at call=1 
[23:34:12.463] D [ pgraph ] <Pgrapher:> graph execution complete 
[23:34:12.463] I [ timer  ] Timer: WireCell::Gen::DepoTransform : 148.88 sec
[23:34:12.463] I [ timer  ] Timer: WireCell::Sio::FrameFileSink : 2.98 sec
[23:34:12.463] I [ timer  ] Timer: WireCell::Gen::DepoSetDrifter : 1.3 sec
[23:34:12.463] I [ timer  ] Timer: WireCell::Sio::DepoFileSource : 0.14 sec
[23:34:12.463] I [ timer  ] Timer: WireCell::Gen::Reframer : 0.1 sec
[23:34:12.463] I [ timer  ] Timer: Total node execution : 153.40000485628843 sec
[23:34:12.465] D [  main  ] finalizing component: "FrameFileSink":"bad_apa_23211_0.npz"
[23:34:12.465] D [   io   ] <FrameFileSink:bad_apa_23211_0.npz> closing bad_apa_23211_0.npz after 2 calls
justIN time: 2025-09-18 20:53:58 UTC       justIN version: 01.05.00