HET End-Trimester Report
Second Period of 2022
April 1 - July 31

This report is composed of five sections:
Facility Status

In this section we will discuss the status of the HET facility and each instrument and any limitation to configurations that occurred during the period.

                      
               

Probe and instrument availability statistics:
There were a total of 123 nights in the trimester:
LRS2-B
LRS2-R
VIRUS
HPF
HPF
LFC
HPF
high-prec.
Guider 1
Guider 2
WFS 1
WFS 2
DIMM
123
123
123
101
100
49
99
123
0
123
123
100%
100% 100% 82%
81%
40%
80% 100% 0%
100% 100%




Observing Statistics

Commissioning, Engineering, and Guaranteed Time Report There were 256 hours granted in the 22-2 period:

There were 253.2 hours of eng/comm/GTO used (charged) in the 22-2 period, in the following categories:





Month by Month Summary

The following table gives the observing statistics for each month. Column A gives the fraction of the month that was spent attempting science (as opposed to engineering or instrument commissioning). Science time is defined to begin at 18 degree evening twilight and end at 18 degree morning twilight. Column B gives the fraction of the possible science time (A) lost due to weather. The other columns give the amount of remaining science time (after removing weather losses) not spent attempting science targets. Please note that the first stack of the night often occurs before 18 degree twilight.

Month A:
Fraction of the Time that was Possible Science
B:
Fraction of Total Time Lost due to Weather
C:
Fraction of Actual Science Time Spent with Shutter Open
D:
Fraction of Actual Science Time Lost due to Overhead
E:
Fraction of Actual Science Time Lost due to Alignment
F:
Fraction of Actual Science Time Lost due to Problems
G:
Fraction of Actual Science Time Not accounted for or Lost
Apr
0.981
0.272
0.668
0.248
0.0564
0.0274
0.0000
May
0.968
0.251
0.659
0.257
0.0683
0.0164
0.0000
Jun 0.969
0.336
0.540
0.238
0.1100
0.1130
0.0000
Jul
0.937
0.267
0.593
0.248
0.1020
0.0568
0.0000

The following tables give a break down of all attempted science visits as well as the category that each falls into.

Charged exposures
Number of Times Shutter Open (Hours) Type
3158
434.58
A - Acceptable
65
15.65
B - Acceptable but Border line conditions
423
102.42
4 - Priority 4 visits (does not include 1/2 charge)
0
0.0 Q - charged but PI error
0 0.0 C - Acceptable by RA but PI rejects

Uncharged exposures caught by RA
Number of Times Shutter Open (Hours) Type
2
0.82
N - Rejected due to unknown cause
49
6.32
E - Rejected for Equipment Failure
238
52.72
W - Rejected for Weather
19
5.88
H - Rejected for Human Errors

Uncharged exposures caught by PI
Number of Times Shutter Open (Hours) Type
2
0.62
P - Rejected for weather
0
0.00 F - Rejected for Equipment Failure
0
0.00 T - Rejected for poor track choice
2
0.67 X - Rejected for Human failure

Acceptable but Uncharged exposures
Number of Times Shutter Open (Hours) Type
0
0.0 I - Targets observed under otherwise idle conditions

The following setup statistics include slew, acquisition, and starting data collection script. The table below gives the average setup time for each instrument PER ACTUAL VISIT and the average and maximum COMPLETED charged science exposures and visits.

The "Exposure" is defined by when the (CCD) shutter opens and closes. A "Visit" is the requested total CCD shutter open time during a track and might be made up of several "Exposures". "Visit" as defined here contains no overhead. To calculate one type of observing efficiency metric one might divide the "Visit" by the sum of "Visit" + "Overhead".

The average setup per visit is calculated from acceptable priority 0-3 (not borderline) science targets. This number reflects how quickly we can move from object to object on average for each instrument, however, this statistic tends to weight the setup for programs with large number of targets.

The average overhead percentage is calculated for each instrument and shows how much of that instrument's total time on sky (overhead+exposure) was overhead. NB: LRS2 has the smallest overhead %, but typical LRS2 observations use much longer exposures than VIRUS, even though VIRUS has a faster average setup time.



Instrument Avg Setup per Visit
(min)
Total time exposed
(hrs)
Overhead
%
VIRUS 4.28
168.57
24.41%
LRS2 5.66
77.45
29.47%
HPF 6.57
133.40
33.20%

The setup statistics can be shortened by multiple setups (each one counted as a separate visit) while on the same target such as moving from LRS2-B to LRS2-R.



HETDEX time interruptions:

Within the times when HETDEX shots were available on-sky for >20 minutes, the following percentages summarize how the time was used:




Overall time charged: 253.2 (eng/comm/GTO) + 254.3h (sci) = 507.5h
Total estimated science time available (in TAC time determinations): 480.6h
   Conclusion: weather in 22-2 was better than expectations by ~27 hours.
     This is our best 2nd trimester in 5 years. In previous years we saw 390.3; 478.9; 469.2; 459.8 hours charged.




Observing Programs Status

In the table below we show the breakdown of the charged time for each program submitted. The "Total %" is the completion of the entire TAC time including P4 time. The last four columns show the completion rate for targets submitted in each priority bin. This completion rate is the greater of the targets completed percentage and the TAC allocation completed percentage in each priority bin.

Institution Tot exp
Tot OH
Tot Chrg Tot TAC Total % P0 Completion
P1 Completion P2 Completion P3 Completion










G22-2-001 0.22
0.10
0.32
0.33
96%


100%
G22-2-002 4.50
1.04
5.54
8.87
62%
100%
100%
100% 0% (NT)










M22-2-001 7.35
1.28
8.63
9.20
94%

100%
100%
83%
M22-2-002 2.25
0.72
2.97
3.00
99%

100%
100%

M22-2-003 2.10
0.48
2.58
2.60
99%
100%
100%












PSU22-2-001 7.58
1.37
8.94
10.25
87%
100%


100%
PSU22-2-002 1.75
0.50
2.25
5.73
39%
100%
100%
100%

PSU22-2-003 1.08 0.00
1.08 1.58 69%(P4)




PSU22-2-004 4.65
0.00
4.65
6.33
73%(P4)




PSU22-2-005 3.94
0.61
4.55
10.97
41%



100%
PSU22-2-006 1.00
0.37
1.37
1.40
98%


100%

PSU22-2-007 0.00
0.00 0.00 1.07
0% 0% (TD)



PSU22-2-008 2.75
0.86
3.61
3.50
103%


100%
100%
PSU22-2-009 1.05
0.33 1.38 1.37
101%
100%


PSU22-2-010 6.30
1.47
7.77
8.00
97%

100%
100%
100%
PSU22-2-011 3.33
1.47
4.80
5.20
92%
100%
100%


PSU22-2-012 2.29
0.96
3.25
1.85
176%


100%

PSU22-2-013 11.20
3.19
14.39
15.00
96%
100%
100%
100%
100%










UT22-2-002 14.03
2.43
16.46
18.00
91%
100%
100%
100%

UT22-2-003 4.91
2.82
7.73
26.30
29%(P4)



100%
UT22-2-004 4.50 1.03
5.53
5.20
106%
100%



UT22-2-005 0.00
0.00
0.00
2.00
0%(P4)




UT22-2-006 9.95
3.31
13.26
16.70
79%(P4)

100%
100%

UT22-2-007 26.79
3.57
30.36
35.40
86%(P4)

100%
100%
100%
UT22-2-008 7.17
3.41
10.57
19.50
54%(P4)


100%

UT22-2-009 7.33
1.40
8.73
9.10
96%


96%

UT22-2-010 0.36
0.00
0.36
5.00
7%(P4)




UT22-2-011 3.95
1.53
5.48
7.00
78%

80%


UT22-2-012 4.25
1.57
5.82
6.00
97%

100%

100%
UT22-2-013 3.42
1.25
4.67
17.80
26%(P4)


100%
9% (SI)
UT22-2-014 12.17
7.69
19.86
33.60
59%(P4)


100%
100%
UT22-2-015 5.78
0.00 5.78
5.00
115%(P4)




UT22-2-016 5.50
1.30
6.80
7.30
93%
100%
100%

62% (DT)
UT22-2-018 11.38
5.56
16.93
26.00
65%(P4)


100%
100%
UT22-2-019 8.33
3.07
11.40
19.30
59%(P4)
100%
100%

100%
UT22-2-021 4.58
1.28
5.87
5.60
105%

100%
100%











HET22-2-100 145.50
44.35
189.85
190.00
99.92%
100%



HET22-2-203 6.67
1.40
8.07
8.00
101%
100%
100%
100%
100%
HET22-2-300 16.63
4.07
20.69
20.00
103%
100%
100%
100%





















J* = joint program between UT, PSU, and Munich - see summary at bottom of table
NT = no (or very late-in-trimester) targets submitted at this priority (even though time was allocated)
HC = HETDEX conflict (targets submitted were in direct competition with HETDEX; PI was aware of issue)
SI = Seasonally inappropriate or narrowly distributed target list
TD = Time Domain targets (either none submitted or submitted targets unreachable due to weather)
DT = Dark Time targets (often need high priority and good sky distribution to be successful)
P4 = Program's overall completion fraction is significantly impacted by the utilization of P4 time


Program Completion Rates
(sci only, removing NT/HC/TD)
Priority Average Completion Median Completion
P0 92.8%* 100%
P1 98.9% 100%
P2 99.8% 100%
P3 84.6% 100%
*one PSU time domain program never observed any of their Pr0 time allocation this trimester



Completion trends by priority









Institution Status

Below we show how the TAC allocations were determined.

quantity
Apr
(hrs)
May
(hrs)
Jun
(hrs)
Jul
(hrs)
Total
(hrs)
18deg-18deg
248.20
224.58
199.88
215.15
887.82
Weather loss frac. 0.396
0.384
0.435
0.487

Efficiency loss frac.
(align+PRs)
0.06
0.07
0.07
0.04

"Clear science" time
140.92
128.66
105.03
105.96
480.56
Com/Eng/GTO time




235.00
"Allowed" hours
given to TACs
for science




245.56




Partner
Share
Time deficit correction
Notes
Total hours
allowed
Goettingen
0.03860
-0.26

9.22
Munich
0.05724
+2.76

16.82
PSU
0.24897
-7.52

53.62
UT
0.65518
+5.02
-20h TESLA allocation
   per HET Board
145.91

Corrections were applied using 20% of the cumulative deficits in time balance between the partners. As of August 1st 2021, those time deficits were:
  UT:   25.1h deficit
  PSU: 37.6h surplus
  M:    13.8h deficit
  G:     1.3h surplus
Actual time usage is carefully monitored to ensure equitable balance between the partners; these corrected allocations should help improve this balance over the long-term.

TACs may allocate up to 8.3% at P0, 25% at P1, 33.3% at P2 and 33.3% at P3. P4 allocations are generally un-restricted. GTO and engineering time are assigned by the HET board and not from this formula.


This is how each institution had allocated its time by priority:

Time Allocation by Institution (hours)

Institution Priority 0 Priority 1 Priority 2 Priority 3 Priority 4 Total P0-P3
Frac. of allowed
Goettingen 0.80
2.20
3.10
3.10
-
9.20
99.8%
Munich 1.40
4.20
5.60
3.60
-
14.80
88.0%
PSU 4.00
12.29
17.90
17.90
20.16
52.09
97.1%
UT 12.10
39.10
51.90
48.70
113.00
151.80
104.0%
Other allocations
GTO 195.00 10.00 11.00 2.00
-
218.00
100.0%

Notes:
1) Allocations in joint programs are reported separately for each partner here





The following is a summary of the total charged time for each institution based on our htopx data base (for shutter open) and night reports (for overhead). It includes shutter open time (weighting priority four by half) and overhead (no overhead for priority 4 observations). Recently this calculation was re-derived using a deficit/surplus model. For each financial year the share paid is compared with the time charged - any discrepancy between the two is tracked and carried forward as a deficit. A negative deficit means more time was observed for that partner than their financial share; a positive deficit means less time was observed. These deficits are calculated in each previous financial year; the table below also includes a preliminary total for the current financial year so far.

Accumulated deficits
for each partner


UT
PSU
M
G
total sci
hours
FY2015-2016

+4.6
-6.9
+1.1
+1.2
40.49
FY2016-2017

+22.7
-22.8
+0.8
-0.8
439.56
FY2017-2018

+37.7
-21.9
-14.7
-1.2
887.71
FY2018-2019

+43.0
-32.0
-10.8
-0.2
1401.17
FY2019-2020

+48.9
-48.4
+0.6
-1.1
2101.82
FY2020-2021

+25.1
-37.6
+13.8
-1.3
3095.70
FY2021-2022

+1.7
-19.0
+13.5
+3.8
4140.40
percent of deficit:

+0.04%
-0.46%
+0.33%
+0.09%

*Note that UT's deficit is decreasing and all partner deficits are <0.5% of total science hours since the WFU.
NB: a more comprehensive annual partner fractional time charging analysis is produced separately from these trimester reports; a current copy can be provided upon request.



Below are the summaries of the Guaranteed Time Observations (GTO) programs granted by the Board:

GTO and Special Time Charged by Project (hours)
Project Allocated
in 22-2
Allocated total
to date
including 22-2
Charged
in 22-2
Charged total
to date
including 22-2
HETDEX (HETYY-P-100) 190.0 2704.0 189.9 2071.4
LRS2 GTO (HETYY-P-2XX) 8.0 199.9 8.1 124.5
HPF GTO (HETYY-P-3XX) 20.0 240.4 20.7
241.3
GW (HETYY-P-400) 0.0 70.0
0.0
12.4

(Totals to date start from the 11-2 period)






Significant time losses to problems during the trimester

The following are our most significant problems in terms of their time lost, keeping those with >60min lost:

Lost
minutes
PR #
Brief description
71
58
10
3

5962
5981
6067
Zeus/Juno computer crash/black
114
5907
H6 velocity fault
365
88
2
36
9
14
9
14
58
36
15
17
67

5364
6024
6026
6031
6042
6041
6042
6002
6045
6053
6056
6060
WFS2 timeout, other probe issues

61
4342
HEFI crash during stack
60
6029
fixedap required for stacking
346
6040
upper corner SAMS issues
83
6049
7:1 9:1 not aligned after swaps
75
5755
Cameras not updating, PAS crash
259
6073
network failure during upgrades









SJ, 9 Aug 2022