Failed to connect to MySQL: Access denied for user ''@'localhost' (using password: NO)

Civil Date
Ephemerides
2018-09-29SunsetSunriseMoon
Set12°18°18°12°RiseRiseSet
00:4701:3602:0411:2911:5712:4604:03-
Night Length9:25Sunset Temperature


On-Duty Personnel
Resident AstronomerTelescope OperatorOPS EngineerDay Ops
Steven JanowieckiAmy Westfall--


Overlapsnone

Other Personnelnone

Guestsnone


Open/Close Log
Open timeOutdoor tempTruss tempClose timeReasonTime open
00:4518.718.510:45dew point10:00
Total Time Open10:00


      
ProgramNight PriorityScience
02:04Engineering (FPA checkout)
02:51Science
04:13Engineering (FPA checkout/HPF)
04:49Science
05:44Engineering (FPA checkout/HPF)
10:43Idle due to weather (dewpoint)
Stack Data
StartStopee50ee80Hefi FocusMars FocusOutside TempDome TempTruss TempWind DirectionWind SpeedStack Type
02:2802:5317.117.618.313511First of Night
↪ CommentsNo measurement. HEFI crashed 3 times in a row.
10:1710:231.021.60220-28215.115.315.620217Post-Observing
10:2410:4814.915.315.520214Stack/Re-stack


Problem Reports
PR NumberTimesTime LostDescriptionResponse
525403:43-04:1300:30 LRS2 pivot stopped, caused VIRUS observation (via vlexp) to crashTonight while taking a p1 VIRUS observation, vlexp crashed between the 2nd and 3rd dither. Error messages are listed below. It appears that LRS2 pivot and the LRS2server had died, and that the parallel LRS2 exposure managed to kill the VIRUS dither. This is unfortunate behavior, for a malfunctioning parallel instrument to take down the primary. Recovery followed procedure in wiki: 03:59 try restarting LRS2 pivot. This fails with errors: Failed to bind to tcp://127.0.0.1:39999: Address already in use. following wiki restart procedures for when RAMdisk is full 04:01:10 stop LRS2 server 04:02:10 restart lrs2pivot pivot log says it is ok 04:02:30 restart LRS2server 04:03:24 asHETDEX: ~sir/dev/trunk/scripting/scripts/dt_fix.sh lrs2 waiting to see if RAM disk clears YES! looks good. take another bias. All working normally and images coming in ok. 2018-09-30T03:43:50.382 INFO [vlexp :single_parallel_exp : 147] - Shutter is closed 2018-09-30T03:43:50.386 INFO [vlexp :single_parallel_exp : 158] - Offsetting Guider1 fiducial by dx -1.46 and dy 0.0 compensate is true 2018-09-30T03:43:50.389 INFO [vlexp :single_parallel_exp : 158] - Offsetting Guider2 fiducial by dx -1.46 and dy 0.0 compensate is true 2018-09-30T03:44:19.117 INFO [vlexp :single_parallel_exp : 162] - Waiting for readout 2018-09-30T03:44:24.120 ERROR [vlexp :single_parallel_exp : 180] - Timeout waiting for message ID 6 ACK, spent 5.000067 seconds. Receiver for vlexp_lrs211765 is likely offline. Traceback (most recent call last): File "/opt/het/hetdex/bin/vlexp", line 527, in args.exp_time,exposure_template,obs_type,args.pobj,args.sobj,last,dshifts) File "/opt/het/hetdex/bin/vlexp", line 175, in single_parallel_exp sinst.wait_for_readout(observation=sr["observation"], exposure=sr["exposure"]) File "", line 3, in wait_for_readout_method pytcs.error: Timeout waiting for message ID 6 ACK, spent 5.000067 seconds. Receiver for vlexp_lrs211765 is likely offline. Traceback (most recent call last): File "/opt/het/hetdex/bin/iexp", line 309, in res = subprocess.check_output(shlex.split(cmd)) File "/opt/het/hetdex/Python-2.7/lib/python2.7/subprocess.py", line 573, in check_output raise CalledProcessError(retcode, cmd, output=output) subprocess.CalledProcessError: Command '['vlexp', '-B', '-i', 'virus', '-pobj', 'SSA22_fieldE4a_000_E', '-texp', '420.0', '-dither']' returned non-zero exit status 1
525505:00-05:0000:00Trajectory and probe offsets made in GC1 result in motions opposite from what is commanded
468202:48-02:5200:04HEFI lost communications (red HEFI Operations text) during focus curves, produced 0.00 values 3 times while trying to measure first stack of night. First stack of night was not measured.


Ops Commentsnone


TO CommentsClear and calm all night.


RA Commentsnone


Observations
FileTarget/QIDExp StartExposureOverheadProgramInstrument ConfigurationData TypeIQDimmSkySBrtSkytransSNRCommentsCharge
lrs20008880_01bias00:410 LRS2calS  Yes
virus0008880_01bias00:410 VIRUScalS  Yes
0001twilight00:5010.5 HPFcalS  Yes
0002twilight00:5210.5 HPFcalS  Yes
0003twilight00:5310.5 HPFcalS  Yes
0004twilight00:5562.9 HPFcalS  Yes
lrs20000001_01skyflat00:5713 LRS2calS  Yes
lrs20000002_01skyflat00:5816 LRS2calS  Yes
lrs20000003_01skyflat01:0022 LRS2calS  Yes
lrs20000004_01skyflat01:0130 LRS2calS  Yes
virus0000001_01skyflat01:047 VIRUScalS  Yes
virus0000002_01skyflat01:0510 VIRUScalS  Yes
virus0000003_01skyflat01:0614 VIRUScalS  Yes
virus0000004_01skyflat01:0718 VIRUScalS  Yes
virus0000005_01skyflat01:0826 VIRUScalS  Yes
virus0000006_01skyflat01:0945 VIRUScalS  Yes
0005GJ_69902:09325.10.6ENG18-3-003HPFeng observed late in track - from guider issueNo
0006GJ_69902:15325.10.6ENG18-3-003HPFeng observed late in track - from guider issueNo
lrs20000005_01Hg_R02:2627 LRS2calS  Yes
lrs20000005_02Hg_R02:2827 LRS2calS  Yes
lrs20000005_03Hg_R02:2927 LRS2calS  Yes
lrs20000006_01Hg_B02:3015 LRS2calS  Yes
lrs20000006_02Hg_B02:3215 LRS2calS  Yes
lrs20000006_03Hg_B02:3315 LRS2calS  Yes
lrs20000007_01Cd-A_B02:3435 LRS2calS  Yes
lrs20000007_02Cd-A_B02:3635 LRS2calS  Yes
lrs20000007_03Cd-A_B02:3735 LRS2calS  Yes
lrs20000008_01FeAr_R02:3915 LRS2calS  Yes
lrs20000008_02FeAr_R02:4015 LRS2calS  Yes
lrs20000008_03FeAr_R02:4115 LRS2calS  Yes
lrs20000009_01flat_Qth_R02:4215 LRS2calS  Yes
lrs20000009_02flat_Qth_R02:4415 LRS2calS  Yes
lrs20000009_03flat_Qth_R02:4515 LRS2calS  Yes
lrs20000009_04flat_Qth_R02:4615 LRS2calS  Yes
lrs20000009_05flat_Qth_R02:4715 LRS2calS  Yes
lrs20000010_01flat_ldls_long_B02:4815 LRS2calS  Yes
lrs20000010_02flat_ldls_long_B02:5015 LRS2calS  Yes
lrs20000010_03flat_ldls_long_B02:5115 LRS2calS  Yes
virus0000007_01parallel03:004209.0UT18-3-008VIRUSsci1.51  Yes
lrs20000011_01parallel03:00420 LRS2sci  Yes
virus0000007_02parallel03:084201.0UT18-3-008VIRUSsci1.09  Yes
lrs20000011_02parallel03:08420 LRS2sci  Yes
virus0000007_03parallel03:164201.0UT18-3-008VIRUSsci1.46  Yes
lrs20000011_03parallel03:16420 LRS2sci  Yes
virus0000008_01parallel03:284205.0UT18-3-008VIRUSsci1.05 3rd dither was not taken due vlexp crashNo
lrs20000012_01parallel03:28420 LRS2sci  Yes
virus0000008_02parallel03:364201.0UT18-3-008VIRUSsci0.99 3rd dither was not taken due vlexp crashNo
lrs20000012_02parallel03:36420 LRS2sci  Yes
lrs20005557_01bias04:040 LRS2calS  Yes
0007GJ_90804:23440.41.7ENG18-3-003HPFeng1.21  Yes
0008GJ_90804:32440.40.7ENG18-3-003HPFeng1.30  Yes
0009GJ_90804:40440.40.7ENG18-3-003HPFeng0.86  Yes
virus0000009_01LDS_749B_024_W04:54605.0VIRUSspecS  Yes
virus0000009_02LDS_749B_024_W04:56601.0VIRUSspecS  Yes
virus0000009_03LDS_749B_024_W04:58601.0VIRUSspecS  Yes
virus0000010_01LDS_749B_046_W05:03604.0VIRUSspecS  Yes
virus0000010_02LDS_749B_046_W05:05601.0VIRUSspecS  Yes
virus0000010_03LDS_749B_046_W05:07601.0VIRUSspecS  Yes
virus0000011_01LDS_749B_046_W05:11603.0VIRUSspecS  Yes
virus0000011_02LDS_749B_046_W05:13601.0VIRUSspecS  Yes
virus0000011_03LDS_749B_046_W05:15601.0VIRUSspecS  Yes
lrs20000013_01FEIGE_110_056_E05:211204.0LRS2specS  Yes
lrs20000014_01FEIGE_110_056_E05:262404.0LRS2specS  Yes
lrs20000015_01FEIGE_110_066_E05:351804.0LRS2specS  Yes
lrs20000016_01FEIGE_110_066_E05:402404.0LRS2specS  Yes
virus0000012_01ngc7128_024_W06:151201.0VIRUSeng  Yes
virus0000012_02ngc7128_024_W06:181201.0VIRUSeng  Yes
virus0000012_03ngc7128_024_W06:211201.0VIRUSeng  Yes
0010GJ_8706:32954.20.1ENG18-3-003HPFeng1.19  Yes
0011GJ_8706:48954.21.1ENG18-3-003HPFeng1.40  Yes
0012GJ_90807:29440.40.7ENG18-3-003HPFeng1.48  Yes
0013GJ_90807:37440.41.7ENG18-3-003HPFeng1.31  Yes
0014GJ_90807:45440.40.7ENG18-3-003HPFeng1.11  Yes
0015GJ_17208:04450.90.5ENG18-3-003HPFeng1.49  Yes
0016GJ_17208:12450.90.5ENG18-3-003HPFeng1.28  Yes
0017GJ_17208:20450.91.5ENG18-3-003HPFeng1.35  Yes
0018GJ_8709:40954.21.1ENG18-3-003HPFeng  Yes
0019GJ_8709:57954.21.1ENG18-3-003HPFeng  Yes
virus0000013_01Hg10:2715 VIRUScalS  Yes
virus0000013_02Hg10:2815 VIRUScalS  Yes
virus0000013_03Hg10:2915 VIRUScalS  Yes
virus0000014_01Cd-A10:3015 VIRUScalS  Yes
virus0000014_02Cd-A10:3115 VIRUScalS  Yes
virus0000014_03Cd-A10:3315 VIRUScalS  Yes
virus0000015_01flat_ldls_long10:3415 VIRUScalS  Yes
virus0000015_02flat_ldls_long10:3515 VIRUScalS  Yes
virus0000015_03flat_ldls_long10:3615 VIRUScalS  Yes
virus0000015_04flat_ldls_long10:3715 VIRUScalS  Yes
virus0000015_05flat_ldls_long10:3815 VIRUScalS  Yes
virus0000015_06flat_ldls_long10:3915 VIRUScalS  Yes
virus0000015_07flat_ldls_long10:4115 VIRUScalS  Yes
virus0000015_08flat_ldls_long10:4215 VIRUScalS  Yes
virus0000015_09flat_ldls_long10:4315 VIRUScalS  Yes
virus0000015_10flat_ldls_long10:4415 VIRUScalS  Yes
virus0000016_01dark10:45360 VIRUScalS  Yes
lrs20000017_01bias10:520 LRS2calS  Yes
virus0000017_01bias10:520 VIRUScalS  Yes
lrs20000017_02bias10:530 LRS2calS  Yes
virus0000017_02bias10:530 VIRUScalS  Yes
lrs20000017_03bias10:540 LRS2calS  Yes
virus0000017_03bias10:540 VIRUScalS  Yes
lrs20000017_04bias10:540 LRS2calS  Yes
virus0000017_04bias10:540 VIRUScalS  Yes
lrs20000017_05bias10:550 LRS2calS  Yes
virus0000017_05bias10:550 VIRUScalS  Yes
lrs20000017_06bias10:560 LRS2calS  Yes
lrs20000017_07bias10:560 LRS2calS  Yes
virus0000017_06bias10:560 VIRUScalS  Yes
virus0000017_07bias10:560 VIRUScalS  Yes
lrs20000017_08bias10:570 LRS2calS  Yes
virus0000017_08bias10:570 VIRUScalS  Yes
lrs20000017_09bias10:580 LRS2calS  Yes
lrs20000017_10bias10:580 LRS2calS  Yes
virus0000017_09bias10:580 VIRUScalS  Yes
virus0000017_10bias10:580 VIRUScalS  Yes
lrs20000017_11bias10:590 LRS2calS  Yes
virus0000017_11bias10:590 VIRUScalS  Yes
lrs20000017_12bias11:000 LRS2calS  Yes
lrs20000017_13bias11:000 LRS2calS  Yes
virus0000017_12bias11:000 VIRUScalS  Yes
virus0000017_13bias11:000 VIRUScalS  Yes
lrs20000017_14bias11:010 LRS2calS  Yes
virus0000017_14bias11:010 VIRUScalS  Yes
lrs20000017_15bias11:020 LRS2calS  Yes
lrs20000017_16bias11:020 LRS2calS  Yes
virus0000017_15bias11:020 VIRUScalS  Yes
virus0000017_16bias11:030 VIRUScalS  Yes
lrs20000017_17bias11:030 LRS2calS  Yes
virus0000017_17bias11:030 VIRUScalS  Yes
lrs20000017_18bias11:040 LRS2calS  Yes
virus0000017_18bias11:040 VIRUScalS  Yes
lrs20000017_19bias11:050 LRS2calS  Yes
lrs20000017_20bias11:050 LRS2calS  Yes
virus0000017_19bias11:050 VIRUScalS  Yes
virus0000017_20bias11:050 VIRUScalS  Yes
0020Dark11:33314.6 HPFcalS  Yes
0021Alpha Bright FCU11:44209.7 HPFcalS  Yes
0022Alpha Bright FCU11:48209.7 HPFcalS  Yes
0023Alpha Bright Cal11:5383.9 HPFcalS  Yes
0024Alpha Bright Cal11:5583.9 HPFcalS  Yes
0025Alpha Bright Cal11:5783.9 HPFcalS  Yes
0026Alpha Bright Cal11:5983.9 HPFcalS  Yes
0027LFC FCU12:02104.9 HPFcalS  Yes
0028LFC FCU12:05104.9 HPFcalS  Yes
0029LFC FCU12:07104.9 HPFcalS  Yes
0030LFC FCU12:10104.9 HPFcalS  Yes
0031LFC FCU12:12104.9 HPFcalS  Yes
0032LFC FCU12:14104.9 HPFcalS  Yes
0033LFC Cal12:18104.9 HPFcalS  Yes
0034LFC Cal12:20104.9 HPFcalS  Yes
0035Etalon Cal12:28157.3 HPFcalS  Yes
0036Etalon Cal12:31157.3 HPFcalS  Yes
0037Etalon Cal12:35157.3 HPFcalS  Yes
0038Etalon Cal12:38157.3 HPFcalS  Yes
0039UNe Slave Cal12:42838.9 HPFcalS  Yes
0040UNe Slave Cal12:56838.9 HPFcalS  Yes
0041UNe Slave Cal13:11838.9 HPFcalS  Yes
lrs20009990_01bias21:150 LRS2calS  Yes
virus0009990_01bias21:150 VIRUScalS  Yes
lrs20009991_01FeAr_R21:3815 LRS2calS  Yes
lrs20009992_01flat_Qth_R21:3915 LRS2calS  Yes
lrs20009993_01dark21:40300 LRS2calS  Yes
virus0009991_01Hg21:5315 VIRUScalS  Yes
virus0009992_01Cd-A21:5415 VIRUScalS  Yes
virus0009993_01flat_ldls_long21:5515 VIRUScalS  Yes
0025Dark22:03314.6 HPFcalS  Yes
0026Alpha Bright Cal22:1383.9 HPFcalS  Yes
0027Alpha Bright Cal22:1683.9 HPFcalS  Yes
0028Alpha Bright Cal22:1883.9 HPFcalS  Yes
0029Alpha Bright Cal22:2083.9 HPFcalS  Yes
0030Alpha Bright FCU22:23471.9 HPFcalS  Yes
0031Alpha Bright FCU22:32471.9 HPFcalS  Yes
0032Alpha Bright FCU22:40471.9 HPFcalS  Yes
0033Alpha Bright FCU22:49471.9 HPFcalS  Yes
0034LFC FCU22:58104.9 HPFcalS  Yes
0035LFC FCU23:01104.9 HPFcalS  Yes
0036LFC Cal23:04104.9 HPFcalS  Yes
0037LFC Cal23:07104.9 HPFcalS  Yes
0038Etalon Cal23:10157.3 HPFcalS  Yes
0039UNe Slave Cal23:13838.9 HPFcalS  Yes
0040UNe Slave Cal23:28838.9 HPFcalS  Yes
0041UNe Slave Cal23:43838.9 HPFcalS  Yes