How To Access Your HET Data
Current Science Operations Data Access
To access your data you will need to acquire a login to the TACC and once that
login is confirmed you will need to contact Greg Zeimann, the HET
Data Scientist (grzeimann(at)gmail.com) and let him know what your
TACC login is. Once your TACC login is linked to the HET project
at the TACC you will have to wait for the TACC human approval to
take place, this usually takes less than 48 hours.
To access your reduced data you will need to login to
ls6.tacc.utexas.edu using this login then cd to where the data
is located:
/work/03946/hetdex/maverick/LRS2/UT24-1-001 (for LRS2, reduced
with Panacea)
or
/work/03946/hetdex/maverick/HPF/UT24-1-001
(for HPF, reduced with Goldilocks)
where you replace "UT24-1-001" with your program's ID.
This information is also provided in your "New data" emails,
sent the morning after your observations have been obtained.
NOTE: You should only retrieve your data from the TACC. You
should not use command line resources for analysis. Doing any
command line, ie. not a submitted job, actions which take
significant CPU resources causes problems for all users of the
TACC and can result in users being banned from the TACC.
(There are ways to request a compute node, if additional
computing resources are required - contact the RAs for help if
needed.)
While it is rarely necessary, you can also access the full
directory structure in each nightly working directory using the
date, instrument name, then the shot/observation number for that
set, then the exposure number within the shot/observation.
Example: 20160401/lrs2/lrs20000001/exp01/lrs2 for lrs2 data
All of the setup images are stored in the directory acm in the
same nightly working directory as the science data (although
these will be in tar files that include every image from that
night). The images names are date stamped so look for the image
taken just before an observation began. In the near future we
will be generating a tar file with the setup images for each
observation and those will be located in the same level as the
expXX directories.
Example: 20170401/acm/20170401T233957.4_acm_sci.fits for
acquisition images
To associate the position of the fiber head of the instrument
you are using with the ACM image please see the appropriate
regions file for that instrument:
All of the guider images are stored in the directory gc1 or gc2
(there are two guiders) in the same nightly working directory as
the science data (all guider images from a night are stored in a
tar file). The images names are date stamped so look for the
image taken at the same time as your observation. In the near
future we will be generating a tar file with the guider images
for each observation and those will be located in the same level
as the expXX directories.
Example: 20170401/gc1/20170401T000052.4_gc1_sci.fits for guider
1 images
Example: 20170401/gc2/20170401T000049.5_gc2_sci.fits for guider
2 images
How to Access old (pre-2014) HET Data (retained for legacy
purposes)
Upon acceptance of your project by the HET staff, you will be
given an
ftp account for retrieving your data from the data server in
Austin.
For illustration we will give an example of retrieving data
for the project UT02-2-004. This project has been provided with
the login
name of schwartz and the password of Sponge. The
PI has been
notified by the HET staff that she has data from the night of
October 31, 2002
UT (20021031). The commands used to retrieve the data
using the
standard Unix command line sftp program are listed to the right
in the table below:
sftp to hydra.as.utexas.edu |
sftp
schwartz@hydra.as.utexas.edu |
use the provided password |
Sponge |
cd to the directory that is named
the same as your
project |
cd
/het_data/het_users/UT02-1-004 |
cd to the data directory named for
the UT observing
date |
cd 20021031 |
set sftp to binary mode |
binary |
get all the data |
mget * |
cd to the calibrations directory |
cd
/het_data/het_users/calibrations |
cd to the data directory named for
the UT observing date |
cd 20021031 |
get the README file describing the
available calibration files |
mget README.* |
get all the files needed to
calibrate your data |
mget * |
exit ftp |
bye |
When you are notified that new data are available, the e-mail
message
should give a description of the contents of the files taken for
your
project. If there are any questions about the data,
calibrations, or
anything to do with the observations, please send an e-mail
to the Resident
Astronomers.
If there are any problems with the ftp system (including lost or
forgotten
passwords or account names), please contact Jim Fowler.
Last updated: Fri, 29 Dec 2023 10:51:54 +0000 stevenj
|