hydra.asutexas.edu

 


 


 




 

How To Access Your HET Data

Current Science Operations Data Access

To access your data you will need to acquire a login to the TACC and once that login is confirmed you will need to contact Greg Zeimann, the HET Data Scientist (grzeimann(at)gmail.com) and let him know what your TACC login is. Once your TACC login is linked to the HET project at the TACC you will have to wait for the TACC human approval to take place, this usually takes less than 48 hours.

To access your reduced data you will need to login to ls6.tacc.utexas.edu using this login then cd to where the data is located:
       /work/03946/hetdex/maverick/LRS2/UT24-1-001 (for LRS2, reduced with Panacea)
or
      /work/03946/hetdex/maverick/HPF/UT24-1-001   (for HPF, reduced with Goldilocks)
where you replace "UT24-1-001" with your program's ID.


This information is also provided in your "New data" emails, sent the morning after your observations have been obtained.

NOTE: You should only retrieve your data from the TACC. You should not use command line resources for analysis. Doing any command line, ie. not a submitted job, actions which take significant CPU resources causes problems for all users of the TACC and can result in users being banned from the TACC. (There are ways to request a compute node, if additional computing resources are required - contact the RAs for help if needed.)

While it is rarely necessary, you can also access the full directory structure in each nightly working directory using the date, instrument name, then the shot/observation number for that set, then the exposure number within the shot/observation.

Example: 20160401/lrs2/lrs20000001/exp01/lrs2 for lrs2 data

All of the setup images are stored in the directory acm in the same nightly working directory as the science data (although these will be in tar files that include every image from that night). The images names are date stamped so look for the image taken just before an observation began. In the near future we will be generating a tar file with the setup images for each observation and those will be located in the same level as the expXX directories.

Example: 20170401/acm/20170401T233957.4_acm_sci.fits for acquisition images

To associate the position of the fiber head of the instrument you are using with the ACM image please see the appropriate regions file for that instrument:

All of the guider images are stored in the directory gc1 or gc2 (there are two guiders) in the same nightly working directory as the science data (all guider images from a night are stored in a tar file). The images names are date stamped so look for the image taken at the same time as your observation. In the near future we will be generating a tar file with the guider images for each observation and those will be located in the same level as the expXX directories.

Example: 20170401/gc1/20170401T000052.4_gc1_sci.fits for guider 1 images
Example: 20170401/gc2/20170401T000049.5_gc2_sci.fits for guider 2 images




How to Access old (pre-2014) HET Data (retained for legacy purposes)

Upon acceptance of your project by the HET staff, you will be given an ftp account for retrieving your data from the data server in Austin.

For illustration we will give an example of retrieving data for the project UT02-2-004. This project has been provided with the login name of schwartz and the password of Sponge. The PI has been notified by the HET staff that she has data from the night of October 31, 2002 UT (20021031). The commands used to retrieve the data using the standard Unix command line sftp program are listed to the right in the table below:

sftp to hydra.as.utexas.edu sftp schwartz@hydra.as.utexas.edu
use the provided password Sponge
cd to the directory that is named the same as your project cd /het_data/het_users/UT02-1-004
cd to the data directory named for the UT observing date cd 20021031
set sftp to binary mode binary
get all the data mget *
cd to the calibrations directory cd /het_data/het_users/calibrations
cd to the data directory named for the UT observing date cd 20021031
get the README file describing the available calibration files mget README.*
get all the files needed to calibrate your data mget *
exit ftp bye

When you are notified that new data are available, the e-mail message should give a description of the contents of the files taken for your project. If there are any questions about the data, calibrations, or anything to do with the observations, please send an e-mail to the Resident Astronomers. If there are any problems with the ftp system (including lost or forgotten passwords or account names), please contact Jim Fowler.





Last updated: Fri, 29 Dec 2023 10:51:54 +0000 stevenj



Phase III

Phase III Information for New Users

HPF quick-look

How to Retrieve Data

World Coordinate System for HET frames

Finding Calibration Files

Updates to Your Target List

Data Rejection Policy

FAQs

Data Reduction Tips

Filling Factor Estimator