## Please edit system and help pages ONLY in the moinmaster wiki! For more
## information, please see MoinMaster:MoinPagesEditorGroup.
##master-page:CategoryTemplate
##master-date:Unknown-Date
#format wiki
#language en

= JSOC Production Users Guide to Data Retrieval, Build and Release of Housekeeping Configuration Files =
The following describes the process steps for doing data retrieval, build and check in to JSOC CVS of the housekeeping configuration files.
=== Sending housekeeping configuration files from LMSAL server ===
On hmifsw1.atc.lmco.com, run send stanford file script to send STANFORD_TLM_HMI_AIA.txt and GROUND_to_CODE_ids.txt files to solserv.lmsal.com server. There is a cron job currently setup to copy over files to solserv machine. 
{{{ 
% ssf_to_jsoc.pl
}}}
=== Getting Production housekeeping configuration files from LMSAL server ===
On j0.stanford.edu as account production run check lmsal queue file script to check for updates. If there are updates in the queue file, this script will copy over latest STANFORD_TLM_HMI_AIA.txt and GROUND_to_CODE_ids.txt files from solserv  machine to j0 machine. This can be setup as cron job. The cronjob is setup on j0 in production but is commented out. Currently is used by running manually.
{{{ 
% clmq.pl
}}}
=== Building necessary files for Production Level 0 Software Processing  ===
The clmq.pl script will build necessary files for Level 0 Software by executing the following scripts.<<BR>>

 * make_hkpdf.pl  -- Makes HK Packet Data Format files 

 * jsoc_make_jsd_file.pl --Makes HK JSD files(preliminary and final) based on latest configuration delivered

 * jsoc_do_jsvn_map_file.pl -- Makes mapping files containing JSOC Version Number mapped to the Packet Version Number

 * mhds.pl  -- Makes housekeeping HK by APID and SDO HK by APID jsd files based on latest configuration files.

 * cjds.pl  -- Creates new HK by APID and SDO HK by APID jsoc dataseries in DRMS if needed. Uses create_series executable.

=== Checking in necessary files for Production Level 0 Software Processing ===
The clmq.pl script calls cicf.pl script to check into JSOC cvs all HK configuration files.<<BR>>
 * cicf.pl  -- Checks in configuration files into JSOC CVS directory TBL_JSOC

=== Updating necessary files for Production Level 0 Software Processing ===
There are three directories that need to be updated to bring over the latest configuration files. There are directories with hk configuration files, sdo hk configuration files, and the mapping files containing the JSOC version number lookup files. The data capture system and pipeline systems that use Level 0 software need to get updates of configuration files from JSOC CVS.  The following script can be used to update these systems. This script updates production's /home/production/cvs/TBL_JSOC/lev0 directory. 
{{{ 
% daily_hk_update.pl
}}}
=== Open Bugs, Issues or Updates Required ===

 * On cron job for clmuq.pl

The cron job for clmuq.pl script is commented out, so this script can be run manually by user. The cron job on production account on j0 machine currently is not working because ssh agent is not setup for script to do copy of STANFORD_TLM_HMI_AIA.txt, GROUND_to_CODE_ids.txt and queue file from solserv.lmsal.com to j0 without a password prompt. Also final test to check all steps above works on production account on j0  of "live" updates has not been carried out because last updates to scripts were on September 2008 and there has not been any new updates of STANFORD_TLM_HMI_AIA.txt and GROUND_to_CODE_ids.txt files from LMSAL team to do this final check of all steps. 

 * On cron job for ssf_to_jsoc.pl

The cvs repository on hmifsw1 is no longer there(as of 12-4-2008) so checking for updates of STANFORD and GROUND files in cvs does not work.