Return to
HK_Level0_Debug_Guide.html
CVS log
Up to [Development] / JSOC / doc
|
Return to
HK_Level0_Debug_Guide.html
CVS log
|
Up to [Development] / JSOC / doc
|
|
File: [Development] / JSOC / doc / Attic / HK_Level0_Debug_Guide.html
(download)
/
(as text)
Revision: 1.9, Mon Nov 29 19:51:50 2010 UTC (12 years, 6 months ago) by carl Branch: MAIN CVS Tags: HEAD Changes since 1.8: +0 -0 lines FILE REMOVED removed since could not view properly |
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="CONTENT-TYPE" CONTENT="text/html; charset=iso-8859-1">
<TITLE></TITLE>
<META NAME="GENERATOR" CONTENT="OpenOffice.org 2.3 (Unix)">
<META NAME="AUTHOR" CONTENT="Carl Cimilluca">
<META NAME="CREATED" CONTENT="20100510;9375300">
<META NAME="CHANGEDBY" CONTENT="Carl Cimilluca">
<META NAME="CHANGED" CONTENT="20100511;15511700">
<STYLE TYPE="text/css">
<!--
@page { size: 8.5in 11in; margin: 0.79in }
P { margin-bottom: 0.08in }
TD P { margin-bottom: 0in }
-->
</STYLE>
</HEAD>
<BODY LANG="en-US" DIR="LTR">
<DIV TYPE=HEADER>
<P STYLE="margin-bottom: 0.2in">HK Level Zero Code Debug
Guide(version 2 on 5/11/2010)</P>
</DIV>
<TABLE WIDTH=665 BORDER=1 BORDERCOLOR="#000000" CELLPADDING=4 CELLSPACING=0>
<COL WIDTH=57>
<COL WIDTH=63>
<COL WIDTH=68>
<COL WIDTH=114>
<COL WIDTH=66>
<COL WIDTH=247>
<THEAD>
<TR VALIGN=TOP>
<TD WIDTH=57>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Item
# </FONT></FONT>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=1>(priority)</FONT></FONT></P>
</TD>
<TD WIDTH=63>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Module
Component/ Subcomponent/</FONT></FONT></P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Executable</FONT></FONT></P>
</TD>
<TD WIDTH=68>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Error
or Warning</FONT></FONT></P>
</TD>
<TD WIDTH=114>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Total
Message</FONT></FONT></P>
</TD>
<TD WIDTH=66>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Problem
Described</FONT></FONT></P>
</TD>
<TD WIDTH=247>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Solution/</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Actions
Required</FONT></FONT></P>
</TD>
</TR>
</THEAD>
<TBODY>
<TR VALIGN=TOP>
<TD WIDTH=57>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">1</FONT></FONT></P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=1>(high)</FONT></FONT></P>
</TD>
<TD WIDTH=63>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->HK
Level 0 </FONT></FONT>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->MOC
Dayfile Save and decode keywords data for asd dayfile and save
keywords to asd HK by APID series(sdo.lev0_asd_0004) </FONT></FONT>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->dsdf.pl
cronjob on production@j0.</FONT></FONT></P>
</TD>
<TD WIDTH=68>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><B>Email
message with this subject.</B></FONT></FONT></P>
<P> <FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><B>JSOC:
</B></FONT></FONT>
</P>
<P><BR>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><B>WARNING:
Ingesting MOC dayfiles: status:No files loaded today</B></FONT></FONT></P>
</TD>
<TD WIDTH=114>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">JSOC:
WARNING: Ingesting MOC dayfiles:</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">status:No
files loaded today</FONT></FONT></P>
<PRE STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Warning Message:</FONT></FONT>
<FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">-->Received count of <0> hkt files and count of <0> xml files from directory</FONT></FONT>
<FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"></tmp21/jsoc/sdo/mocprods/lzp>.</FONT></FONT>
<FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">-->When executing script </home/production/cvs/JSOC/proj/lev0/scripts/hk/dsdf.pl></FONT></FONT>
<FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">from cron job.</FONT></FONT></PRE><P STYLE="font-weight: medium">
<BR>
</P>
</TD>
<TD WIDTH=66>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Dayfile
were not retrieved by process that retrieves the Level 0 dayfiles
from MOC Product server. This should be done by 9PM PDT. Then
this process looks for dayfiles. If none are there, an email is
sent out to jsoc_ops.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">This
causes other processes to fail because they are looking for
dayfiles at 11PM.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
</TD>
<TD WIDTH=247>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(1)Confirm
the process that retrieves Dayfiles from MOC is working. Check
with Art or Hao.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(2-option
a)Once this is working the process will pick up dayfiles for lost
day(s) and the current day and save dayfiles at 10PM-PDT.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(2-option
b)If needed we can start save of dayfiles for lost day as soon as
we get files retrieved by process that gets files from MOC
Product Server.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->login
to j0 as production.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
cd /home/production/cvs/JSOC/proj/lev0/scripts/hk</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
dsdf.pl moc</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">-->View
log file to confirm saved dayfiles and decode asd dayfile.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
view log-df-moc</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><SPAN STYLE="font-weight: medium">(3)There
are processes that missed getting dayfiles and processing. These
needed-temporary-quickly-done processes run as cron jobs between
11-11:30PM PDT on <A HREF="mailto:production@n02">production@j0</A><A HREF="mailto:production@n02">.</A><A HREF="mailto:production@n02">
</A></SPAN></FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">By
checking log files(log-doAPID17, log-doAPID19, log-doAPID21,
log-doAPID38, log-doAPID40) can see if runs were successful.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(a)
Keyword Data for APID 19(For Sebastien and Jesper)</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->Got
to directory to update manually script.</FONT></FONT></P>
<P STYLE="font-weight: medium"> <FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
cd /home/production/cvs/JSOC/proj/lev0/scripts/hk</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->Change
start day and end day in script to day(s) did not have day files.
</FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">For
example change $i start value and 6 end value shown below:</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">#(1)hardcode
end day for month </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">#for
october 2008 use 1-31 days </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">$i=5;
</FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">while
($i < 6) </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">{
</FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">-->
Go into file and change: </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
vi getFilesFromDayfile_019v2.pl</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">-->Run</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
getFilesFromDayfile_019v2.pl</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">b)APID
17,21,38,40 are less critical since these series are used by
Master Pointing series to gather data. Since the master pointing
series does not change HK lookup times often, this should not
have a problem until we update the master pointer series. To do
these updates. Repeat steps about described in 3a. By vi editing
files and then running. Remember v2 version in name of file is
for hand editing and v3 version should not be touched(used for
cronjobs).</FONT></FONT></P>
</TD>
</TR>
<TR VALIGN=TOP>
<TD WIDTH=57>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">2</FONT></FONT></P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=1>(high)</FONT></FONT></P>
</TD>
<TD WIDTH=63>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->HK
Level 0 </FONT></FONT>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->Real
time Decode and save of keywords to asd series using RTMON
Dayfile </FONT></FONT>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->On
</FONT></FONT><A HREF="mailto:production@n02"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><SPAN STYLE="background: transparent">production@j0</SPAN></FONT></FONT></A><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><SPAN STYLE="background: transparent">
at /home/production/cvs/JSOC/proj/lev0/scripts/hk.</SPAN></FONT></FONT></P>
<P><BR>
</P>
<P> <FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
gdfrt.pl apid=129 pkt_size=128 >
LOG-RT-APID0x081-2010.05.11.09_10:00:00</FONT></FONT></P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
monitor_df_rtmon.pl apid=129 </FONT></FONT>
</P>
</TD>
<TD WIDTH=68>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><B>(1)
j0 server down or crashed email from admins</B></FONT></FONT></P>
<P><BR>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><B>(2)
</B></FONT></FONT>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><B>Email
with subject:</B></FONT></FONT></P>
<P><BR>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><B>JSOC:WARNING:INGESTING
REALTIME DAYFILE FOR APID 129:Dayfile does not exist</B></FONT></FONT></P>
</TD>
<TD WIDTH=114>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(1)j0
server down or crashed.</FONT></FONT></P>
<PRE STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><FONT FACE="Courier, monospace">(2)Email message in body :</FONT>Error Message:</FONT></FONT>
<FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">-->Dayfile </hmisdp-mon/log/packets/0x0081/20100204.0x0081> is not probably there.</FONT></FONT>
<FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">-->This monitor script will continue running and resend another email notice if the data file is there and data starts flowing and stops again.</FONT></FONT>
<FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">-->To restart monitor enter command: /home/production/cvs/JSOC/proj/lev0/scripts/hk/monitor_df_rtmon.pl apid=129</FONT></FONT>
<FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">-->To stop monitor run command(user=production):/home/production/cvs/JSOC/proj/lev0/scripts/hk/stop_monitor_df_rmon.pl apid=129</FONT></FONT></PRE>
</TD>
<TD WIDTH=66>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Possible
Problems: </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(1)J0
server goes down because of crash or runs out of memory. </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(2)Or
the j0 server loses nfs connection to /hmisdp-mon/log/packets
directory.</FONT></FONT></P>
</TD>
<TD WIDTH=247>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(1)Solution
is to restart gdfrt.pl process with new LOG file marked with
time restarted process. Restart monitor_df_rtmon.pl process. </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">a)Login
into j0 as production user on terminal window. Execute: </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
gdfrt.pl apid=129 pkt_size=128 >
LOG-RT-APID0x081-2010.05.11.09_10:00:00</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">This
process decodes minute of dayfile and saves keywords to
sdo.lev0_asd_0004 series.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">b)Log
on to j0 on another terminal window and execute: </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
monitor_df_rtmon.pl apid=129</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">This
script monitors if dayfile is getting updated every 5 minutes, if
not sends email warning.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">c)
View if passing when processing. Note the is one issue shown in
the log file as failed when processing more then 1 minute of data
at beginning of run. This is really ok.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
tail -f <LOG-RT-<whatever></FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">d)View
in LookData tool that data records are getting added to
sdo.lev0_asd_0004.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(2)Check
j0 can see /hmimon-sdp.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
</TD>
</TR>
<TR VALIGN=TOP>
<TD WIDTH=57>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">3</FONT></FONT></P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=1>(low)</FONT></FONT></P>
</TD>
<TD WIDTH=63>
<P><BR>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->HK
Level 0 </FONT></FONT>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->RTMON
Dayfile Save of only ASD Dayfile</FONT></FONT></P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">->dsdf.pl
cronjob on production@j0.</FONT></FONT></P>
<P><BR>
</P>
<P><BR>
</P>
<P><BR>
</P>
<P><BR>
</P>
</TD>
<TD WIDTH=68>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><B>Email
message with this subject.</B></FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt"><B>JSOC:WARNING:Ingesting
RTMON dayfiles: status:Possible error ingesting dayfile.</B></FONT></FONT></P>
</TD>
<TD WIDTH=114>
<PRE STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Warning Message:</FONT></FONT>
<FONT SIZE=2 STYLE="font-size: 9pt">-->Received count of <1> hkt files and count of <1> xml files from directory </hmisdp-mon/log/packets>.</FONT>
<FONT SIZE=2 STYLE="font-size: 9pt">-->When executing script </home/production/cvs/JSOC/proj/lev0/scripts/hk/dsdf.pl> from cron job.</FONT>
<FONT SIZE=2 STYLE="font-size: 9pt">-->Check if there is problem. The dayfiles to ingest into data series and delete from directory did not match the count of the dayfiles received.</FONT>
<FONT SIZE=2 STYLE="font-size: 9pt">-->Possibly a problem ingesting dayfiles in series because of bad setting of SUMSERVER parameter or SUMS could be not available.</FONT>
<FONT SIZE=2 STYLE="font-size: 9pt">-->Possibly not an issue which was caused by the dayfiles not being ingested on previous day(s) therefore the file count received today does not match files ingested.</FONT></PRE><P STYLE="font-weight: medium">
<BR>
</P>
</TD>
<TD WIDTH=66>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">The
RT Dayfile was not saved to dayfile series.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Possible
problems:</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(1)SUMS
down.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(2)Path
setup to pickup or drop off dayfile was not correct.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(3)No
dayfile on /hmi-sdp server.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(4)J0
has no access to hmi-sdp server.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
</TD>
<TD WIDTH=247>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(1)Verify
issue:</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Check
if RT dayfile in sdo.hk_dayfile series where date is day of
problem and source=rtmon. Check log file at log-df-rtmon for
information on warning.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">Check
for dayfile at drop directory defined in dsdf.pl and pickup
directory in ingest_dayfile.pl</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(2)Manual
save RT dayfile that failed last night. Execute the manual
command to save asd rtmon dayfile to sdo.hk_dayfile.</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">ssh
or login to j0 as production user. Since we are save only asd
files(apid in hex use 81) use command with apid=81. Set merged
value to 0 which mean save dayfile only. Utilize src=rtmon
because file is in rt filename format. The dsnlist is a map to
tell script were save dayfile.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">a)Save
dayfile:</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
cd /home/production/cvs/JSOC/proj/lev0/scripts/hk</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
ingest_dayfile.pl apid=81 dsnlist=./df_apid_ds_list_for_rtmon
src=rtmon merged=0</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">b)Verify
files save by checking LookData tool with sdo.hk_dayfile.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">c)Clean
files:</FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
cd /tmp21/production/lev0/hk_rtmon_dayfile </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
rm <files saved></FONT></FONT></P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">%
vi DF_DELETE_FILE_LIST_RTMON </FONT></FONT>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(Remove
files saved already)</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><FONT FACE="Courier, monospace"><FONT SIZE=2 STYLE="font-size: 9pt">(3)Fix
issue, if needed to, described in list issues in Problem
Description column. Verify tomorrow no warning email is send.
Verify log has no errors.</FONT></FONT></P>
<P STYLE="font-weight: medium"><BR>
</P>
<P STYLE="font-weight: medium"><BR>
</P>
</TD>
</TR>
<TR VALIGN=TOP>
<TD WIDTH=57>
<P><BR>
</P>
</TD>
<TD WIDTH=63>
<P><BR>
</P>
</TD>
<TD WIDTH=68>
<P><BR>
</P>
</TD>
<TD WIDTH=114>
<P><BR>
</P>
</TD>
<TD WIDTH=66>
<P><BR>
</P>
</TD>
<TD WIDTH=247>
<P><BR>
</P>
</TD>
</TR>
</TBODY>
</TABLE>
<P STYLE="margin-bottom: 0in"><BR>
</P>
</BODY>
</HTML>
| Karen Tian |
Powered by ViewCVS 0.9.4 |