Differences between revisions 12 and 19 (spanning 7 versions)
Revision 12 as of 2012-04-19 06:33:08
Size: 5923
Editor: glimmer
Comment: status report April 12-18th,2012.
Revision 19 as of 2012-04-26 15:17:18
Size: 4405
Editor: c-174-62-75-186
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
4/18/2012:   __April 25th, 2011 :Status update:
__

  1>jsoc.ColorTables is created and populated . Art's idea was to have two drms tables: a stand alone colortable with just ct name and format ie .sao or .lut and another tables mapping which hmi series goes with which table and what are the default min/max/scaling values. But as of now, Phil populates the pull down menu from the existing su_priya.ColorTables and that works . So, for now the plan is to not worry about the new colortable, but to edit jsoc_export as movie to not have any of the parameters hard coded but to accept min/max/scaling variables on the command line; if not supplied then to use show_info to determine the defaults and use them.

2>exportdataPD.html has scaling and size pull down menus put in..but I have not succeeded in populating them from the su_priya.ColorTables series.

3>Data products webpage: spent a lot of time making the left navbar with a rollover effect..but decided that it looked very crowded and confusing. spent some time trying to decide how to display the "Visual Data Products" page which needs to give equal status to all the missions ..its a lot of products! Played around with the idea of a carousel ..but finally decided on something simpler . The layout is a tablewith the five missions and then each product type will have its own slide show that will be activated when you roll over the mouse.As of now ONLY the HMI Observables slide how works . If this type of visual is ok with Phil; I'll go ahead.

4>Paper: Got the script for generating the figures using Linecore proxies(using I3 and I4 filtergrams values)working and the plots look right. Need to make 4 sets for the four flares and spend some time making them look pretty. Edited a big chunk based on revised plan. More edits due.would like to be done with it by end of next week.

To do in week of Apr19-25

 1. Make sure all the color Tables including mag is in the DRMS. Figure out if WVL is enough as a prime key? Or do we need to add a "string" as a prime key. make it work with jsocexport manage as a variable.
 1. The link now opens in a new tab..but doesnt close the tab when the focus changes. and a new link is clicked ,need to figure that one out.
 1. Ask Art what he wants for the tables- put in the javascript required to make the scaling/min/max as variables. Make sure you put an alert to pop up when the user chooses a different scaling.
 1. make the figures for the paper. Put in text to explain the reasons for using and focusing on filtergrams.
 1. The Dataproducts webpage: Phil wants a more instrument to go on there.see ~/priya/JSOC_webpages_design.pdf for the flowchart
some other ideas: maybe the ? on the lookdata/exportdata page should be an i symbol or a flashbulb? 4/18/2012:__
__

__April 18 Status update:__
Line 4: Line 25:
 1> '''The JSOC Data products web page:''' [http://jsoc.stanford.edu/Priya/HMI/ http://jsoc.stanford.edu/Priya/HMI/ ]
  *  Have updated most of the child links with info that people sent me.
  * figured out wher to put in the javascript so the difference between jsoc and jsoc2 is maintained. Turns out ..it need to go into a window.OnLoad function no bodyOnload .
 '''1>''' '''The JSOC Data products web page:''' [http://jsoc.stanford.edu/Priya/HMI/ http://jsoc.stanford.edu/Priya/HMI/ ]
  * Have updated most of the child links with info that people sent me.
  * figured out where to put in the javascript so the difference between jsoc and jsoc2 is maintained. Turns out ..it need to go into a window.OnLoad function no bodyOnload .
Line 10: Line 31:
''' 2> Flares paper '''
  * Have determined what all needs to be rewritten- but just starting on it today.
  * Emailed Hugh that I will get back to the paper.
  3> '''Making the Colortables/scale a variable that can be used during exporting data as jpgs/mpgs.'''
''' 2> Flares paper '''
Line 15: Line 33:
  * Have not done much about it yet  * Have determined what all needs to be rewritten- but just starting on it today.
 * Emailed Hugh that I will get back to the paper.
''' '''
Line 17: Line 37:











    3/11/11

 . Worked with Art and Phil to get the hg_patch /AIA to work as export as movie and images. Finally everything seems to be working.Phil wants have the option in hg_patch to "not track" so the AIA people can monitor (take a patch of) a limb phenomenon. ALso we need to put in option to export FITS/ movie and Image in one request. Also the colortables need to
go into a JSOC series??

 . Need to come up with a series of tall the M and C class flares from the past month.
2/16/11

 . Phil pointed out that the hg_patch part of jsoc_export_as_movie/image is not yet working. Tracked down how to make legit hg_patches from JSOC_drms runlogs.hg_patch was not working because of a bug in show_info. Also needed a special case for hg_patch as it should not be scaled andone needed to to go into the @hg_patch.log files to figure out what kind of data it was-M, Icor V etc. Turns out Ic and Ic_flat are also different and need to be treated differently. Pit in log and sqrt scaling in render_image.The cropping at the limb was not happening correctly: turned out that we need to "not invert" the
image forhg_crop (ie. we wanted as-is) and there was a bug in the way crrot was being calculated.

2/14/11 Wrote a script to extract M and C class data from the ftp link Taeil sent. Can extract all the relevant data and run drms_compare on them and store as a series. Came up with 3/4 color tables as per Todds specs using Xpallete in IDL

1/26/11 got started with Solar flares stuff. Need to get a list of known h-alpha and xray flare dates above a certain threshold and see if i can detect anything in the level1.5 files(Ic,Lw,Ld) and calculate Li(Line Intensity) which is Ic-Ld? use ricks drms_compare module.

1/24/10 The aia_make_images module works fine. It chooses the correct color table based on the record: and makes multiple colortable-images for a series with multiple wavelengths. Need to figure out how to put in log scaling in render_image. Also we need a faciltiy to be able to export images/fits and movie ALL at one go. Spent some time just brushing up on C.

1/10/10

Converted all the AIA color tables to .lut. Familiarized myself with the AIA data. We will need lev1 and lev1_hg_patch and lev 1.5 data to be made into movies.

1/4/10

 . 1> Art suggested he would make the edits to the jsoc_export_manage
 . 2> found the colortables for AIA images
 . 3> For the Flares Project: turns out that getting the list of flares may be a bit elaborate: grepping and awking though lists at NOAA. Spent a lot of time trying to find a site with location and flare categories.
 .
12/15/10

1> Bash script is done and works 2> script interacts ok with the qsub call ie works fine on the cluster. The exportdataPD.html and exportdataPD2.html pages includ ethe drop down menu (in js)to include image and movie. 3> met with Phil: 3 new issues:

 * AIA images/movies also need to be made from from the jsioc page. They have specific requirements for their colors.
 * jsoc_export_manage need to be reorganized so that calls are not replicated in the (as of now) 2 possible calles :1) to jsoc_export_as_is:
  . 2) to jsoc_export_as_fits but all possiblre common pre-processing is done.
 * Phil would like the option of choosing the scaling/colortable/size for the images/movie
 * edited the Camilla_sdo card to put on sdo facebook page
##master-page:HomepageTemplate
#format wik

== Priya Desai ==
Email: [[MailTo( priya@sun.stanford.edu ]

11/16/10

1> Met with Art to discuss integrating the image and movie option in the JSOC_export page.The image option will be a bash script~module) with the name "jsoc_export_as_image" to maintain consistency. At least initially all default values such as scaling/colortables etc should be provided within the module (not given as options to the user).

 * Use the colortables from the DRMS series.
 * Have 5 possible types of files: hmi.M_ (magentogram), hmi.V_ (Dopplergram), hmi.Ic_ (Continuum), hmi.Ld_(Line Depth), hmi.Lw_(Line width)
2> As a next step, need to insert *ALL* IDL colortables into the DRMS series for colortables that has been created.

3> Met with Todd to talk about creating a better colortable for the Public Images -something that will show the structure in the penumbra. and has a pale yellow background.
 . '''3> ''''''Making the Colortables/scale a variable that can be used during exporting data as jpgs/mpgs.''' * Have not done much about it yet.
Line 81: Line 39:
 . CategoryHomepage  . CategoryCategory
  • April 25th, 2011 :Status update:

  • 1>jsoc.ColorTables is created and populated . Art's idea was to have two drms tables: a stand alone colortable with just ct name and format ie .sao or .lut and another tables mapping which hmi series goes with which table and what are the default min/max/scaling values. But as of now, Phil populates the pull down menu from the existing su_priya.ColorTables and that works . So, for now the plan is to not worry about the new colortable, but to edit jsoc_export as movie to not have any of the parameters hard coded but to accept min/max/scaling variables on the command line; if not supplied then to use show_info to determine the defaults and use them.

2>exportdataPD.html has scaling and size pull down menus put in..but I have not succeeded in populating them from the su_priya.ColorTables series.

3>Data products webpage: spent a lot of time making the left navbar with a rollover effect..but decided that it looked very crowded and confusing. spent some time trying to decide how to display the "Visual Data Products" page which needs to give equal status to all the missions ..its a lot of products! Played around with the idea of a carousel ..but finally decided on something simpler . The layout is a tablewith the five missions and then each product type will have its own slide show that will be activated when you roll over the mouse.As of now ONLY the HMI Observables slide how works . If this type of visual is ok with Phil; I'll go ahead.

4>Paper: Got the script for generating the figures using Linecore proxies(using I3 and I4 filtergrams values)working and the plots look right. Need to make 4 sets for the four flares and spend some time making them look pretty. Edited a big chunk based on revised plan. More edits due.would like to be done with it by end of next week.

To do in week of Apr19-25

  1. Make sure all the color Tables including mag is in the DRMS. Figure out if WVL is enough as a prime key? Or do we need to add a "string" as a prime key. make it work with jsocexport manage as a variable.
  2. The link now opens in a new tab..but doesnt close the tab when the focus changes. and a new link is clicked ,need to figure that one out.
  3. Ask Art what he wants for the tables- put in the javascript required to make the scaling/min/max as variables. Make sure you put an alert to pop up when the user chooses a different scaling.
  4. make the figures for the paper. Put in text to explain the reasons for using and focusing on filtergrams.
  5. The Dataproducts webpage: Phil wants a more instrument to go on there.see ~/priya/JSOC_webpages_design.pdf for the flowchart

some other ideas: maybe the ? on the lookdata/exportdata page should be an i symbol or a flashbulb? 4/18/2012:

April 18 Status update:

  • This past week was the performance review. Goal is to increase efficiency and productivity by taking on fewer well defined tasks and pushing towards completing them. Will with Art to improve programming skills in C and understanding of DRMS and Export System. Am working on 3 main projects+ any exportdata bugs that Art may send my way.

    1> The JSOC Data products web page: [http://jsoc.stanford.edu/Priya/HMI/ http://jsoc.stanford.edu/Priya/HMI/ ]

    • Have updated most of the child links with info that people sent me.
    • figured out where to put in the javascript so the difference between jsoc and jsoc2 is maintained. Turns out ..it need to go into a window.OnLoad function no bodyOnload .

    • put in javascript to make the pages elastic-ie font/images change size based on client browser width.
    • Resized header so it does not wrap around and come to the next level. all fonts/margins etc are now in "em" so that makes it scalable . Again order of functions in the main js calling function seems important. check in with Phil.
    • The link now opens in a new tab..but doesnt close the tab when the focus changes. and a new link is clicked ,need to figure that one out.

2> Flares paper

  • Have determined what all needs to be rewritten- but just starting on it today.
  • Emailed Hugh that I will get back to the paper.

  • 3> Making the Colortables/scale a variable that can be used during exporting data as jpgs/mpgs. * Have not done much about it yet.


JsocWiki: PriyaDesai (last edited 2013-05-01 04:35:23 by localhost)