LookData

This is a tool developed by the JSOC team for internet data searching and data queuing.

You can access it at: http://jsoc.stanford.edu/ajax/lookdata.html

The tool has numbered sections. The document below corresponds to those sections.

1. "Find the Dataseries"

All JSOC data is stored in a database system ("DRMS") that references a large filing system ("SUMS"). All the data is stored by "namespace" (e.g. 'sid', 'hmi', 'hmi_ground', 'aia', etc). It is further broken down and stored in series. Each series represents a set of data, typically a table in the database. If you know the namespace and series for your data, you can enter it in the blank. The default is "NOT ^dsds\.", because the namespace 'dsds' contains over 13,000 series, and is mostly old MDI data ported over from our Oracle system.

The form blank searches any series names as a wildcard with whatever you enter. If you were to enter 'sid', it would get all tables in namespaces such as su_sid, sid_awe, or sid, if such namespaces existed, and it would find any series that had "sid" in the name, such as su_jennifer.sidtest2 or su_deborah.sid.

While the search for series is happening, the lookdata page will tell you that it is "processing", and offer you an "abort" button if you wish to stop the search. When the search is done, lookdata will tell you how many series matched your search, below the search text box.

2. "Pick the Series to Use"

Once the search from step one has concluded, you'll see that a box to the right has been populated with series names, in the form of namespace.dataseries (e.g. su_jennifer.sidtest2). Search that box using the scrollbar if necessary to find the dataseries you want. If it's not there, retry your search in step one above. The "pick" tool here will only allow you to choose one series at a time. When you select one of the series in the box, the boxes in the next steps are populated. While the tool is fetching information about your chosen series, you will see a message from the system in the upper right hand corner telling you that it is processing your request.

When your series request is finished processing, you will see below the horizontal line "Information about selected series". The information includes such things as prime keys for the series, number of records, how long the files are retained on disk, and any series descriptive notes.

3. "Select Records and Get Record Count"

4. "Select Keywords"

5. "Select Segments"

6. "Get Keyword and Segment Values Here"

7. "Request Export of Desired Data and Get Status of Prior Requests"

JsocWiki: LookData (last edited 2013-05-01 04:35:22 by localhost)