Work out what streams new variables "tas", "pr", "ua" and "zg" are in

[NParsonsMO]

[NParsonsMO]

pr and ua are for MJO recipes.

Solved issues left as record

The MJO recipe needs day/ua and day/pr.

I tried stream apd on the basis that "month" had been swapped for "day", but the standardise data task told me this wasn't a thing [I thought it was a thing].

CDDS's stream_mappings told me they were in ap6, and this does find them for u-az513 and u-bv526 (I think these were the CMIP runs), but it doesn't work for u-cw673. In this (non-CMIP) run, they could be successfully extracted from stream apa.

We don't have any infrastructure for pulling the same variable from different streams in different runs, and given that we want to take arbitrary runs in CMEW, this would seem very difficult to implement.

Additionally, although CDDS could extract the variables, it couldn't convert them, failing in task mip_convert_apa_atmos-uvgrid with the following snippet from the logs:

Launching subprocess
============ MIP_CONVERT OUTPUT ============
Using MIP Convert version 3.3.3
*** Starting conversions ***
Loading data for "GCModelDev_day.json: ua"
Unable to produce MIP requested variable "ua" for "GCModelDev_day": Problem with 'cmor.axis'. Please check the logfile (if defined).
Unable to produce MIP requested variable "ua" for "GCModelDev_day": Problem with 'cmor.axis'. Please check the logfile (if defined).
Problem with 'cmor.axis'. Please check the logfile (if defined).
Traceback (most recent call last):
  File "[CDDS conda env]/cdds-3.3.3/lib/python3.10/site-packages/mip_convert/request.py", line 125, in convert
    produce_mip_requested_variable(variable_name, stream_id, substream, mip_table, user_config,
 ...
  File "[CDDS conda env]/cdds-3.3.3/lib/python3.10/site-packages/cmor/pywrapper.py", line 558, in axis
    return _cmor.axis(table_entry, units, l, coord_vals,
_cmor.CMORError: Problem with 'cmor.axis'. Please check the logfile (if defined).
Critical Errors found in all variables, therefore MIP convert has failed.
*** Finished conversions ***

day/pr is in stream

• apa in not-for-CMIP run u-cw673
• ap6 in the for-CMIP runs u-az513 and u-bv526

day/ua is in stream

• ape in not-for-CMIP run u-cw673
• ap6 in the for-CMIP runs u-az513 and u-bv526

The difference in streams between different model runs will be fixed by implementing

• Make streams configurable at dataset level #510

[NParsonsMO]

day/zg is needed for recipe_miles_block.yml.

I did find it in the for-CMIP runs u-az513 and u-bv526, but am having trouble running the recipe (possibly to do with the 360_day calendar) with these runs.

I haven't yet found it in the not-for-CMIP run u-cw673.