320 likes | 329 Views
This document outlines the various options for re-broadcasting GOES-R data, considering the needs of different users and applications. It also discusses the distribution and dissemination approach, terminology, and guiding principles.
E N D
What could/should GOES-R re-broadcast?GOES Users Working sub-group: GRB Content First meeting: June 19, 2003
Logistics 6 week deadline (July 31, 2003) Outline the various options for GOES-R data re-broadcast Weekly tele-cons (Thursday’s at 10am -- Eastern) 877-960-2882 PARTICIPANT PASSCODE: 153180 Need for something like NetMeeting? If we just use ppt, please put slide numbers on them (view/header and footer/click on slide #). “Not here to solve the problem, but to bound it as tight as possible”
Team Members Initial team: Jim Gurka, Tim Schmit, John Pereira, Roger Heymann, Tom Renkevens, Dick Reynolds, Steve Short, Bill Brockman, Ken Carey, Monica Coakley
Large (processed) data volumes HES-IR ~65mbs-1 • HES - Disk Sounding • (HES-DS) • HES - Severe Weather / Mesoscale • (HES-SW/M) • HES - Coastal Waters • (HES-CW) • ~ 5 mbs -1 • ABI – Advanced Baseline Imager • ~22 mbs -1 Total ~ 92 mbs -1
What data/products should be re-broadcast? GRB may be limited (for a variety of reasons) to ~10-24 mb/s. Current GOES (imager and sounder) GVAR is 2.1 mb/s.
Issues to Resolve • GOES-R data and products distribution and dissemination approach -- considering • Operations, research, international and general users • Timeframe of 10 to 20+ years from now
Terminology • Distribution – within the government system, to known specific users (e.g., NCEP, WFOs, DoD, etc) • Dissemination – external to the government, to user communities – generally broadcast arrangements (e.g., GVAR, NOAA Weather Radio, EMWIN, Internet) • GVAR – Format of current GOES re-broadcast data (2.1mb/s) • GVAR-like – Sending out approx. 2.1 mb/s of GOES-R data • GRB – GOES-R Re-broadcast • Level 1b – Calibrated, navigated radiances
Assumptions • User needs • All users and applications not known • Forecasting all future users and applications uncertain • Future communications capabilities will continue to evolve – bringing improved capability and lower cost • Future data compression techniques will continue to improve (both lossless and lossy) • Things change.
Guiding Principles • Free and open access to all data – with full resolution data available and archived 2 NOAA does not compete with commercial service providers where available • Continuation ofat least the current level of broadcast dissemination required • NOAA has limited authority to subsidize cost of distribution of data to non-federal U.S. or other prospective users (except for dissemination of severe weather forecasts and warnings) • Solutions for data distributed to federal users should be based simply on technical, cost, cost-sharing and operational considerations • Having more users reducing the cost per user! • NOAA must ensure continuity of operations.
User Categories • Prospective Users for real-time, continuous, near full resolution data stream (i.e., radiances) • U.S. Gov’t modeling centers (~3-5) • NWS (for their region of interest) • U.S. research centers (~6-10) • Few international centers (ECMWF, UKMet, etc) • Very large number of general users from media, general forecasting, aviation forecasting, science education, international, others… • Other environmental science data users (e.g., earth, oceans, climate) • Users of derived products (SST, Winds, retrievals, clouds, etc.
Operational Users • NCEP and other national centers are the primary user for high resolution data • Other prospective users of full data stream • Fleet Numerical Center and Air Force Global Weather Center – similarity of operation & backup • Possible need for real-time high resolution data at other NCEP centers (e.g., SPC, TPC) • VAAC, etc. • Other government cooperating centers • International users
Research Users • Real-time research institutions have opportunity to use – selectively – the full data stream • Probably less than a dozen U.S. research institutions interested in full data stream in real-time • More interested on data on a more limited basis (certain events, etc) • Archiving and Access demand growing dramatically, with retention of all data likely necessary
Proposed Approach • Rebroadcast future GRB data stream tailored to general “mid-range” users – and consistent with users’ technical infrastructure (i.e., antenna, receiver) • Current GVAR level proven very useful – for today’s users • Current GVAR technology base likely to grow over next decade – need to be sensitive to user impacts • Tailor data stream to maximize utility not volume • Optimize between GRB and LRIT • Make full data stream and/or selective channels available thru service provider(s) for others
Service Providers • Service provider approach offers maximum flexibility for evolving needs • Approach needs to be developed – building understanding and acceptance ASAP • Options might include • Providers offering “cafeteria style” (push and/or pull) • Specialized providers (e.g., for academia, international) • Selective role(s) for NOAA • Evolution for future technologies and practices
Can both radiances (level 1b -- calibrated and navigated) and products (level 2) fit in the re-broadcast? If not, which is a higher priority? How much ABI data should be re-broadcast? • Might some levels of data compression be considered? If so, both imager and sounder? CW? What type of compression ratios? Do we have time to compress data (latency)? • How much, if any, HES-IR needs to be re-broadcast? To whom? • How much, if any, HES-CW needs to be re-broadcast? If none, how would HI get data? • How many GVAR receivers are there today? Can we merge the lists Roger and Steve? Are these consistent of those from Dane Clark and crew?
6) Are there Southern Hemisphere, DoD, European, Asian data needs? Whatother users are best served with a direct broadcast? 7) Do National Centers need redundant systems? (ie, satellite primary,land secondary) 8) Is it reasonable to assume one spot can serve and archive all the data (without a re-broadcast)? 9) Do there need to be two sites? 10) What might be the costs (in 10 years) associated with land lines?
11) What is the right range for re-broadcast data amounts? 10, 16, 24mbs-1? 12) In 10 years, will DoD ships need direct GVAR data? 13) Do we need to look at a GOES-R re-broadcast versus a commercial satellite? (Isn’t this an architecture issue?) 14) Aren’t there international agreements for data re-broadcast? 15) Who else is working this issue, that should be on this committee? 16) Does a satellite re-broadcast offer additional reliability? (due to then data available both via land and satellite). 17) Other questions?
Assumptions: • All level 1b data will be archived. Can get back to “raw” counts. • All level 1b data will be served. • Processed ABI data is 22 mbs-1. • Processed HES-IR is 65 mbs-1. • Processed HES-CW is 5 mbs-1. • The "knee" is at 16 mbs-1 for re-broadcast data • We want the information to flow, not just the data.
1a) Re-broadcast approx 2mbs-1. Partial ABI only "GVAR-like" • spectral sub-set (only current imager bands?) • temporal sub-set • - spatial sub-set • - invoke lossy data compression (CR=~10) • - combination of above • 1b) Re-broadcast approx 4mbs-1. Partial ABI only "GVAR+-like" • spectral sub-set (only current imager bands?) • - temporal sub-set • - spatial sub-set • - invoke lossy data compression (CR=~5) • - combination of above
2a) Re-broadcast as in "1a", plus 14 mbs-1 of other data “2+14" Other data: ABI only (lossless compression) Other data: select ABI plus compressed HES-IR Other data: select ABI plus compressed HES-IR plus compressed HES-CW Other data: select ABI plus lossless compressed HES-CW 2b) Re-broadcast as in "1a", plus 12 mbs-1 of other data "4+12" Other data: ABI only (lossless compression) Other data: select ABI plus compressed HES-IR Other data: select ABI plus compressed HES-IR plus compressed HES-CW Other data: select ABI plus lossless compressed HES-CW 2c) Re-broadcast more than 16 mbs-1, say 20 mbs-1 "20“ For example: ABI 8mbs-1 + HES 10 mbs-1 + HES-CW 2mb-1 2d) Re-broadcast more than 16 mbs-1, say 24 mbs-1 "24"
3) Re-broadcast non-radiance products from the ABI, HES-IR and HES-CW "Products only" Note: the process of radiances to products is non-unique Note: the generation of various products can vary in time
There is a group looking at data compression methods and impacts of high spectral resolution data. For more information (soon) check out: http://www.osd.noaa.gov/goes_R/index.htm
Some uses of the current GOES Sounder NWP (Numerical Weather Prediction): Clear-sky radiances (Global, Eta) Precipitable water layers (CRAS, RUC, Eta) Cloud-top information (CRAS, RUC) Winds (NOGAPS) Nowcasting/short-term forecasting: TPW Skin Temperature Lifted Index CAPE Total Ozone Radiance Images Cloud Height Effective Cloud Amount The range of uses will dramatically increase with the improved spatial, spectral and temporal coverage of the HES-IR.
• • Over 120 know GVAR sites