tag:blogger.com,1999:blog-5822805028291837738.post550415504262664881..comments2021-10-21T03:28:19.615-04:00Comments on Various Consequences: Predictions and Entropy in EnsemblesJoshua Stultshttp://www.blogger.com/profile/03506970399027046387noreply@blogger.comBlogger32125tag:blogger.com,1999:blog-5822805028291837738.post-48398764339478323552010-11-12T12:28:01.481-05:002010-11-12T12:28:01.481-05:00Way up in the third comment I said: I think it wou...Way up in the <a href="http://j-stults.blogspot.com/2010/02/predictions-and-entropy-in-ensembles.html?showComment=1265657993518#c2286142440864893762" rel="nofollow">third comment</a> I said: <i>I think it would be a little tough to argue that you would get physically meaningful statistics from a solution that wasn't at least approximately (even if only crudely) time-accurate. </i><br /><br /><a href="http://www.pnas.org/content/99/suppl.1/2487.full" rel="nofollow">Leonard Smith agrees</a>: <i>Given the nonlinearities involved, it is not clear whether a model that cannot produce reasonable “weather” can produce reasonable climate statistics of the kind needed for policy making, much less whether it can mimic climate change realistically. </i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-88421343745954446062010-10-28T17:28:33.357-04:002010-10-28T17:28:33.357-04:00I was looking up this oldie, but goodie for a youn...I was looking up this oldie, but goodie for a young practitioner and found this interesting tidbit about grid convergence in the presence of sub-grid parameterizations:<br /><i>For these reasons, gridding guidelines will be based on physical and nu- merical arguments, rather than on demonstrations of convergence to a _right" answer. Grid convergence in LES is more subtle, or confusing, than grid convergence in DNS or RANS because in LES the variables are filtered quanti- ties, and therefore the Partial Differential Equation itself depends on the grid spacing. The order of accuracy depends on the quantity (order of derivative, inclusion of sub-grid-scale contribution), even without walls, and the situa- tion with walls is murky except of course in the DNS limit. We do aim at grid convergence for Reynolds-averaged quantities and spectra, but the sensitivity to initial conditions is much too strong to expect grid convergence of instantaneous fields (except for short times with closely defined initial conditions). In DES, we are not in a position to predict an order of accuracy when walls are involved; we cannot even produce the filtered equation that is being approximated. We can only offer the obvious statement that the full flow field is filtered, with a length scale proportional to A, which is the DES measure of grid spacing". This probably applies to any LES with wall modeling. Nevertheless, grid refinement is an essential tool to explore the soundness of this or any numerical approach.</i><br /><a href="http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20010080473_2001126451.pdf" rel="nofollow">Young Person's Guide to Detached-Eddy Simulation Grids</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-87483348480084498052010-10-15T06:52:47.955-04:002010-10-15T06:52:47.955-04:00Tom said: Such statements are just a propaganda wi...Tom said: <i>Such statements are just a propaganda with the intent to convey to ignorant people the idea that the models cannot be wrong beacuse what they do are rigorous mathematics (e.g "equation solving") and no sane person would dare to challenge a mathematical truth .</i><br /><br />In fact it's pretty good propaganda, because, coming from CFD, I assumed that they were actually solving NS until I actually took a look at the documentation for NCAR's community model and searched in vain for grid convergence studies. There are significant analytical simplifications that happen before discretization, and, as you point out, no one bothers finding a grid converged <i>solution</i> to the chosen equation set anyway.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-90912889321001013362010-10-15T04:49:16.823-04:002010-10-15T04:49:16.823-04:00Climate models, at their heart, solve equations de...<i>Climate models, at their heart, solve equations derived from physical laws, for example, the nonlinear Navier–Stokes equations of fluid flow. </i><br /><br />No they don't . It is flabbergasting how somebody can make such an obviously wrong statement .<br />They cannot do that because the resolution (100 km) simply doesn't allow to solve any equation at all if it is not rigorously linear .<br />Such statements are just a propaganda with the intent to convey to ignorant people the idea that the models cannot be wrong beacuse what they do are rigorous mathematics (e.g "equation solving") and no sane person would dare to challenge a mathematical truth .<br /><br />In fact this kind of statements generally means that "the dynamical core of climate models is <b>inspired</b> by results/insights obtained by studies of Navier-Stokes" .<br />For example in a 2D flow model one could be tempted to include in some discretized form the vorticity conservation even at with a grid of 100 km where the vorticity is a grossly estimated approximation .<br />But it should be obvious for everybody that these things have absolutely nothing in common with actually <b>solving</b> the equations !<br /><br />Not that we know that there are unique regular solutions of Navier Stokes anyway (tongue in the cheek :))TomVonknoreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-53455913355937990182010-10-01T10:51:43.129-04:002010-10-01T10:51:43.129-04:00Model imperfections, coupled with fundamental limi...<i>Model imperfections, coupled with fundamental limitations on the initial-value prediction of chaotic weather and the unknown path that society may take in terms of future emissions of greenhouse gases, imply that it is not possible to be certain about future climate.<br />[...]<br />Ensembles, in which different initial conditions are sampled (recognizing the sensitive dependence on initial conditions in atmospheric flows), are now routinely produced and used in risk-based assessment of weather impacts. More recently, model uncertainties are also sampled. Hence, the extension to the climate problem is a natural one. Nevertheless, the key distinction is that for the weather forecasting problem, the ensemble prediction system may be verified over many cycles and may be corrected and improved. For the climate change prediction, no such verification is possible— a problem that has caused much debate about the best way to make predictions.<br />[...]<br />Climate models, at their heart, solve equations derived from physical laws, for example, the nonlinear Navier–Stokes equations of fluid flow. This is in contrast with some predictive models that may be purely based on the fitting of (perhaps complex) functions to data. Empirical approaches are not valid for climate change prediction as such models could not be reliably used to make extrapolations outside the historical training period (some authors even level this criticism at physically based models). Owing to finite computing capacity, approximations must be made to the equations and because they must be solved using computational techniques, certain processes must be simplified or parameterized for reasons of practicality (and <b>here an element of empiricism can creep in</b>).</i><br /><a href="http://rsta.royalsocietypublishing.org/content/365/1857/1957.abstract" rel="nofollow">Ensembles and probabilities: a new era in the prediction of climate change</a><br /><br />Such understatement, the holistic tuning of all of the <i>kludged</i> together empricisims and sub-grid parameterizations is the only thing that makes the model give reasonable looking climates. It's not unreasonable to be skeptical of the predictive capabilities of such a mess.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-43400742523236253522010-09-27T15:32:48.306-04:002010-09-27T15:32:48.306-04:00I may have been looking for something that doesn&#...I may have been looking for something that doesn't exist:<br /><i>Climate models are not verified or validated but updated and modified as new information becomes available.</i><br /><a href="http://wires.wiley.com/WileyCDA/WiresArticle/wisId-WCC60.html" rel="nofollow">Constructing Climate Knowledge with Computer Models</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-19441249869458719622010-09-27T10:36:58.972-04:002010-09-27T10:36:58.972-04:00Interesting comment that touches on the behavior o...<a href="http://judithcurry.com/2010/09/22/the-uncertainty-monster/#comment-1829" rel="nofollow">Interesting comment</a> that touches on the behavior of functionals of chaotic system state.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-44407849075838943102010-09-25T10:32:58.099-04:002010-09-25T10:32:58.099-04:00Survey results indicate climate scientists see cli...<a href="http://j-stults.blogspot.com/2010/02/predictions-and-entropy-in-ensembles.html#update" rel="nofollow">Survey results</a> indicate climate scientists see climate prediction more as an IVP than a BVP.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-69407190071963625042010-08-09T10:14:59.799-04:002010-08-09T10:14:59.799-04:00Adendum :
I almost forgot the most important . Ye...Adendum :<br /><br />I almost forgot the most important . Yes a study of Hamiltonian systems is one of the most important things . It is a basis of about everything in physics - mechanics , statistical thermodynamics , quantum mechanics and it plays a role even in the chaos theory (not "Schaos") .<br />Not knowing well Hamiltonian systems in physics is equivalent to not knowing well the alphabet in reading .Tom Vonknoreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-51828273268531178892010-08-09T10:08:51.512-04:002010-08-09T10:08:51.512-04:00Gmcrews
Sorry but I can't speculate about tha...Gmcrews<br /><br />Sorry but I can't speculate about that . I think that it can have something in common with the fact that the nature is often isotropic and homogeneous . It strikes me in the Kolmogorov turbulence theory . But really I have either too many or no clues . Both cases are not good .<br /><br />Schaos is a word that I have made up for the purpose of this post . So actually there are only those people having read this post who know it :)<br /><br />You must continue googling LDS . Try also coupled map lattices . Try Afraimovich and Bunimovich . There is not much because it is very hard and few people work on it . "Schaos theory" doesn't exist yet . So with these exceptions there is really nothing that permits to get a grip on "Schaos" .<br /><br />Yes Hamiltonian systems are not dissipative .<br />This doesn't prevent them to be chaotic (e.g exponential divergence of trajectories) . The N body system is chaotic . The solar system is chaotic . However it is a special kind of chaos , a non ergodic chaos . There are also very important and interesting theorems (look up KAM theorem) .<br /><br />I did not understand you last phrase . Or at least how it links to my post above .<br />Complexity is a thing unto itself . I would rather say the opposite - fluid dynamics is precisely the domain where it shows most . There is a reason why the Navier Stokes equations still resist even the most basic demonstration - namely existence of a smooth unique solution in the 3D case . <br />The N body system is not bad either - how complexity appears from only 3 points interacting by simple gravity (and the system is not ergodic) .TomVonknoreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-33782329064277620092010-08-07T12:59:48.599-04:002010-08-07T12:59:48.599-04:00Quoting Tom: "As there is nothing that warran...Quoting Tom: "As there is nothing that warrants us ergodicity, it is a miracle that so many dynamical systems have this property."<br /><br />Tom, can you speculate why that may be? I am familiar with Wigner and his 1960 article on <a href="http://www.dartmouth.edu/~matc/MathDrama/reading/Wigner.html" rel="nofollow">The Unreasonable Effectiveness of Mathematics in the Natural Sciences</a>. Have things become more reasonable since 1960? Or less? I am particularly interested in the climate dynamical system. For example, what are your thoughts on the efficacy of climate system ensembles?<br /><br />Also, do you know of any good overviews of Schaos that are accessible over the web? I am already generally familiar with fluid dynamics. I did a google on lattice dynamical systems and did not find much.<br /><br />You mention Hamiltonian dynamics, which I was taught were most applicable to non-dissipative systems (e.g., inviscid fluids). Is this concept important to getting a grip on Schaos?<br /><br />Your comments make intuitive sense to me. (Warning -- I'm wrong so often.) I'm thinking the complexity demands we think less about fluid dynamics and more about thermodynamics.<br /><br />Thanks in advance.F.W.Graumishttps://www.blogger.com/profile/05795380097849494251noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-37646492953059209742010-08-05T16:03:01.816-04:002010-08-05T16:03:01.816-04:00Tom, you cover a lot of ground here. It'll pr...Tom, you cover a lot of ground here. It'll probably take me a while to digest and respond; just wanted to let you know I appreciate your comments.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-44317950095102783542010-08-05T09:59:31.551-04:002010-08-05T09:59:31.551-04:003) IVP , BVP and climate .
First I consider that ...3) IVP , BVP and climate .<br />First I consider that distinguishing IVP and BVP is irrelevant . This distinction is just a technicality which may but must not impact existence and unicity of solutions to PDE or ODE . Actually from a physical point of view everything is IVP because when you observe a system , you have the state you observed at some t0 and the laws of nature who say how it evolves from there . BVP is a sophistication when you want that the system observes some kind of constraints . In any case a BVP is just an IVP to which we added an equation describing a constraint if this constraint (like f.ex no slip condition) is not already included implicitly in the laws of nature . <br />So weather is of course an IVP if one wants to use this terminology . But what is the climate ?<br />I will finish my post with this question because I admit that after 10 years of reading papers and books about climate , I still do not know what it is from the <b>physical</b> point of view . Well as I showed above , climate is clearly not chaos . <br />Climate might be Schaos but Schaos theory doesn’t exist . So what is left ? <br />Climate may be a time and space average of weather what one often reads . But then one must ask an obvious question . Is there something in the climate that is not already in weather ? If the answer is that there are slow phenomenons that are neglected in weather (because it won’t go beyond 2 or 3 days) but are taken in account in climate , then there is no qualitative difference between weather and climate . It is just a matter of constant coefficients that one allows to vary or additional equations . Then climate is weather with variable coefficients . This doesn’t make the former more predictable than the latter . Besides this definition <b>NEVER</b> answers how and why the temporal and spatial averaging intervals should be chosen and why a set of some particular averages should be more relevant than another .<br /><br />Last , also often given definition is of the kind “Climate is an envelope of weather and constrains its variations” . <br />This definition is often given with analogies to Lorenzian chaos and attractors which , as we have already seen is horribly wrong . <br />From this definition follow other misconceptions , probably also guided by misunderstanding of Schaos , namely that the climate would be “stable” or that the system would tend to some kind of “equilibrium” . <br />Well both weather and climate are fundamentally out of equilibrium which is a condition of chaos as we have seen . As for “stability” it is ill defined – if stability means “stays in some interval” then it is trivial – chaotic systems also always “stay in some interval” . If it means invariant , then it is obviously wrong .<br />What stays is that what I see , is that “climatology” is just a numerical simulation of a fluid mechanics system on a grid on which one imposed the conservation of mass , energy and momentum . Then clearly every run will show states that look like climate or weather . The constructal theory with infinitely simpler model easily reproduces all major features of the general circulation too . It is trivial to simulate a system by observing conservation laws and perhaps a bit of subgrid parametrisations . Problem is precisely that it can NOT show something pathological even if what it shows might have in reality a probability of 0 . There where it becomes pathological is that there is no reason that a frequency for a particular state obtained in 1000 simulations corresponds to a probability that the real system realizes this particular state . There is actually no reason that there even exists an invariant PDF for states on some arbitrary grid (see what I wrote about ergodicity) . Because of that , the results of numerical simulations can’t be validated or invalidated by experience . This really doesn’t look very interesting to me .TomVonknoreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-25971139858808185582010-08-05T09:56:07.602-04:002010-08-05T09:56:07.602-04:002) Schaos
No , this is not a typo . I have chosen ...2) Schaos<br />No , this is not a typo . I have chosen to use a different word Schaos to distinguish it from chaos that I have described above in 1) . The S goes for space because we have now extended the dynamics to the spatial domain . And unfortunately almost nothing of the chaos theory survived this extension to the spatial domain . Worst of all is that we lost the frame of the theory – the phase space - because it now became uncountably infinite dimensional (this just comes from the trivial observation that a PDE is equivalent to an uncountable infinity of ODEs) .<br />And with the phase space we lost everything that comes along – attractors , orbits , stability , invariance , ergodicity and what not . The only thing that survived is the sensibility to initial conditions which makes Schaos as deterministically unpredictable as chaos . But even that can no more be quantitatively and qualitatively explained by well defined concepts like the Lyapounov coefficients because we have no orbits in the phase space anymore . That’s why every time I hear or read the words “Lorenz and chaos” and “climate” used together , I can be sure that the person doesn’t know what he is talking about . The only point that Lorenz and climate have in common is that Lorenz was a meteorologist .<br />Schaos theory doesn’t exist . What comes nearest is fluid dynamics and LDS (lattice dynamical systems) . The latter tries to artificially create an equivalent of a phase space by considering that the system is described by N chaotic (chaos as defined in 1) oscillators situated on a spatial lattice and interacting with each other . It is very complex , and the few results are far from a Schaos theory . Such systems are generally not ergodic , if one agrees what an extension of ergodicity to S domain means … Clearly there are no invariant spatial structures which could play a role equivalent to the attractors in the chaos theory (just look at cigarette smoke) . It is not clear at all what a stochastic interpretation of Schaos should be .<br />Etc . So weather and climate are very probably schaotic but certainly not chaotic .TomVonknoreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-11931539650892738392010-08-05T09:54:35.934-04:002010-08-05T09:54:35.934-04:00Hello Josh .
I came to appreciate your open mind a...Hello Josh .<br />I came to appreciate your open mind and your pragmatic approach to very complex problems .<br />That's why I am about to start a rather long post about a couple of fundamental things .<br />I will mostly tackle 2 issues :<br />- the chaos<br />- the IVP vs BVP point of view <br />I will try to stay at a very general level avoiding technicalities . It is much more important to get the general view right and I think that only very few climate model builders get the general view right . That of course dramatically lowers the probability to study <b>relevant</b> technicalities .<br />As I write on the fly , it will probably not be well structured so I apologize in advance .<br /><br />1) The chaos<br />Unfortunately it is probably a fair statement to say that 90% or so of climate model builders don't know what they are talking about . This has for consequence that they draw wrong conclusion from right observation or the other way round . Especially notions of attractors , basins of attraction , stability , invariance are almost always misunderstood . Yet these are <b>fundamental</b> concepts. What is the chaos theory ?<br />Mathematically it is a study of a system of non linear ODE . Physically it is a study of system with non linear dynamics . This study uses the frame of a <b>FINITE</b> phase space where the state of the system describes an orbit function of time . The number of dimensions may be low (f.ex Lorenz or planetary orbits) or very high (statistical thermodynamics) but is always finite . A chaotic system is <b>always</b> out of equilibrium and no point on its orbit in the phase space is “nearer” or “farther” from some hypothetical equilibrium condition . On the contrary , systems at or near equilibrium can never be chaotic .<br />I will insist upon it and say it a second time : the variables are independent dimensions of the phase space function of time <b>ONLY</b> . The chaos will always appear in a system where at least one of the Lyapounov coefficients is positive . This is a necessary and sufficient condition . The result of chaos is that the trajectory of the system runs through a necessarily bounded region of the phase space along a trajectory that is <b>impossible</b> to be predicted deterministically . The subspace of the phase space where the orbits live is called an attractor . Generally an attractor is invariant , e.g its topology is independent from the initial conditions but it is of course dependent from the parameters/coefficients of the ODE . It may or may not be fractal but I won’t discuss this technicality farther .<br />As the time evolution of a chaotic system cannot be predicted deterministically and it is an impossibility of principle , the only way to progress is a stochastical description . Therefore the very fundamental tool to progress in the chaos theory is the ergodic theory . One cannot insist enough on the fact that the ergodicity is the single most important property of a chaotic system . Indeed ergodicity gives us the insurance of <b>existence</b> of an <b>invariant</b> PDF function in the phase space which gives us the probability of the system to find itself in a small volume around a point . Invariant means that this PDF neither depends on the initial conditions nor on time . As there is nothing that warrants us ergodicity , it is a miracle that so many dynamical systems have this property . The major example of non ergodicity are Hamiltonian dynamics (gravitational interaction in the N body problem) and in this case no statistical description is possible . From this observation follows that ergodicity can <b>NEVER</b> be assumed but must be demonstrated . However once it is demonstrated a consistent , robust statistical description is possible (thermodynamics works quite nicely , right ?) .TomVonknoreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-66805442201661947162010-07-15T09:44:44.261-04:002010-07-15T09:44:44.261-04:00More by Pielke Sr on the IVP/BVP distinction in cl...More by Pielke Sr <a href="http://pielkeclimatesci.wordpress.com/2010/07/15/new-paper-impact-of-atmosphere-and-sub-surface-ocean-data-on-decadal-climate-by-dunstone-and-smith-2010/" rel="nofollow">on the IVP/BVP distinction</a> in climate forecasting.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-46841255702566741142010-07-01T09:22:00.955-04:002010-07-01T09:22:00.955-04:00Roger Pielke Sr has put up a short bit on the IVP/...Roger Pielke Sr has put up <a href="http://pielkeclimatesci.wordpress.com/2010/07/01/qa-on-gcms-weather-and-climate/" rel="nofollow">a short bit</a> on the IVP/BVP distinction (he's also published on the subject, one paper titled 'climate prediction as an initial value problem' from way back in 1998), here's what he says:<br /><i>There is a fundamental difference in how scientists who have prompted the 2007 IPCC WG1 report view climate modeling and how other climate scientists view this modeling. The IPCC perspective is that numerical weather prediction is an initial value problem while climate prediction is a boundary value problem in which levels of atmospheric CO2 and aerosols are the primary “boundary forcing”. With this perspective, they claim that changes in the statistics of weather (and other climate features) can be skillfully predicted.<br /><br />However, our research has shown this is a seriously flawed view as climate prediction is really an initial value problem.</i><br /><br />It's neat to see his appropriately titled paper from '98, match up with the dawning realization from the big iron boys that, yes in fact the governing equations (the physics) tell you what type of problem you are solving, rather than your computational capabilities.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-89460886001076285362010-06-02T13:31:11.909-04:002010-06-02T13:31:11.909-04:00A ways up thread I wrote:If you are solving a PDE,...A ways up thread I wrote:<i>If you are solving a PDE, then verifying a calculation (of a verified code) with grid convergence is the sine qua non.</i><br /><br />Here is <a href="http://www.amazon.com/gp/product/0486411834?ie=UTF8&tag=variouconseq-20&linkCode=as2&camp=1789&creative=390957&creativeASIN=0486411834" rel="nofollow">Boyd's take</a> on the matter:<br /><i><b>Definition 16 (IDIOT)</b> Anyone who publishes a calculation without checking it against an identical computation with smaller N OR without evaluating the residuals of the pseudospectral approximation via finite differences is an IDIOT.</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-31853968768661938412010-04-28T10:53:26.936-04:002010-04-28T10:53:26.936-04:00Pielke Sr. has another good article on his site ab...Pielke Sr. has <a href="http://pielkeclimatesci.wordpress.com/2010/04/28/comments-on-numerical-modeling-as-the-new-climate-science-paradigm/" rel="nofollow">another good article on his site about validation and credibility</a>. It mentions <a href="http://j-stults.blogspot.com/2009/12/sociology-of-science.html?showComment=1267482482861#c4597583011007976903" rel="nofollow">Lindzen's lament</a>, and the problem of science-based decision making which relies on models unconstrained by reality. Also mentions that the IVP vs BVP analogy for the difference between climate and weather is starting to be recognized as incorrect.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-68522328091824520512010-03-23T15:40:01.365-04:002010-03-23T15:40:01.365-04:00This paper, Numerically Converged Solutions of the...This paper, <a href="http://ams.allenpress.com/perlserv/?request=get-document&doi=10.1175%2FMWR2788.1&ct=1" rel="nofollow">Numerically Converged Solutions of the Global Primitive Equations for Testing the Dynamical Core of Atmospheric GCMs</a>, provides a test case demonstrating numerical convergence of a pseudo-spectral discretization for the governing equations commonly used in climate models (which are significantly simplified from the full-up hyperbolic conservation laws). The demonstrated convergence rate is only ~0.9, so there's likely <a href="http://j-stults.blogspot.com/2010/01/chaotic-time-convergence-and-mms.html" rel="nofollow">still an ordered error</a>, a discontinuity (but they add artificial viscosity so this is unlikely), or they aren't in the asymptotic range yet (this seems unlikely as well based on eye-balling their contour plots). They mention in the paper that mathematics rather than physics should be the focus of a verification test like this, but then they go on to worry about the 'realism' of the test. Use the <a href="http://j-stults.blogspot.com/2010/01/chaotic-method-of-manufactured.html" rel="nofollow">method of manufactured solutions</a> and stop worrying!<br /><br />This is <a href="http://ntrs.nasa.gov/search.jsp?R=351477&id=3&as=false&or=false&qs=Ns%3DHarvestDate%257c1%26N%3D4294682639" rel="nofollow">worrisome</a>:<br /><i>To demonstrate that the converged numerical solution discussed above is not an artifact of the pseudospectral model that was used to compute it, we have adopted the practical expedient of computing a new set of numerical solutions to the identical set of equations and initial conditions but with a different numerical scheme.</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-15131091319967565982010-03-17T17:08:18.373-04:002010-03-17T17:08:18.373-04:00Here's the reason why I haven't been able ...Here's the reason why I haven't been able to find grid convergence results for climate models, the past results have not been very 'encouraging' (emphasis added):<br /><i>To place any confidence in numerical simulations of climate, the horizontal and vertical resolution must be fine enough to accurately represent the phenomenological scales of motion of most importance to the climate system. A common spectral truncation used in global climate models is a 42-wave triangular truncation (T42), which can very accurately treat features and their horizontal derivatives down to approximately 950 km. Motion scales below this truncation limit must be treated in some other way, and generally enter the solution in the form of a forcing term. In a spectral model these “subgrid-scale” terms are evaluated on a transform grid whose grid intervals are directly related to the spectral truncation. In a T42 model the transform grid interval is approximately 300 km at the equator. These terms are almost always evaluated using parameterization techniques, which can be highly nonlinear and are generally functions of the explicitly resolved atmospheric state variables. Ideally, one would select a horizontal resolution for which the solutions are in a convergent regime; i.e., where additional increases in resolution would not greatly alter the solutions. Under such circumstances it might also be expected that the behavior of parameterized forcing terms would not significantly change with additional increases in resolution.<br /><br />Exploration of global atmospheric simulation sensitivity to horizontal resolution goes back more than 30 years (Manabe et al. 1970), and has continued sporadically in the intervening years (e.g., Manabe et al. 1979; Boer and Lazare 1988; Boville 1991; Kiehl and Williamson 1991; Chen and Tribbia 1993). Most investigations have identified some systematic improvements related to increases in horizontal resolution. In an earlier version of the CAM, Williamson et al. (1995) showed that many statistics used to characterize 3 climate properties began to converge in the range of a T63 spectral truncation for midlatitudes. They also showed that scales of motion included at T63 and higher resolutions were needed to capture the nonlinear processes which drive some larger scale circulations. <b>The more discouraging outcome of that investigation was that they were unable to demonstrate convergence for many other quantities, even at a T106 truncation.</b></i><br /><br />So what do you do when you can't get grid convergence on the functionals you care about? You punt (twiddle your fudge factors):<br /><i>One of the unique design goals for the CAM3 was to provide simulations with comparable large-scale fidelity over a range of horizontal resolutions. This is accomplished through modifications to adjustable coefficients in the parameterized physics package associated with clouds and precipitation.</i><br /><br /><a href="http://www.google.com/url?sa=t&source=web&ct=res&cd=1&ved=0CAgQFjAA&url=http%3A%2F%2Fwww.ccsm.ucar.edu%2Fpublications%2Fjclim04%2FPapers%2FAMWG6.pdf&ei=70ChS5rsDsT7lwfvyZX-DQ&usg=AFQjCNE9PstkVfeOrmL-6Wjk9M685b5wXg&sig2=hEwrfYEggE3B4wKxE5VUfw" rel="nofollow">CCSM CAM3 Climate Simulation Sensitivity to Changes in Horizontal Resolution</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-38030141970361052402010-02-26T11:00:28.233-05:002010-02-26T11:00:28.233-05:00To re-emphasize Dan's point (again) about unea...To re-emphasize <a href="http://j-stults.blogspot.com/2010/02/predictions-and-entropy-in-ensembles.html?showComment=1266009835491#c3632047337221036884" rel="nofollow">Dan's point</a> (<a href="http://j-stults.blogspot.com/2010/02/predictions-and-entropy-in-ensembles.html?showComment=1266412502074#c3609889383777633777" rel="nofollow">again</a>) about uneasiness when the stuff you care about is still a function of the grid (emphasis added):<br /><br /><i>The other approach</i> [to adaptive mesh refinement] <i>is motivated from the mathematical side. Assuming that a well defined partial differential equation is given, adaptive refinement of the approximation order or mesh width intends to equilibrate the numerical error. This approach requires that a consistent formulation of the error is available and also that a capable estimation of that error is feasible. It also requires that the numerical method together with the discretization of the problem are both convergent. <b>This might not be the case in real life meteorological applications, where discrete models of sub-grid processes can destroy convergence</b>.</i><br /><a href="http://books.google.com/books?id=SSyaX3myq4gC&lpg=PP1&ots=zCLegzxbz5&dq=adaptive%20Atmospheric%20Modeling%3A%20Key%20Techniques%20in%20Grid%20Generation%2C%20Data%20Structures%2C%20and%20Numerical%20Operations%20with%20Applications&pg=PA10#v=onepage&q=&f=false" rel="nofollow">-- Adaptive Atmospheric Modeling: Key Techniques in Grid Generation, Data Structures, and Numerical Operations with Applications</a><br /><br />This sort of thing should make you very uneasy about unvalidated claims of predictive capability. This is an open research problem that is being worked though. For instance, Dr Curry has an interesting paper about <a href="http://curry.eas.gatech.edu/currydoc/Khvorostyanov_JAS59.pdf" rel="nofollow">water droplet terminal velocity parameterization [pdf]</a>, in which one of the stated goals is to get a continuous model to improve on older 'look-up table'-style discontinuous ones.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-53473038365556894782010-02-18T08:26:07.397-05:002010-02-18T08:26:07.397-05:00At least one person has recently presented some &#...At least <a href="http://www.image.ucar.edu/Workshops/TOY2009/focus02/abstracts.shtml" rel="nofollow">one person has recently presented</a> some 'motivational' work on verification to the folks at UCAR:<br /><b>Verification through Adaptivity</b><br />Brian Carnes<br />Sandia National Laboratories<br /><i>Joint work with Bart van Bloemen Waanders and Kevin Copps, Sandia National Laboratories</i><br /><br /><b>Verification of computational codes and calculations has become a major issue in establishing credibility of computational science and engineering tools.</b> Adaptive meshes and time steps have become powerful tools for controlling numerical error and providing solution verification. This talk makes the case for using adaptivity to drive verification. Connections between numerical error and overall uncertainty are emphasized.<br />In the first part of the talk, an overview of verification using uniform grid studies is presented, including grid convergence and manufactured solutions. Then basic ideas of numerical error estimation and adaptivity are outlined, including goal-oriented approaches using the adjoint problem. Finally, examples are shown to illustrate the use of adaptivity to control numerical error in thermal, fluid, and solid mechanics applications.<br /><br /><a href="http://www.ne.ncsu.edu/research/ace/Carnes_ACE2007.pdf" rel="nofollow">Here's some slides</a> the same guys presented at a different conference (roughly the same subject though).Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-36098893837776337772010-02-17T08:15:02.074-05:002010-02-17T08:15:02.074-05:00ekzept,
Thanks for the links; the point about the...ekzept, <br />Thanks for the links; the point about the unclaimed prize was about 'blow-up' not resolution, I probably could have been clearer.<br /><br />You said:<br /><i>solving the world or a set of ocean currents is a different problem than solving a river, and methods need to be adapted accordingly, including their figures of merit.</i><br />The sub-grid scale models and other parametarizations may be different, but this is just hand-waving. If you are solving a PDE, then verifying a calculation (of a verified code) with grid convergence is the sine qua non.<br /><br />The unfortunate problem with climate models is that they don't actually do this. To re-emphasize Dan's point about uneasiness when the stuff you care about is still a function of the grid (from <a href="http://www.ccsm.ucar.edu/models/ccsm3.0/ccsm3.0_faq.html#grids1" rel="nofollow">the CCSM FAQ</a>):<br /><i>The CCSM3.0 release officially supports three resolutions referred to as "T85_gx1v3", "T42_gx1v3", and "T31_gx3v5". For each resolution, multi-century control runs using all active models (a "B configuration") have been scientifically validated.</i><br />In other words, we tuned the model at each of three resolutions to give decent hindcasts. That's not exactly consistent with the <a href="http://www.aiaa.org/content.cfm?pageid=231&masterid=102" rel="nofollow">encouraged state of the practice</a>.<br /><br />At least they <i>are</i> <a href="http://www.nar.ucar.edu/2008/ESSL/catalog/cgd/amp.php" rel="nofollow">working on it</a>:<br /><i><b>Project: Simulation quality as a function of horizontal and vertical resolution</b><br /><br />Another major evaluation focus in AMP is on simulation quality as a function of horizontal and vertical resolution. Jim Hack, Julie Caron, and John Truesdale have been examining the quality of the mean climate and its variability characteristics using the spectral dynamical core for horizontal resolutions ranging from T31 through T341. This work has demonstrated clear improvements in the simulated mean dynamical circulation when more a more traditional climate resolution of T42 is doubled to T85 (Hack et al., 2006). Variability metrics, however, are generally unchanged at the higher resolution. Furthermore, continued increases in horizontal resolution exhibit weaker responses in terms of simulation improvement, particularly with regard to the most serious systematic simulation errors. This appears to point to deficiencies in the treatment of parameterized physics as the principal source of these systematic errors. The resolution studies have demonstrated significant differences in the interaction of the dynamical core and the parameterized physics package as a function of horizontal resolution. To better explore these issues, Truesdale has incorporated modifications to the CAM so that a single-column model version of the CAM (known as SCAM) can be more seamlessly exploited. Recent work by Truesdale includes an analysis of hurricanes in the high-resolution (T341) CAM runs compared to statistics generated by the Nested Regional Climate Model (NRCM) runs. Studies using the CAM and SCAM at multiple resolutions are ongoing.</i> <br /><br />I'd still appreciate any links to the lit of any grid convergence type studies (I'm not trying to get you to do a lit review for me I promise, I'm just curious, and I've looked, using scholar.google.com, with no luck, maybe the climate science folks call it something else?).Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-47103149119452445622010-02-17T01:20:04.084-05:002010-02-17T01:20:04.084-05:00There's a lot of discussion about grid converg...There's a lot of discussion about grid convergence in models in the background reports and papers for (e.g.) the Community Climate System Model, http://www.ccsm.ucar.edu/models/<br /><br />There has been a lot of work done on the Earth models, much of it specialized to various subsystems (ocean, land, atmosphere, interactions), and a fair bit on algorithms (extended Kalman work, for instance, and http://www.nar.ucar.edu/2008/ESSL/catalog/cgd/amp.php). There's an overview available at: http://www.linuxclustersinstitute.org/conferences/archive/2009/PDF/Dennis_88341.pdf<br /><br />I don't think whether a Navier Stokes prize has been won or not is any statement on the state of progress. You don't need to solve things at N-S resolution to simulate globally, these wouldn't necessarily generalize to non-linear dynamics (ice shelf collapse), and there are lots of reasons why prizes are forgone. For instance, there are other more pertinent competitions: http://www-pcmdi.llnl.gov/uhrccs/<br /><br />In short, solving the world or a set of ocean currents is a different problem than solving a river, and methods need to be adapted accordingly, including their figures of merit.Anonymousnoreply@blogger.com