tag:blogger.com,1999:blog-5822805028291837738.post6222505973266237003..comments2020-06-01T01:53:36.438-04:00Comments on Various Consequences: Uncertainty Quantification with Stochastic CollocationJoshua Stultshttp://www.blogger.com/profile/03506970399027046387noreply@blogger.comBlogger23125tag:blogger.com,1999:blog-5822805028291837738.post-1284795174546698792012-09-30T12:56:53.400-04:002012-09-30T12:56:53.400-04:00Ivan, thanks for your comment. If you google term...Ivan, thanks for your comment. If you google terms like <i>probability Jacobian transformation</i> you should find lots of slides/tutorials/lesson notes. That's what we're doing here. The Jacobian in this simple 1-D problem is just the slope we've estimated using the complex step method.<br /><br />You don't have to do it this way. Lots of folks just use the function values to fit a polynomial, and then use this as a surrogate. It's faster to do Monte Carlo with a polynomial rather than the full model. Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-38662430762032813402012-09-29T17:25:29.420-04:002012-09-29T17:25:29.420-04:00I find this short article to be really interesting...I find this short article to be really interesting and insightful since I have not heard such an explanation of the stochastic collocation method before (and, to be honest, the complex-step trick either); although, I am reading the literature on uncertainty quantification all the time. Can you please provide some links where I can clarify for myself this part "we really want [...] the slope at the collocation points" and what follows it? I am familiar with [1]-[4], but, it seems, I am still missing something. Thank you.Ivannoreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-17456908965516393422011-12-23T11:01:14.079-05:002011-12-23T11:01:14.079-05:00Nice animated graphic showing an adaptive stochast...Nice animated graphic <a href="http://dbarajassolano.wordpress.com/2011/12/17/a-quick-illustration-of-adaptive-stochastic-collocation-methods/" rel="nofollow">showing an adaptive stochastic collocation approach</a>.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-41737689990118877102011-09-22T12:23:25.296-04:002011-09-22T12:23:25.296-04:00The PSUADE Uncertainty Quantification Project: PSU...The <a href="https://computation.llnl.gov/casc/uncertainty_quantification/index.html" rel="nofollow">PSUADE Uncertainty Quantification Project</a>: <i>PSUADE is a acronym for Problem Solving environment for Uncertainty Analysis and Design Exploration. It is a software toolkit to facilitate the UQ tasks ...</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-64848616860375142052011-09-02T17:20:58.439-04:002011-09-02T17:20:58.439-04:00Extensive set of slides for an introduction to mod...<a href="http://www.stanford.edu/group/uq/events/pdfs/lecture_3.pdf" rel="nofollow">Extensive set of slides</a> for an introduction to modern UQ methods, polynomial chaos and stochastic collocation.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-38584445370150893322011-08-26T15:33:40.785-04:002011-08-26T15:33:40.785-04:00Uncertainty Quantification in Computational Models...<a href="http://climatechange.cs.umn.edu/docs/20110815-Najm.pdf" rel="nofollow">Uncertainty Quantification in Computational Models</a> a presentation given at the <a href="http://climatechange.cs.umn.edu/annual.php" rel="nofollow">Workshop on Understanding Climate Change from Data (UCC11)</a>, which is apparently an "<a href="http://www.nsf.gov/funding/pgm_summ.jsp?pims_id=503169" rel="nofollow">expedition in computing</a>", sounds fun...Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-82554864124851091092011-08-15T09:50:21.876-04:002011-08-15T09:50:21.876-04:00Direct Reduction of SPDEs through the stochastic t...<a href="http://www.google.com/url?sa=X&q=http://mpdc.mae.cornell.edu/Conferences/RioUQ2011/PRESENTATIONS/Karniadakis-Presentation.pdf&ct=ga&cad=CAcQAxgBIAEoATAAOABAiuiU8gRIAVgAYgVlbi1VUw&cd=SAaCBqSyYPQ&usg=AFQjCNEuACXw_mu2SEOsrJUxFWKyCbYlbw" rel="nofollow">Direct Reduction of SPDEs through the stochastic transformation method</a> “Spectral Polynomial Chaos Solutions of the Stochastic Advection Equation”. Some History… <b>...</b> Multi-element probabilistic collocation method (ME-PCM) ...<a href="http://www.google.com/url?sa=X&q=http://mpdc.mae.cornell.edu/Conferences/RioUQ2011/PRESENTATIONS/Karniadakis-Presentation.pdf&ct=ga&cad=CAcQAxgBIAEoBDAAOABAiuiU8gRIAVgAYgVlbi1VUw&cd=SAaCBqSyYPQ&usg=AFQjCNEuACXw_mu2SEOsrJUxFWKyCbYlbw" title="http://mpdc.mae.cornell.edu/Conferences/RioUQ2011/PRESENTATIONS/Karniadakis-Presentation.pdf" rel="nofollow">mpdc.mae.cornell.edu/.../Karniadakis-Presentation.pdf</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-24244800877130137722011-03-29T15:09:07.504-04:002011-03-29T15:09:07.504-04:00Modeling of physical systems underspecified by dat...<a href="http://computerlectures.pnl.gov/pdf/DTartakovsky_pres.pdf" rel="nofollow">Modeling of physical systems underspecified by data</a><br />Outline<br />1. Physical systems & Stochastic PDEs<br />2. Data-Driven Domain Decompositions (D4) for SPDEs<br />3. Implementation of D4<br /> (a) Data analysis & image segmentation<br /> (b) Closure approximations for SPDEs<br /> (c) PDEs on random domains<br />4. Effective parameters for heterogeneous composites<br />5. ConclusionsJoshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-63651322932281461742010-08-19T10:32:22.232-04:002010-08-19T10:32:22.232-04:00Turns out, using the sensitivity derivatives (what...Turns out, using the sensitivity derivatives (what I calculated with the <a href="http://j-stults.blogspot.com/search/label/complex%20step" rel="nofollow">complex-step method</a> in this post), for stochastic problems <a href="http://portal.acm.org/citation.cfm?id=1144419&dl=&coll=GUIDE&CFID=98095027&CFTOKEN=90778239" rel="nofollow">helps with sampling too</a>, the Abstract:<br /><i>This paper establishes a general theoretical framework for variance reduction based on arbitrary order derivatives of the solution with respect to the random parameters, known as sensitivity derivatives. The theoretical results are validated by two examples--the solution of the Burgers equation with viscosity as a single random parameter, and a test case involving five random variables. These examples illustrate that the first-order sensitivity derivative variance reduction method achieves an order of magnitude improvement in accuracy for both Monte Carlo and stratified sampling schemes. The second-order sensitivity derivative method improves the accuracy by another order of magnitude relative to the first-order method. Coupling it with stratified sampling yields yet another order of magnitude improvement in accuracy.</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-54280269741963968692010-08-06T13:35:50.227-04:002010-08-06T13:35:50.227-04:00A more precise definition of UQ is the end-to-end ...<i>A more precise definition of UQ is the end-to-end study of the reliability of scientific inferences.</i><br /><a href="http://www.er.doe.gov/ascr/ProgramDocuments/Docs/NNSAGrandChallengesReport.pdf" rel="nofollow">Scientific Grand Challenges for National Security</a>: The role of computing at the extreme scale.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-13441462598816304022010-07-29T15:38:07.443-04:002010-07-29T15:38:07.443-04:00In this post I used the sensitivity derivative of ...In this post I used the sensitivity derivative of the function with respect to the random variable to do the transformation from random input to random output. This info can also be used to increase the efficiency of a more standard Monte Carlo sampling approach:<br /><i>For a fixed number of samples, there is typically an order of magnitude reduction in the error achieved by the sensitivity derivative-enhanced sampling (SDES) approach. Equivalently, SDES computations require two orders of magnitude fewer samples to achieve the same accuracy in the moments compared with baseline Monte Carlo and stratified sampling schemes. The improvement afforded by the SDES approach appears to increase as the number of random variables increases. The overhead for the extra sensitivity derivative calculations is less than 5%...</i><br /><a href="http://scholar.google.com/scholar?cluster=1781741245541454567" rel="nofollow">Exploitation of Sensitivity Derivatives for Improving Sampling Methods</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-64119512738061099502010-07-03T08:59:56.822-04:002010-07-03T08:59:56.822-04:00On Nuit Blanche: High Dimensional Problems and Sol...On Nuit Blanche: <a href="http://nuit-blanche.blogspot.com/2010/07/high-dimensional-problems-and-solutions.html" rel="nofollow">High Dimensional Problems and Solutions</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-65282326655272173052010-06-22T11:10:46.980-04:002010-06-22T11:10:46.980-04:00A low level introduction to high dimensional spars...<a href="http://people.sc.fsu.edu/~jburkardt/latex/sandia_2007/sandia_2007.html" rel="nofollow">A low level introduction to high dimensional sparse grids</a> has a thesis, paper and presentation slides on sparse grids.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-19293451730574066072010-06-14T17:37:08.301-04:002010-06-14T17:37:08.301-04:00An efﬁcient Bayesian inference approach to inverse...<a href="http://scholar.google.com/scholar?cluster=6982056370863432535&hl=en&as_sdt=100000000000&as_vis=1" rel="nofollow">An efﬁcient Bayesian inference approach to inverse problems based on an adaptive sparse grid collocation method</a>, using methods developed for UQ to do Bayesian inference for solving inverse problems, this one has a good review of relevant alternative techniques upfront. The key difference between this and the other similar paper linked above is the dimension of the stochastic space. The previously linked paper addresses low-dimension unknown spaces in the examples; this paper uses an adaptive Smolyak algorithm to tackle the curse of dimensionality faced by inverse problems with multi-dimensional PDEs as the forward models (very high dimension stochastic space). <br /><b>Abstract:</b> <i>A new approach to modeling inverse problems using a Bayesian inference method is introduced. The Bayesian approach considers the unknown parameters as random variables and seeks the probabilistic distribution of the unknowns. By introducing the concept of the stochastic prior state space to the Bayesian formulation, we reformulate the deterministic forward problem as a stochastic one. The adaptive hierarchical sparse grid collocation (ASGC) method is used for constructing an interpolant to the solution of the forward model in this prior space which is large enough to capture all the variability/uncertainty in the posterior distribution of the unknown parameters. This solution can be considered as a function of the random unknowns and serves as a stochastic surrogate model for the likelihood calculation. Hierarchical Bayesian formulation is used to derive the posterior probability density function (PPDF). The spatial model is represented as a convolution of a smooth kernel and a Markov random ﬁeld. The state space of the PPDF is explored using Markov chain Monte Carlo algorithms to obtain statistics of the unknowns. The likelihood calculation is performed by directly sampling the approximate stochastic solution obtained through the ASGC method. The technique is assessed on two nonlinear inverse problems: source inversion and permeability estimation in ﬂow through porous media.</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-20696567966701965192010-04-21T10:55:07.526-04:002010-04-21T10:55:07.526-04:00UQ is hot world-wide: Ph.D positions at the Semina...UQ is hot world-wide: <a href="http://www.hp2c.ch/fileadmin/user_upload/Job_Offer_SAM.pdf" rel="nofollow">Ph.D positions at the Seminar for Applied Mathematics (SAM)</a>, <i>The research activity of both students will be in the area of Uncertainty Quantification (UQ) for partial differential equations. Particular attention will be paid to hyperbolic systems of conservation laws, in particluar shallow water equations, Euler equations of gas dynamics and equations of MagnetoHydroDynamics (MHD).</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-8796815167232123372010-03-24T08:06:15.925-04:002010-03-24T08:06:15.925-04:00Lots of interesting papers here on Dongxiao Zhang&...Lots of interesting papers <a href="http://www-rcf.usc.edu/~donzhang/index_files/Journal%20papers.htm" rel="nofollow">here</a> on <a href="http://www-rcf.usc.edu/~donzhang/" rel="nofollow">Dongxiao Zhang's site.</a> They are mostly focused on ground water and petroleum flows and data assimilation for modeling those things; the recent ones are on combining stochastic collocation methods with Kalman filters.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-57888534402520843262010-03-16T09:17:36.028-04:002010-03-16T09:17:36.028-04:00This paper has a couple simple examples worked out...This paper has a couple simple examples worked out:<br /><a href="http://www.google.com/url?sa=t&source=web&ct=res&cd=1&ved=0CBEQFjAA&url=http%3A%2F%2Fntrs.nasa.gov%2Farchive%2Fnasa%2Fcasi.ntrs.nasa.gov%2F20030016674_2003020380.pdf&ei=e32fS_HeHsSblgf6s6SLDg&usg=AFQjCNHQBbGT02UpZulj6CSI6eJuxnALMw&sig2=hX3fC7lCwRIB7BO0zQnfZQ" rel="nofollow">A Stochastic Collocation Algorithm for Uncertainty Analysis</a><br /><b>Abstract:</b><i>This report describes a stochastic collocation method to adequately handle a physically intrinsic uncertainty in the variables of a numerical simulation. For instance, while the standard Galerkin approach to Polynonfial Chaos requires multi-dimensional summations over the stochastic basis functions, the stochastic collocation method enables to collapse those summations to a one-dimensional summation only. This report furnishes the essential algorithmic details of the new stochastic collocation method and provides as a numerical example the solution of the Riemann problem with the stochastic collocation method used for the discretization of the stochastic parameters.</i><br /><br />This paper is about using stochastic collocation as part of a Bayesian inference procedure for inverse problems:<a href="http://www.google.com/url?sa=t&source=web&ct=res&cd=3&ved=0CB8QFjAC&url=http%3A%2F%2Fwww.math.purdue.edu%2F~dxiu%2FPapers%2FMarzoukX_CiCP09.pdf&ei=e32fS_HeHsSblgf6s6SLDg&usg=AFQjCNFODuflhljaB-XwkEWjL_jTO90A-Q&sig2=z1WIj_erXvwOePaJ_nLlQQ" rel="nofollow"> Stochastic Collocation Approach to Bayesian Inference in Inverse Problems</a><br /><b>Abstract:</b> <i>We present an efficient numerical strategy for the Bayesian solution of inverse problems. Stochastic collocation methods, based on generalized polynomial chaos (gPC), are used to construct a polynomial approximation of the forward solution over the support of the prior distribution. This approximation then defines a surrogate posterior probability density that can be evaluated repeatedly at minimal computational cost. The ability to simulate a large number of samples from the posterior distribution results in very accurate estimates of the inverse solution and its associated uncertainty. Combined with high accuracy of the gPC-based forward solver, the new algorithm can provide great efficiency in practical applications. A rigorous error analysis of the algorithm is conducted, where we establish convergence of the approximate posterior to the true posterior and obtain an estimate of the convergence rate. It is proved that fast (exponential) convergence of the gPC forward solution yields similarly fast (exponential) convergence of the posterior. The numerical strategy and the predicted convergence rates are then demonstrated on nonlinear inverse problems of varying smoothness and dimension.</i><br /><br /><b>Key words:</b> <i>Inverse problems, Bayesian inference, stochastic collocation, generalized polynomial chaos, uncertainty quantification.</i><br /><br />Of <a href="http://j-stults.blogspot.com/2010/03/parameterization-calibration-and.html?showComment=1268415279755#c6446370072030488705" rel="nofollow">particular note</a>:<br /><i>The gPC stochastic Galerkin approach has also been extended to Bayesian inference of spatially-distributed quantities, such as inhomogeneous material properties appearing as coefficients in a PDE <a href="http://scholar.google.com/scholar?hl=en&q=Dimensionality+reduction+and+polynomial+chaos+acceleration+of+Bayesian+inference+in+inverse+problems&btnG=Search&as_sdt=100000000000&as_ylo=&as_vis=1" rel="nofollow">[16]</a>.</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-53833498132179132642010-03-10T10:26:28.791-05:002010-03-10T10:26:28.791-05:00Interesting upcoming keynote (26 Mar 10) as part o...Interesting upcoming keynote (26 Mar 10) as part of <a href="http://www.ima.umn.edu/2009-2010/" rel="nofollow">UM's Complex Fluids and Complex Flows</a>,<br /><b>Title: </b> Abrupt climate change and climate variability: When data fail us<br /><b>Abstract: </b><i>We are familiar with the controversy regarding global warming and its social and environmental implications, much less so about why these controversies arise. I will describe the role played by mathematics in climate research and will discuss how mathematics plays a central role in answering one of the toughest technical challenges posed by the Intergovernmental Panel on Climate Change (IPCC 2007) report: How confident are we about predictions of future climate scenarios? In this university-level talk, I will describe why it is so difficult to pin down uncertainties in climate variability and will highlight some of the mathematical tools being developed by The Uncertainty Quantification Group and others, to tackle this question. </i><br /><br />What's the <a href="http://j-stults.blogspot.com/2010/02/catastrophic-sea-level-rise.html" rel="nofollow">time-constant for the 'abrupt' behavior</a>?Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-92203036323029665352010-03-09T20:09:26.288-05:002010-03-09T20:09:26.288-05:00In this paper (Uncertainty in Emissions Projection...In this paper (<a href="http://www.google.com/url?sa=t&source=web&ct=res&cd=1&ved=0CA0QFjAA&url=http%3A%2F%2Fdspace.mit.edu%2Fbitstream%2Fhandle%2F1721.1%2F3566%2FMITJPSPGC_Rpt79.pdf%3Fsequence%3D1&ei=IvGWS7-HAtS6lAfS36D1DA&usg=AFQjCNHUTYFM9BajiiyAaFTGppJcyCP2TA&sig2=LE7Pk3EQBAH81km0P8z7rg" rel="nofollow">Uncertainty in Emissions Projections for Climate Models</a>), they use one of the next higher order zeros as a validation point so that it will be available if the currently used expansion is unacceptable. That makes sense, but if you do decide to go up to the next higher order, should you throw away all the previous points (since they aren't at the new zeros) or use them (since they were hard-earned info)?Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-10922504221106091762010-03-03T22:34:46.931-05:002010-03-03T22:34:46.931-05:00George,
Thanks for the article; it's a good o...George,<br /><br />Thanks for the article; it's a good one.<br /><br />I think we can do a few things to keep our friends 'faithful': <br /><br />Pick the points well, we get into <a href="http://en.wikipedia.org/wiki/Runge%27s_phenomenon" rel="nofollow">trouble pretty quick with equidistant points</a>. <br /><br />Pick a <a href="http://en.wikipedia.org/wiki/Orthogonal_polynomials#The_classical_orthogonal_polynomials" rel="nofollow">nice orthogonal basis</a>, which turn out to be the ones we need to get rapid convergence for this application anyway (particular family depends on the input probability distributions). <br /><br />The other thing is to do a 'validation point' to compare a prediction from the response surface to a new model evaluation and see if it is within an acceptable tolerance (they do this in that <a href="http://j-stults.blogspot.com/2010/02/uncertainty-quantification-with.html#Xprob_collo_ocean" rel="nofollow">ocean model example</a>). <br /><br />If all else fails, we can do a least squares approximation instead of exact interpolation, which is usually better conditioned (with a good algorithm like QR). In this example since we pick the original set of points at the zeros of a certain order of Hermite polynomial, if we do an additional validation point it won't be at a zero, so doing least squares rather than interpolation on this new expanded set of points might make sense. <br /><br /><i>Should I be leery here?</i><br />Yes, <a href="http://gmcrews.blogspot.com/2010/02/rapidly-increasing-scope-for-software.html?showComment=1267203560297#c2237712249867724195" rel="nofollow">we can calculate everything...</a> some of it might even be right.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-78539597973596156332010-03-03T20:41:35.925-05:002010-03-03T20:41:35.925-05:00Hi Joshua,
Being unfamiliar with the SRSM, I look...Hi Joshua,<br /><br />Being unfamiliar with the SRSM, I looked up <a href="http://en.wikipedia.org/wiki/Response_surface_methodology" rel="nofollow">response surface methods</a> on the Wikipedia. It had a brief discussion of practical concerns, but what about the theoretical?<br /><br />I've always been leary of curve fitting with polynomials, since I was taught that polynomials are <a href="http://mathdl.maa.org/mathDL/22/?pa=content&sa=viewDocument&nodeId=3084" rel="nofollow">perfidious</a>. Reducing a problem to the solution of an explicit polynomial equation may not be that desirable of a transformation.<br /><br />Should I be leary here?<br /><br />GeorgeF.W.Graumishttps://www.blogger.com/profile/05795380097849494251noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-2823702396401823902010-03-03T12:50:35.146-05:002010-03-03T12:50:35.146-05:00UQ is critically important when it comes to inform...UQ is critically <a href="http://j-stults.blogspot.com/2009/12/verification-validation-and-uncertainty.html?showComment=1265930746591#c4974499522336313883" rel="nofollow">important when it comes to informing policy</a>:<br /><i>Characterization of uncertainty associated with transport-transformation models is often of critical importance, as for example in cases where environmental and biological models are employed in risk assessment. However, uncertainty analysis using conventional methods such as standard Monte Carlo or Latin Hypercube Sampling may not be efficient, or even feasible, for complex, computationally demanding models.</i><br /><br /><i>This work introduces a computationally efficient alternative method for uncertainty propagation, the Stochastic Response Surface Method (SRSM). The SRSM approximates uncertainties in model outputs through a series expansion in normal random variables (polynomial chaos expansion). The unknown coefficients in series expansions are calculated using a limited number of model simulations. This method is analogous to approximation of a deterministic system by an algebraic response surface.</i><br /><br />Rather than use a complex-step method like I did above, they use automatic differentiation:<br /><i>Further improvements in the computational efficiency of the SRSM are accomplished by coupling the SRSM with ADIFOR, which facilitates automatic calculation of partial derivatives in numerical models coded in Fortran. The coupled method, SRSM-ADIFOR, uses the model outputs and their derivatives to calculate the un-known coefficients.</i><br /><br /><a href="http://www.google.com/url?sa=t&source=web&ct=res&cd=1&ved=0CAYQFjAA&url=http%3A%2F%2Fwww.ccl.rutgers.edu%2Freports%2FEDMAS%2FT-15_CCL-EDMAS-03.pdf&ei=rJyOS6iyCaOg8QaXm9iCDQ&usg=AFQjCNHdCSY5U_KJLdgDwe35ReDxGfWmOg&sig2=i8MeDP9PKlo1JaAQlULgvQ" rel="nofollow"> Computational Methods for the Efficient Sensitivity and Uncertainty Analysis of Models for Environmental and Biological Systems</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-6645223362434039112010-03-03T12:43:06.775-05:002010-03-03T12:43:06.775-05:00The Computational Chemodynamics Lab at Rutgers has...The <a href="http://www.ccl.rutgers.edu/abstracts2005.htm" rel="nofollow">Computational Chemodynamics Lab</a> at Rutgers has some interesting stuff on stochastic collocation or polynomial chaos expansions, here's <a href="http://www.ccl.rutgers.edu/abstracts/SRA2005/sastry-yuri.htm" rel="nofollow">one of the abstracts</a>:<br /><i>The Stochastic Response Surface Method (SRSM) is a recently developed, computationally efficient technique for uncertainty propagation through numerical computational models. The SRSM provides an alternative to traditional techniques such as Monte Carlo and Latin Hypercube Sampling by approximating model outputs as probabilistic response surfaces involving orthogonal polynomials of standard random variables; this approximation is also known as the polynomial chaos expansion. The coefficients of the polynomial approximation are estimated from the model outputs at a set of sample points either via collocation or regression techniques. These coefficients provide combined sensitivity and uncertainty information of model outputs with respect to model inputs. This helps in identifying those inputs that contribute to the output uncertainties the most, thus allowing for prioritizing further studies and data gathering efforts. The application of the SRSM so far has involved prior (a priori) selection of collocation or regression points in order to estimate the polynomial chaos expansion coefficients. The current work presents algorithmic improvements to the SRSM by utilizing Bayesian techniques for estimating the coefficients of polynomial expansion. The improvements to the SRSM are implemented as modules of the MENTOR system (Modeling ENvironment for TOtal Risk studies), and the new SRSM modules are evaluated from the perspective of (a) estimating output uncertainties, (b) assessing contributions of individual input uncertainties, (c) computational efficiency, and (d) ability to utilize outputs from the available model runs. A comparative evaluation of the SRSM with regression and Bayesian techniques is presented for different environmental models with a diverse set of probability distributions for the model inputs including simple mixture distributions.<br /></i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.com