tag:blogger.com,1999:blog-5822805028291837738.post4983449906529853795..comments2023-12-09T03:51:33.158-05:00Comments on Various Consequences: Verification, Validation, and Uncertainty QuantificationJoshua Stultshttp://www.blogger.com/profile/03506970399027046387noreply@blogger.comBlogger19125tag:blogger.com,1999:blog-5822805028291837738.post-62313453486811627882010-05-05T12:04:06.040-04:002010-05-05T12:04:06.040-04:00An unfortunate common thread that I’ve noticed in ...<i>An unfortunate common thread that I’ve noticed in many of the V&V reports I’ve read is they seem to think Karl Popper had the last word on scientific induction!</i><br /><br />Well, <a href="http://books.google.com/books?id=tpEg2S33OIMC&lpg=PA3&ots=Y64brB3gPK&dq=The%20Rationality%20of%20Induction&lr&pg=PP1#v=onepage&q&f=false" rel="nofollow">he didn't</a> (hat tip <a href="http://wmbriggs.com/blog/?p=2336" rel="nofollow">Briggs</a>).Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-69752724830644083412010-04-07T13:06:58.944-04:002010-04-07T13:06:58.944-04:00The new International Journal for Uncertainty Quan...The new <a href="http://uncertainty-quantification.com/" rel="nofollow">International Journal for Uncertainty Quantification</a> (mentioned previously <a href="http://j-stults.blogspot.com/2009/12/verification-validation-and-uncertainty.html?showComment=1266766108642#c4053822723670243849" rel="nofollow">here</a> and <a href="http://j-stults.blogspot.com/2009/12/verification-validation-and-uncertainty.html?showComment=1265056017624#c7997829236291691045" rel="nofollow">here</a>) is <a href="http://www.netlib.org/na-digest-html/10/v10n14.html#5" rel="nofollow">now online and accepting submissions</a>.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-64586522137635776742010-03-02T09:17:38.365-05:002010-03-02T09:17:38.365-05:00From NA digest:
Postdoc Position in V&V/UQ at ...From <a href="http://www.netlib.org/na-digest-html/10/v10n09.html" rel="nofollow">NA digest</a>:<br /><i><b>Postdoc Position in V&V/UQ at Sandia National Laboratories</b><br /><br />The Computer Science Research Institute (CSRI) at Sandia National Laboratories in Albuquerque, NM, is seeking outstanding applicants for a postdoctoral position in any of the broad areas of Verification and Validation (V&V), Uncertainty Quantification (UQ), data assimilation, optimization, and inverse problems. The CSRI brings university faculty, students, and others together to pursue collaborative research in a highly multidisciplinary, team-based environment. The CSRI is well known for producing the DAKOTA and Trilinos multi-function software packages. For more information, see <a href="http://www.cs.sandia.gov/CSRI/" rel="nofollow">http://www.cs.sandia.gov/CSRI/</a>, <a href="http://www.cs.sandia.gov/dakota/" rel="nofollow">http://www.cs.sandia.gov/dakota/</a>, and<br /><a href="http://trilinos.sandia.gov/" rel="nofollow">http://trilinos.sandia.gov/</a>).<br /><br />To apply, go to <a href="http://www.sandia.gov" rel="nofollow">http://www.sandia.gov</a>, click on Employment, click on Career Opportunities, click on Search Job Postings, enter the job opening number (64709) in the Keywords field of the Basic Job Search, press Search, and scroll down to see the posting.</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-40538227236702438492010-02-21T10:28:28.642-05:002010-02-21T10:28:28.642-05:00I mentioned in a previous comment that D. Xiu was ...I mentioned in <a href="http://j-stults.blogspot.com/2009/12/verification-validation-and-uncertainty.html?showComment=1265056017624#c7997829236291691045" rel="nofollow">a previous comment</a> that D. Xiu was the associate editor of a new Uncertainty Quantification journal, he has written a nice (freely accessible) review article on <a href="http://www.math.purdue.edu/~dxiu/Papers/Xiu_CiCP08.pdf" rel="nofollow">Fast Numerical Methods for Stochastic Computations</a>, which is a good intro to the state of the art.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-49744995223363138832010-02-11T18:25:46.591-05:002010-02-11T18:25:46.591-05:00Regulatory Models and the Environment: Practice, P...<a href="http://www.escholarship.org/uc/item/8777n23k" rel="nofollow">Regulatory Models and the Environment: Practice, Pitfalls, and Prospects</a><br /><i>Modeling is a difficult enterprise even outside<br />of the potentially adversarial regulatory environment. The demands grow when the regulatory requirements for accountability, transparency, public accessibility, and technical rigor are added to the challenges. Moreover, models cannot be validated (declared true) but instead should be evaluated with regard to their suitability as tools to address a specific question. The committee concluded that these characteristics make evaluation of a regulatory model more complex than<br />simply comparing measurement data with model results. Evaluation also must balance the need for a model to be accurate with the need for a model to be reproducible, transparent, and useful for the regulatory decision at hand. Meeting these needs requires model evaluation to be applied over the “life cycle” of a regulatory model with an approach that includes different forms of peer review, uncertainty analysis, and extrapolation methods than for non-regulatory models.</i><br /><br />Their choice of terminology is unfortunate, validated generally doesn't mean true, it means understanding the degree to which a model is a suitable representation of the real world.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-24728341690101192862010-02-09T19:54:43.558-05:002010-02-09T19:54:43.558-05:00Updated ASME V&V guide published.<a href="http://engineers.ihs.com/news/2010/asme-vv20-fluid-dynamics-020510.htm" rel="nofollow">Updated ASME V&V guide published.</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-84270912161334141262010-02-09T08:29:59.928-05:002010-02-09T08:29:59.928-05:00The googlebot found this funding summary document ...The googlebot found <a href="http://fire.pppl.gov/fy11_doe_adv_sim_comp_camp.pdf" rel="nofollow">this funding summary document</a> for some of the DOE's nuclear weapons stockpile stewardship stuff, this paragraph on the 'predictive capabilities framework' is interesting:<br /><br /><i>The Predictive Capability Framework (PCF) is an integrated roadmap that reflects the responsive scientific capabilities needed to deliver a predictive capability to the nuclear security enterprise. Participants of the PCF include Defense Science, ASC, Engineering, DSW Research & Development, and Inertial Confinement Fusion Ignition and High Yield Campaign. The PCF identifies a list of long-term integrated goals and links the progress in the predictive capabilities to the progress in the five enabling capabilities, four of which (theory/model capabilities, code/algorithm capabilities, computational facilities, and Quantification of Margins and Uncertainties (QMU) and Verification & Validation (V&V) capabilities) are developed by the ASC program. With the pending completion of major new experimental facilities and entry into peta-scale high performance computing, the PCF represents a new phase of science-based stockpile stewardship – one better aligned to the challenges of an aging and changing stockpile.</i><br /><br />Even thought they can't do full-up testing anymore, experimental work is still a huge part of their understanding of the useful predictive capabilities of their (huge) simulations.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-79978292362916910452010-02-01T15:26:57.624-05:002010-02-01T15:26:57.624-05:00Interesting new journal: International Journal for...Interesting new journal: <a href="http://www.begellhouse.com/journals/52034eb04b657aea.html" rel="nofollow">International Journal for Uncertainty Quantification</a><br /><br />It might turn out to be pretty good, the associate editor is <a href="http://scholar.google.com/scholar?q=Dongbin%20Xiu" rel="nofollow">Dongbin Xiu</a>, who has some pretty good recent papers on using polynomial chaos expansions to do UQ.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-86957406140669218512010-01-30T10:21:47.885-05:002010-01-30T10:21:47.885-05:00"If error is corrected whenever it is recogni..."If error is corrected whenever it is recognized, the path of error is the path of truth." —Hans Reichenbach<br />From the banner on the <a href="http://pecos.ices.utexas.edu/" rel="nofollow">PECOS site</a>.<br /><br /><a href="http://pecos.ices.utexas.edu/pecos-hiring-several-postdoctoral-fellows/" rel="nofollow">They are also hiring</a>:<br /><i>...areas including Computational Engineering and Sciences, Turbulence Modeling and Optimal Experimental Design.</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-34447803580441391002010-01-23T14:07:07.428-05:002010-01-23T14:07:07.428-05:00NIST is putting on a conference in Boulder on Unce...<a href="http://www.nist.gov/itl/math/ifip-woco-10.cfm" rel="nofollow">NIST is putting on a conference in Boulder on Uncertainty Quantification, 1-4 Aug 2011</a>:<br /><i><b>Purpose</b>:<br />Computing has become an indispensable component of modern science and engineering research. As has been repeatedly observed and documented, processing speed measured in floating point operations per second has experienced exponential growth for several decades. These hardware efficiencies have been accompanied by innovations in mathematical algorithms, numerical software, and programming tools. The result is that, by any measure, the modern computer is many orders of magnitude more powerful than its early predecessors, capable of simulating physical problems of unprecedented complexity.<br /><br />Given the success of scientific computation as a research tool, it is natural that scientists, engineers, and policy makers strive to harness this immense potential by using computational models for critical decision-making. Increasingly, computers are being used to supplement experiments, to prototype engineering systems, or to predict the safety and reliability of high-consequence systems. Such use inevitably leads one to question <b>"How good are these simulations? Would you bet your life on them?"</b> Unfortunately, most computational scientists today are ill equipped to address such important questions with the same scientific rigor that is routine in experimental science.</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-36184792634724301862010-01-21T19:15:30.840-05:002010-01-21T19:15:30.840-05:00Interesting sounding post doc position at NREL:
Th...Interesting sounding <a href="http://www.cleantechrecruits.com/print_listing/?listing_id=5492" rel="nofollow">post doc position at NREL</a>:<br /><i>The successful candidate will perform research on the use of modern statistical techniques and participate in work with NREL scientists to analyze and control uncertainty and sensitivity in large geospatial and temporal data sets, laboratory data, mathematical models and simulations related to renewable energy and energy efficiency research and deployment.<br />[...]<br />A strong background in Uncertainty Quantification and Sensitivity Analysis. Experience in Validation and Verification and applying statistical analysis to scientific, engineering, energy resource, and/or atmospheric science data sets.</i>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-7494514907016728972010-01-19T07:52:46.054-05:002010-01-19T07:52:46.054-05:00NC State is putting on Verification and Validation...NC State is putting on <a href="http://continuingeducation.ncsu.edu/vandv/" rel="nofollow">Verification and Validation for Nuclear Systems Analysis: Workshop II</a>, May 24-28, 2010Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-80586958693086330932010-01-16T19:14:10.907-05:002010-01-16T19:14:10.907-05:00Dan Hughes has written a nice white-paper on Discu...<a href="http://models-methods-software.com" rel="nofollow">Dan Hughes</a> has written a nice white-paper on <a href="http://go2.wordpress.com/?id=725X1342&site=edaniel.wordpress.com&url=http%3A%2F%2Fdanhughes.auditblogs.com%2Ffiles%2F2007%2F02%2Fvandvandsqapost.pdf" rel="nofollow">Discussions of Application of Verification, Validation, and Quality Assurance Procedures to Climate Modeling Software</a>.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-52609749192919225992010-01-09T08:22:21.251-05:002010-01-09T08:22:21.251-05:00The reference list linked to the AIAA standard on ...The reference list linked to the AIAA standard on VV&UQ, here's the <a href="http://catalog.asme.org/Codes/PrintBook/VV_10_2006_Guide_Verification.cfm" rel="nofollow">ASME's similar standard</a> ($45), <a href="http://cstools.asme.org/csconnect/FileUpload.cfm?View=yes&ID=24816" rel="nofollow">an overview</a> is available as well (free).Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-8608841536652457262009-12-25T22:27:17.231-05:002009-12-25T22:27:17.231-05:00Description of the Sandia Validation Metrics Proje...<a href="http://prod.sandia.gov/techlib/access-control.cgi/2001/011339.pdf" rel="nofollow">Description of the Sandia Validation Metrics Project</a><br />ABSTRACT: This report describes the underlying principles and goals of the Sandia ASCI Verification and Validation Program Validation Metrics Project. It also gives a technical description of two case studies, one in structural dynamics and the other in thermomoechanics, that serve to focus the technical work of the project in Fiscal Year 2001.Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-3165940692159019022009-12-25T22:11:32.775-05:002009-12-25T22:11:32.775-05:00Software Failure Probability Quantification for Sy...<a href="http://syrexe.com/engineering/2009/163456.html" rel="nofollow">Software Failure Probability Quantification for System Risk Assessment </a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-76131730258575007122009-12-17T12:59:30.669-05:002009-12-17T12:59:30.669-05:00Polynomial regression with derivative information ...<a href="http://www.mcs.anl.gov/~anitescu/PUBLICATIONS/2009/roderick_FR09.pdf" rel="nofollow">Polynomial regression with derivative information in nuclear reactor uncertainty quantification</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-75457301942678673512009-12-11T20:18:21.369-05:002009-12-11T20:18:21.369-05:00In an age of spreading pseudoscience and anti-rati...In an age of spreading pseudoscience and anti-rationalism, it behooves those of us who believe in the good of science and engineering to be above reproach whenever possible. Public confidence is further eroded with every error we make. Although many of society’s problems can be solved with a simple change of values, major issues such as radioactive waste disposal and environmental modeling require technological solutions that necessarily involve computational physics. As Robert Laughlin noted in this magazine, “there is a serious danger of this power [of simulations] being misused, either by accident or through deliberate deception.” Our intellectual and moral traditions will be served well by conscientious attention to verification of codes, verification of calculations, and validation, including the attention given to building new codes or modifying existing codes with specific features that enable these activities. <br />--P.J. Roache, "<a href="http://portal.acm.org/citation.cfm?id=1018092" rel="nofollow">Building PDE Codes to be Verifiable and Validatable</a>", Computing in Science and Engineering, 2004Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.comtag:blogger.com,1999:blog-5822805028291837738.post-41344068679414120362009-12-11T19:36:00.513-05:002009-12-11T19:36:00.513-05:00A good account of the importance of experimental v...<a href="http://www.southcoasttoday.com/apps/pbcs.dll/article?AID=/20091211/OPINION/912110351/-1/NEWSMAP" rel="nofollow">A good account of the importance of experimental validation re:climate change</a>Joshua Stultshttps://www.blogger.com/profile/03506970399027046387noreply@blogger.com