1 / 26

META-ANALYSIS

META-ANALYSIS. Types of Meta-Analysis. Qualitative Quantitative. Quantitative Meta-Analysis Data Sources. Primary – the ideal data source Raw data Secondary: The data and conclusions presented in study reports / papers Tertiary:

jlevingston
Download Presentation

META-ANALYSIS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. META-ANALYSIS

  2. Types of Meta-Analysis • Qualitative • Quantitative

  3. Quantitative Meta-AnalysisData Sources • Primary – the ideal data source • Raw data • Secondary: • The data and conclusions presented in study reports / papers • Tertiary: • Distillations of the data and conclusions presented by the secondary sources

  4. Major Flaw in Existing Meta-Analyses • Depend on tertiary data (third-hand information) • Use extremely broad explanatory variable definitions • Generally have very low explanatory power • Coefficients frequently have confidence levels of less than 50%

  5. Literature Example Lipscomb, Mooney and Kilpatrick “Do Survey Results Systematically Differ from Hedonic Regression Results? Evidence From a Residential Property Analysis” - Forthcoming, Journal of Real Estate Literature

  6. Issues No comparison of results to actual market results

  7. Issues Only peer-reviewed papers used without a test for bias resulting from restricted data selection

  8. From the Paper

  9. From the Paper

  10. From the Paper

  11. Base Studies A number of the base studies used in the meta-analyses to date can be shown to be flawed

  12. Summary Quantitative Meta-analysis:Hedonic analysis of a regression model BUT Meta-analysis has significantly greater issues • Third-hand data • Low explanatory power • Low statistical significance of coefficients • Overly-broad variable definitions • Virtually complete lack of confirmation

  13. META-ANALYSIS IS NOT AND SHOULD NOT BE AN ACCEPTED APPRAISAL METHOD

  14. CONTINGENT VALUATION • CV • CVM • POTENTIAL BUYER SURVEYS

  15. DEFINITION • “According to the World Bank Institute (2002, p. 2), the CVM is a stated preference method used to estimate ‘‘the value that a person places on a good, usually one that is not sold in markets, such as environmental quality or good health.” Lipscomb, Clifford A., Max Kummerow, Will Spiess, Sarah Kilpatrick, John A. Kilpatrick, “Contingent Valuation and Real Estate Damage Estimation,” Journal of Real Estate Literature, Volume 19, Number 2, 2011.

  16. REASONS FOR DOING CVM • real estate is a market good • Argument for CVM based on the idea that those who purchased are ill-informed, imprudent, or plain foolish, and the prices paid do not fully reflect the impact of the issue • a CVM survey must be performed to determine how the market should have responded.

  17. Dr. Kinnard’s “dictum” has been stated as: “The best information may be found in transactions that did not occur.” The correct statement is: Possibly the best information might be found in failed sales of impaired property.

  18. COURT RULINGS • The courts do not agree • Melody Baker et al v Motorola, Inc, et al, Superior Court of the State of Arizona in and for the County of Maricopa, CV 92-02603 • Circuit Court for Baltimore County Case # 03-C-07-003809 IN THE COURT OF APPEALS OF MARYLAND No. 15 September Term, 2012 EXXON MOBIL CORPORATION v. THOMAS M. ALBRIGHT, et al.

  19. WHAT IS BEING MEASURED • COMPENSATING SURPLUS: • “That amount that would be required to make the property owner indifferent between remaining in the property with the issue, and moving to a property without the issue.” • Mundy, Bill and David McLean, “The Addition of Contingent Valuation and Conjoint Analysis to the Required Body of Knowledge for the Estimation of Environmental Damages to Real Property,” Journal of Real Estate Practice and Education, Volume 1, Number 1, 1998. {Referencing “The straightforward discussion of compensating surplus can be found in Mitchell and Carson (1990), p. 24.”}

  20. WRONG RESPONDENTS • All of the surveys to date use respondents chosen at random and not qualified with respect to specialized knowledge of the issue. • Surveys are normally less than ten minutes. • Respondents do not have time to fully consider the issues. • Respondents do not have time to consult other players

  21. LACK OF CONFIRMATION • CVM proponents have not tested the accuracy and reliability of their predictions. • The research by Roddewig and Frey noted error rates of 200% when compared to actual market performance

  22. TRIMMED MEAN • “This method {marginal bidder analysis} eliminates extreme bids and gives more weight to those bids closer to the middle of the bid distribution. This is a form of trimmed mean analysis, which eliminates outlier observations.” • Lipscomb, Clifford A., Max Kummerow, Will Spiess, Sarah Kilpatrick, John A. Kilpatrick, ibid.

  23. TRIMMED MEAN • The buyers and sellers have no interest in taking the “middle of the bid distribution” as a sale price. The seller wishes to maximize his price and only the top few bidders would be considered, all others bids being put in the circular file where the real market participants actually put them.

  24. NO BASELINE • Simons CVM studies of leaking gas stations provide an indicated discount. • HOWEVER, no base line to let us determine the discount for a gas station without a leak. • This is a common CVM problem.

  25. NOT AN APPROVED METHOD • Not in USPAP or Advisory Opinions or Guide notes • Not endorsed in AI training materials • Plenty of market data • Intended only for non-market data and then for amounts generally less than $50

More Related