1 / 43

Ron S. Kenett

Relative Linkage Disequilibrium: An intersection between evolution, algebraic statistics, text mining and contingency tables. Ron S. Kenett KPA Ltd., Raanana, Israel and Department of Statistics and Applied Mathematics "Diego de Castro", University of Torino, Italy in collaboration with

nerys
Download Presentation

Ron S. Kenett

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Relative Linkage Disequilibrium: An intersection between evolution, algebraic statistics, text mining and contingency tables Ron S. Kenett KPA Ltd., Raanana, Israel and Department of Statistics and Applied Mathematics "Diego de Castro", University of Torino, Italy in collaboration with Silvia Salini Department of Economics, Business and Statistics, University of Milan, Italy

  2. Outline Graphical Displays Evolution “Algebraic Statistics” Contingency Tables Text Mining

  3. Evolution Background 1930 - 1975 Linkage Disequilibrium The Fundamental Theorem of Natural Selection: “the rate of increase of fitness of any organism at any time is equal to its genetic variance at that time” R.A. Fisher Sam Karlin FISHER, R. A. 1930, The Genetical Theory of Natural Selection. Clarendon, Oxford, U.K.. LEWONTIN, R., and KOJIMA, K., 1960, The evolutionary dynamics of complex polymorphisms. Evolution 14: 458-472. KARLIN, S . and FELDMAN, M., 1970, Linkage and selection: Two locus symmetric viability model. Theoretical Population Biology 1 : 39-71. KARLIN, S., 1975, General two-locus models: some objectives, results and interpretations. Theoretical Population Biology 7 : 364-398. KARLIN,S . and KENETT, R. 1977, Variable Spatial Selection with Two Stages of Migration and Comparisons Between Different Timings, Theoretical Population Biology, 11, pp. 386-409.

  4. Contingency Tables Background - 1975 Discrete multivariate analysis: theory and practice “The first comprehensive treatise on the analysis of categorical data using loglinear and related statistical models…”

  5. Graphical Display Background - 1983

  6. Algebraic Statistics Background - 2008

  7. Text Mining 254 itemsets:The “e” relationship 57 ……….. female…………..infection………………… 40 ……….. female……………………..………………… 109 ……….. ……….…………..infection………………… 48 ……………..………………………….……..…………

  8. RHS ^RHS LHS RHS ^RHS ^LHS Contingency Tables The Data

  9. Contingency Tables “…a man who has carefully investigated a printed table, finds, when done, that he has only a very faint and partial idea of what he has read; and that like a figure imprinted on sand, is soon totally erased and defaced.” William Playfair (1786), The Commercial and Political Atlas, from Edward R. Tufte (1983), The Visual Display of Quantitative Information.

  10. Graphical Display The Simplex x3 x1 x2 x4

  11. Graphical Display The Simplex

  12. Two loci, two alleles each, four genotypes: AB, Ab, aB, ab “Algebraic Statistics” Linkage Disequilibrium D can be extended to more dimensions…

  13. “Algebraic Statistics” Linkage Disequilibrium An algebraic observation…

  14. “Algebraic Statistics” Relative Linkage Disequilibrium D is the distance from the point corresponding to the contingency table in the simplex, to the surface D=0 in the ee direction. DM is the distance from the point corresponding to the contingency table on the surface D=0 in the ee direction, to the surface of the simplex, in that direction.

  15. Graphical Display

  16. Contingency Tables RLD Example RLD

  17. Text Mining Association Rules • Association rules are one of the most popular unsupervised data mining methods used in applications such as Market Basket Analysis, to measure the associations between products purchased by each consumer, or in web clickstream analysis, to measure the association between the pages seen (sequentially) by a visitor of a site. • Mining frequent itemsets and association rules is a popular and well researched method for discovering interesting relations between variables in large databases. The structure of the data to be analyzed is typically referred to as transactional. • Once obtained, the list of association rules extractable from a given dataset is compared in order to evaluate their importance level. The measures commonly used to assess the strength of an association rule are the indexes of support, confidence, and lift.

  18. Text Mining Support • The support for a rule A => B is obtained dividing the number of transactions which satisfy the rule, NA=>B, by the total number of transactions, N. support {A=>B} = NA=>B / N

  19. Text Mining Support The higher the support the stronger the information that both type of events occur together. support {A=>B} = {NA=>B / N}= x1

  20. Text Mining Confidence • The confidence of the rule A => B is obtained by dividing the number of transactions which satisfy the rule, NA=>B , by the number of transactions which contain the body of the rule, A. confidence {A=>B} = NA=>B / NA

  21. Text Mining Confidence A high confidence that the LHS event leads to the RHS event implies causation or statistical dependence. confidence {A=>B} = {NA=>B / NA}= x1/g

  22. Text Mining Lift • The lift of the rule A => B is the deviation of the support of the whole rule from the support expected under independence given the supports of the LHS (A) and the RHS (B). lift {A=>B} = confidence{A=>B} / support{B} = support{A=>B}/support{A}support{B}

  23. Contingency Tables Relative Linkage Disequilibrium and other measures RLD Sup = 57/254 = .224 Conf = 57/97 = .588 Sup (RHS) = 166/254 = .654 lift = .588/.654 = .90

  24. Association Rules The groceries example First 20 rules for groceries data, sorted by Lift

  25. Association Rules The groceries example For “Lift” > 2.5, RLD varies between 1%-40% RLD Lift Plot of Relative Disequilibrium versus Lift for the 430 rules of groceries data set

  26. Association Rules The groceries example

  27. Association Rules The groceries example RLD shows more variability than “support” RLD Support Plot of Relative Disequilibrium versus Support for the 430 rules of groceries data set

  28. Association Rules The groceries example For RLD of 20%, “Confidence” varies between 1%-40% RLD Confidence Plot of Relative Disequilibrium versus Confidence for the 430 rules of groceries data set

  29. Association Rules The groceries example First 20 rules for groceries data, sorted by Lift

  30. Association Rules The groceries example For “Lift” > 2.5, RLD varies between 1%-40% RLD Lift Plot of Relative Disequilibrium versus Lift for the 430 rules of groceries data set

  31. Association Rules The groceries example RLD ChiSquared Plot of RLD versus Chisquare for the top 20 rules of groceries data set, sorted by RLD

  32. Association Rules The groceries example RLD Odds Ratio Plot of RLD versus Odds Ratio for the top 20 rules of groceries data set, sorted by RLD

  33. Summary • RLD is intuitive • RLD yields different answers from “usual” measures • RLD can be extended to higher dimensions • There are opportunities in considering the relationship between Association Rules and Contingency Tables

  34. Graphical Displays Evolution Algebraic Statistics Contingency Tables Text Mining

  35. References • Bishop, Y.M. M., Fienberg, S.E. and Holland, P.W. (1975). Discrete Multivariate Analysis: Theory and Practice. M.I.T. Press, Cambridge, MA. Paperback edition (1977). Reprinted, by Springer-Verlag, New York (2007). • Fisher, R. A. (1930). The Genetical Theory of Natural Selection. Clarendon, Oxford, U.K.. • Hahsler, M., Grun, B., and Hornik, K. (2005). arules – A computational environment for mining association rules and frequent item sets. Journal of Statistical Software, 14(15):1–25. ISSN 1548-7660. URL http://www.jstatsoft.org/v14/i15/. • Karlin, S. and Feldman, M. (1970). Linkage and selection: Two locus symmetric viability model. Theoretical Population Biology 1 : 39-71. • Karlin, S. and Kenett, R.S. (1977). Variable Spatial Selection with Two Stages of Migration and Comparisons Between Different Timings, Theoretical Population Biology, 11, pp. 386-409. • Kenett, R. (1983). On an Exploratory Analysis of Contingency Tables. The Statistician, 32, pp. 395-403. • Kenett, R. and Salini, S. (2008). Relative Linkage Disequilibrium: A New measure for association rules UNIMI - Research Papers in Economics, Business, and Statistics http://services.bepress.com/unimi/statistics/art32/ • Lewontin, R,. C., and Kojima, K. (1960). The evolutionary dynamics of complex polymorphisms. Evolution 14: 458-472. • Omiecinski, E. (2003). Alternative interest measures for mining associations in databases. IEEE Transactions on Knowledge and Data Engineering, 15(1):57–69. • Piatetsky-Shapiro, G. (1991). Discovery, analysis, and presentation of strong rules. In: Knowledge Discovery in Databases, pages 229–248. • Shimada, K., Hirasawa K, and Hu J. (2006) Association Rule Mining with Chi-Squared Test Using Alternate Genetic Network Programming, ICDM2006. • Tan, P-N, Kumar, V., and Srivastava, J. (2004). Selecting the right objective measure for association analysis. Information Systems, 29(4):293–313.

  36. Backup slides

  37. Association Rules The telecom systems example

  38. Association Rules The telecom systems example Item FrequencyPlot (Support>0.1) of telecom data set

  39. Association Rules The telecom systems example 3D Simplex Representation for 200 rules of telecom data set and for the top 10 rules sorted by RLD

  40. Association Rules The telecom systems example 2D Simplex Representation for the top 10 rules sorted by RLD of telecom data set

  41. Association Rules The telecom systems example Top 10 rules sorted by RLD of telecom data set

  42. Contingency Tables RLD Statistical Properties

  43. Contingency Tables RLD Statistical Properties

More Related