320 likes | 332 Views
Surveying the Social Landscape. Ontologies, Social Networks, and Analytic Challenges. Kimberly Glasgow Senior Technical Engineer, CACI kglasgow@caci.com. Overview. Understanding fundamental SNA concepts What’s a Network? What do you do with it? Analytic methods
E N D
Surveying the Social Landscape Ontologies, Social Networks, and Analytic Challenges Kimberly Glasgow Senior Technical Engineer, CACI kglasgow@caci.com 1 December 2006
Overview • Understanding fundamental SNA concepts • What’s a Network? • What do you do with it? • Analytic methods • How might ontology fit in? • How can the two help address intelligence challenges? 1 December 2006
Hypothetical task • Analysis of an imaginary terrorist group 1 December 2006
Imaginary group - “Sword of Allah Jihadi’s Brigade” • Background • Predominantly Middle Eastern terrorist group • Religious extremism • Loose affiliation with al Qaeda • Training camps • Threat to U.S personnel, business interests throughout region • Goal • Disrupt financial network • Identify key individuals • Confidence • Measure of effectiveness 1 December 2006
Imaginary Background on “Sword of Allah Jihadi’s Brigade” Ahmed al-Yemeni, and Yasin al-Yemeni (believed to be brothers, or possibly, cousins) are among those who have supplied currency, in varying amounts of USD to Ahmed Salman, who has also been supported by several others in the SAJB, such as Ahmed Yasin and Salman. Notably, the transfer of funds from Ahmed al-Yemeni may be largest amount (possibly $1400) known to have taken place in SAJB in recent years. Some of this funding may also have been used to enable Ahmed Ali’s activities, probably using Mustafa as a conduit for funds. Support has flowed to Salman Ali, known to have attended a training camp at the same time as both Ahmed Salman, and Salman Said, from a number of sources, including Ahmed Zayman, Salman Salman, and Salman Muhammad, though the amounts or even denominations involved in these activities remains incompletely understood. Yasin has supplied at least $500 to Ahmed Ali, who has in turn funded Salman Hakin, and possibly also provided fraudulent documentation, which he in turn may have gone to Ahmed Yasin, though this cannot be confirmed… 1 December 2006
Fund Source Recipient Amt Salman AhmedSalman ? Ahmed SalmanSayyid >2000 unk denomination Yasin AhmedAli 500USD Zayman SalmanSalman ? Ali Salman_al-Yemeni poss 15K riyals Muhammad AhmedAli 1 Mustafa AhmedAli 35 unk denom Hakim AhmedAli ? Sayyid Hakim <300 USD Salman_al-Yemeni YasinSalman 600-900 unk denm SalmanSalman SalmanAli ? 1 December 2006
SAJB – Financial Support Network Centrality Metric • Support From: • 4 or more • 2-3 • 1 • 0 1 December 2006
SAJB – Financial Support Network 1 December 2006
Challenges • Data • Too much, too fast, too many kinds • Bias • Information • Entities • Representation, normalization, coreference • Relations • Analytic • Methodology • Completeness • Inference • Retrieval 1 December 2006
What’s a network? 1 December 2006
Another network 1 December 2006
Another network 1 December 2006
Last one 1 December 2006
Global Future of Terrorism ..”U.S. counterterrorist policies are tailored to combat what we believe to be the shifting trends in terrorism. One trend is the shift from well-organized, local groups supported by state sponsors to loosely organized, international networks of terrorists..” Patterns of Global Terrorism, 2000 1 December 2006
The Networked Future of Crime “.. criminal organizations and networks based in North America, Western Europe, China, Columbia, Israel, Japan, Mexico, Nigeria, and Russia will expand the scope and scale of their activities. They will form loose alliances…corrupt leaders..insinuate themselves into troubled banks and businesses…” Global Trends 2015, Nat’l Intelligence Council 1 December 2006
A network is.. Anything that can be represented as • Actors (nodes, vertices, entities) joined together by • Relationships (edges, ties, links, arcs) Note: • Actors are commonly people (groups, organizations, companies, nations) • Relationships possess an element of choice (non-random) • Work, friendship, kinship, orders, support, communication… Remember the “S” in SNA 1 December 2006
High level view of SNA • Scientific, mathematical means to study networks of connected individuals (or organizations) • Kinship, friendship, exchange, sex • Group survival, individual success, spread of disease • Business consulting- networks and bottom line • Health and Social Policy • AIDS, sex and drug networks, social support, education… • Intelligence, Homeland Security, Law Enforcement 1 December 2006
History • Jacob Moreno (1889-1974) • leading psychotherapist, theorist founder of Sociometry • pioneer of Group Psychotherapy • Stanley Milgram • “Six Degrees of Separation” • Watts and Strogatz • Network model to generate “small world” graphs • Barabasi • Scale-free, preferential attachment, P(k) =Ak−γ 1 December 2006
SNA Basics • Emerged from • Sociology • Graph Theory • Statistics… • Quantify social relations • Data represented as matrices • Algorithms (it’s all about the metrics) • Properties of networks • Structure • Position • Subgroups 1 December 2006
What can you do with a matrix? • Add, subtract, multiply, divide • Symmetrize, dichotomize, transpose, reverse In other words, perform any operation that turns your information into a more accurate representation of the phenomenon you’re analyzing = Incredible flexibility Unfortunately, no one can be told what the Matrix is. You have to see it for yourself. -Morpheus 1 December 2006
How can you analyze a social network? • Network level measures • Basic statistics – how big, how many • Density, distance – how well connected • Subgroup measures • Identify, characterize locally dense regions of the graph • Individual measures • Centrality – prominence, prestige All ways to answer sociologically meaningful questions about networks 1 December 2006
Ontology • Flexible, extensible way to represent knowledge about the world • Can evolve as intelligence needs change • Computationally tractable • Richer than taxonomy • Better suited to modeling social phenomena 1 December 2006
How does ontology fit in? • Rigor of creating an ontology for a given domain • clarifies thinking • Exposes knowledge gaps, assumptions • Automation of knowledge creation • Inference new facts from • Existing (individual facts) • Multiple facts • Improved accuracy and completeness of information • Enhanced query and retrieval capabilities • query at a humanly meaningful level 1 December 2006
An ontology of social relations • Social interactions • What we do with or to each other • Social perception • What we think or feel about others • Social roles • Kinship 1 December 2006
Inner World, Outer World • Behaviors and interactions • Power and authority • Communication • Support • Business • Sexual • Knowledge/beliefs/emotions • Cognitive • Affective 1 December 2006
Is it easy? 1 December 2006
Basic Emotions 1 December 2006
Is it easy? . No Organize and prioritize based upon customer’s decision-making needs 1 December 2006
Why care about social networks? • Fundamentally different way of representing and understanding targets • “six degrees of separation” • Enabling unique and powerful kinds of analysis Way to survey, interpret, share information about the social landscape 1 December 2006
Why care about ontologies wrt social networks? • Way to store structured information about what’s true about the social world we care about • “Knows” what we know • In a way that’s useful to humans • Integrating different types of data • And we can ask them cool questions Way to store, inference, retrieve, share information about the social landscape 1 December 2006
In summary • SNA is a fundamentally different way of representing and understanding the world • Networks • Subgroups • Individuals • Enables unique and powerful kinds of analysis to meet intelligence needs • Challenging information demands greatly enabled and enhanced by ontology 1 December 2006
Questions? 1 December 2006