110 likes | 214 Views
Make Community Detection More Human. Motahhare Eslami Cutlure as Data Fall 2012. Groups (Communities, Clusters,…). Sociogram : to analyze choices or preferences within a group. Groups in structural terms:
E N D
Make Community Detection More Human MotahhareEslami Cutlure as Data Fall 2012
Groups (Communities, Clusters,…) • Sociogram: to analyze choices or preferences within a group. • Groups in structural terms: “whenever human association is examined, we see what can be described as thick spots— relatively unchanging clusters or collections of individuals who are linked by frequent interaction and often by sentimental ties. These are surrounded by thin areas—where interaction does occur, but tends to be less frequent and to involve little if any sentiment.”(Freeman[2]) An example of a social network diagram
Detecting Groups • Small networks • Sociograms are useful • Large Networks • TOO Big to know
Solution & Challenge • Using community detection algorithms • Ground-truthfor evaluation • BIG data will make having the Ground-truthhard/impossible • Evaluation Metrics other than Ground-truth • How evaluate evaluation metrics?! • Use different networks to compare selected algorithms
Different Networks Analysis • High modularity: dense connections between the nodes within modules but sparse connections between nodes in different modules
Evaluation • Questions • What if a group makes no sense?! -2 • What if a group is very large to revise? -1 • What if a group is the combination of two specific groups? -1 • What if a group is separated to two groups?-1 • What if you think this clustering work better?+1 • What if you find some interesting point about this clustering? +1
Future Work… • First of all: IRB approval! • Finding evaluation metrics correlation with our method accuracy by measuring them before & after applying our method • Establishing the online application • Designing more specific interview questions
References • Sociogram, http://en.wikipedia.org/wiki/Sociogram • http://www.6seconds.org/2012/05/08/sociograms-mapping-the-emotional-dynamics-of-a-classroom/->Image • FREEMAN, L.C., AND WEBSTER, C.M. (1994), "Interpersonal proximity in social and cognitive space,“ Social Cognition, 12, 223-247 • Large:http://www.ece.umd.edu/~wenjunlu/research.html • Fortunato, Santo. Community detection in graphs. Physics Reports 486.3 (2010): 75-174. • Lancichinetti, Andrea, Santo Fortunato, and Filippo Radicchi. Benchmark graphs for testing community detection algorithms. Physical Review E 78.4 (2008): 046110. • Han, Jiawei, and MichelineKamber. Data mining: concepts and techniques. Morgan Kaufmann, 2006.