50 likes | 164 Views
Web Analysis: Algorithms for Locating and Analyzing Virtual Social Networks on the World Wide Web . Sun-Ki Chai University of Hawai`I http://www2.hawaii.edu/~sunki/. Web Analysis. Intelligent agent software for examining social structure of world wide web –
E N D
Web Analysis: Algorithms for Locating and Analyzing Virtual Social Networks on the World Wide Web Sun-Ki Chai University of Hawai`I http://www2.hawaii.edu/~sunki/
Web Analysis Intelligent agent software for examining social structure of world wide web – identify, demarcate, and analyzes virtual communities 1. intelligent, socially-informed crawling to identify virtual communities 2. automatic collection and compilation of site data - downloaded to dataset 3. analysis engine for calculating centralities, word frequencies, feedback to (1)
Interaction with Web Analysis 1. selection "seed sites" and / or identifying keywords 2. selection of crawling algorithm - some combination of links-in and/or links-out centrality and keyword matching for "admittance score" of linked sites 3. selection of intrasite filtering and overall halting criteria intrasite - depth of crawl, exclude cgi overall halting - size of dataset 4. let it run - it incrementally expands set, generates new keywords 5. Draws information from crawls of sites, available registration info, search engines, online databases 6. analyze downloaded dataset
Web Analysis Output (cont.) %URL http://boycotts.org/ %TITLE Boycott Action News %CONTACT Co-Op America, 1612 K Street N.W., 600, Washington, DC 20006 US, (301) 881-4900, patr@crcwnet.com %DESCRIPTION Co-op America's "tell it like it is" information about corporations that need to be made more accountable. %CATEGORIES Society / Issues / Business / Corporate Accountability, News / Current Events / Business and Economy / Business and Society / Business Ethics %RELATED: http://www.ceres.org/, http://www.bts.gov/ntda/oai/, http://www.betterworld.com/BWZ/9604/welcome.htm/, http://www.asyousow.org/, http://shareholderaction.org/, http://adbusters.org/campaigns/corporate/flash.html/, http://www.censorshipkills.com/, http://www.bitc.org.uk/ . . . %WORDFREQ: 221,"the“, 147,"to“, 120,"and“, 109,"of“, 74,"boycott“, 62,"in“, 59,"a“, 55,"by“, 55,"that“, 40,"products“, 34,"contact“, 34,"workers“, 34,"www“, 33,"information“, 33,"is“, 32,"has“, 32,"web“, 31,"site“, 31,"target“, 30,"company“, 30,"its“, 30,"made“, 29,"phone“, 27,"org“, 26,"com“, 25,"for“, 25,"organizers“, 24,"with“, 23,"consumer“, 23,"from“, 23,"not“, 22,"action“, 22,"email“, 20,"consumers“, 20,"world“, 19,"as“, 19,"being“, 19,"have“, 19,"on“, 18,"allegations“, 18,"boycotted“, 18,"fax“, 18,"organizer“, 17,"inc“, 17,"requested“,17,"tobacco“ . . .