1 / 30

Markus Schranz schranz@infosys.tuwien.ac.at

Pushing the Quality Level in Networked News Business semantic-based content retrieval and composition in international news publishing. Markus Schranz schranz@infosys.tuwien.ac.at. Problem and Project Description Goals and Objectives Approaches and Results

vanna-wilkinson
Download Presentation

Markus Schranz schranz@infosys.tuwien.ac.at

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Pushing the Quality Level in Networked News Business semantic-based content retrieval and composition in international news publishing Markus Schranz schranz@infosys.tuwien.ac.at

  2. Problem and Project Description Goals and Objectives Approaches and Results Architectural Design & Communication Multinational and Multilingual Services Semantic Content Relations Future Steps and Exploitation Agenda

  3. Environmental Situation problem description • Internet gains in importance in the news distribution area • Large amount of distributed business information is available • European business today is highly segmented and widely unrecognised beyond national borders • Business news mostly bear national relevance but hold the potential to spread cooperation opportunities and business chances towards an economically and socially integrated Europe. • Business is global  news need to beSupport for old and new economy within entire Europe is required; Appropriate solution beneficial for business in the EU, with special focus on the support and the integration of new member states

  4. Existing approaches problem description • National solutions available • Business News Distribution Service in German speaking area • Increasing interest from both • Subscribers • Press distributors within the existing services for multinational solutions • Limitations • Single language limitation • Not attractive for European companies to join

  5. project description Objectives • NEDINE has been EC-funded (Apr 2004-Apr2006). The objective of the project is to establish a distributed news network, aimed at European journalists and opinion leaders. • NEDINE provides participants with a network for news exchange and distribution. It supports mutual awareness of relevant topics and information content within all European countries. • NEDINE focuses on the availability and affordability for all partners to transport national information to the addressed target group, regardless of the origin, nationality and financial capability of the information provider.

  6. project description The Challenge Austrian reader Austrian NA Czech reader Czech NA Small CompanyGood product Slovakian NA Slovakian reader

  7. project description • News agency offers to its readers: • Multilingual news • International news • From various sources • (Semantic) Relationships independent from source • Relevance ranking for search The Solution • News agency offers to its customers: • Single access point for international press releases • Distribution • Payment • Editing / Translation • Price advantage compared to collection of single press releases Austrian reader Austrian NA Czech reader Czech NA • News agency benefits from the nedine network: • Common business model • Additional customers • more revenues • new contacts • international presence Small CompanyGood product Slovakian NA Slovakian reader

  8. First Approach – Centralized Architecture Pro‘s: Single maintenance point Clear infrastructure One traffic channel (News agency  NEDINE) No additional infrastructure required for Partners Con‘s: Single point of failure (whole network down) Huge amount of network traffic Storage of complete articles Which organization maintains the central server? Architecture Reasoning approaches and results

  9. centralized configuration approaches and results ČIA SITA Web Service Interface NEDINE Central Server PTE

  10. Alternative Approach – Hybrid P2P - Architecture Why Peer - to - Peer? Better scalability No single point of failure No downtime if central services are down Less network traffic Network remains transparent for the peers (they only see Nedine) Architecture Reasoning approaches and results

  11. Final Approach – Hybrid P2P - Architecture Properties of this Architecture: Democratic System Identical software components are installed at each partner Nedine becomes a logically centralized platform Nedine is technically distributed to the view of all participating peers Semantic relations and necessary steps for news distribution are done in a local context approaches and results

  12. P2P configuration approaches and results NEDINE Peer NEDINE Peer ČIA SITA NEDINE Peer Web Service Interface Virtually Central Services PTE

  13. Communication: Peer  Agency Web Services as the communication protocol Standard Interfaces for default peers (SOAP, NewsML Data transfer, Queries, Network Data) Customized interfaces for each partner, if necessary (database access based on document ID) Location and functionality of the NEDINE-peer is defined in the corresponding WSDL-file Functionality is only visible by the local peer, which increases network security approaches and results

  14. Inter - Peer - Communication Implemented also by XML Web Services Inter – peer communication is invisible to the agencies High flexibility, easy to upgrade/change – doesn’t influence the rest of the network Network traffic is encrypted via PKI (Private-Public-Key Infrastructure) approaches and results

  15. Multinational and Multilingual Services Multinational Service Integration Standardized news exchange formats  NewsML Local Service to Peer communication  SOAP local service providers hold business critical information installation of a local peer with well-known (open) source increases trust of the participating organizations and underlines the local character of the relevant business data Peer-to-Peer communication SOAP approaches and results

  16. Multilingual News Publishing and Distribution Automatic Translation ? Multilingual content presentation ? Multilingual information distribution & retrieval Semantic relations between the (multilingual) business news contents approaches and results

  17. Pushing the Quality Level by Semantics International news describe local business and lack relevant interrelations “Linking” between sensible business news has been manual work and thus costly Semantic relationships increase business value of news items, but how to create with reasonable effort? Semantic News Enrichment approaches and results

  18. The Vector Space Engine Vectors are assigned to every news article representing keyword occurrences (weights) Vectors are technically small portions of data, feasible to integrate in peer component Semantic relationships increase business value of news items Automatically recognize similarities by creating a vector space on relevant keywords approaches and results

  19. approaches and results • What is a keyword? • all words (except stopwords) • relevant words • from frequencies • with weights (vector space model) • from the domain • How does a keyword look like? • A word : bodies • A stem : bodi • A lemma : body • A phrase : public bodies

  20. approaches and results Document - Stemming and/or - PN Detection and/or - N-Gram Detection … Query Query Q = (wq1,…,wqn) Query Processing Document Processing Matching D = (wd1,…,wdn) - Stemming and/or - PN Detection and/or - N-Gram Detection … Document

  21. approaches and results • Vector Space Model combined with statistic and linguistic processing. • Statistical metrics included are: • tfij = Term frequency for word i in document j • IDFi = Inverse Document Frequency for word i in the whole document collectionIDFi = 1 + • wij = tfij *IDFi N = Total documents dfi = Document Frequency for term i

  22. Vector Space Model approaches and results • Documents are indexed by vectors • Documents are retrieved by similarity • Query and Documents are compared using the cosine formula: Sim(Q,D) = • Local archives must provide term frequency data (internal and document)

  23. Preprocessing of texts NEWS Document Vectors The used model approaches and results Statistical process Metadata information Linguistic Processing Taggers and Stemmers Proper Names Heuristics Syntactic patterns Semantic resources (EWN)

  24. Use case: distributing news in Czech republic and in AustriaČIA CZ, DE approaches and results NEDINE Peer NEDINE Peer 1. Distribution &Enrichment SITA (SK,EN) ČIA (CZ,DE,EN) 4. 5. CZ,DE Subscriber 2. Enrichment (DE) 3. NEDINE Peer PTE (DE,EN) 6. 7. DE Subscriber

  25. Recent developments and open issues Nedine has been extended with translation services (additional service on P2P architecture) Secure communication infrastructure has been implementation Performance and scalability tests Market & Business orientation  Nedine Association has been funded end 2005 Future Exploitation

  26. Have a look at NEDINE, we are • open to recommendations, news providers • and partners from all over Europe. • Website http://www.nedine.org/ • E-Mail info@nedine.org • Nedine Contact Person: Dr. Markus Schranz • Tel. ++43-1-81140-444, schranz@pressetext.at Good News from Europe

More Related