1 / 3

UBICOMP ‘01 A Hybrid Evaluation Approach for Ubiquitous Computing Environments

UBICOMP ‘01 A Hybrid Evaluation Approach for Ubiquitous Computing Environments Mark Burnett, Chris Rainsford DSTO, Australia. Typical Characteristics. Quantitative. Qualitative. Target Problem. Well defined, agreed metrics. Loosely defined, new, unknown metrics. Pros.

jewell
Download Presentation

UBICOMP ‘01 A Hybrid Evaluation Approach for Ubiquitous Computing Environments

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. UBICOMP ‘01 A Hybrid Evaluation Approach for Ubiquitous Computing Environments Mark Burnett, Chris Rainsford DSTO, Australia

  2. Typical Characteristics Quantitative Qualitative Target Problem Well defined, agreed metrics. Loosely defined, new, unknown metrics Pros Well defined outcomes, easy to compare candidates Allows exploration, encourages diversity, human subjectivity allowed. Cons Narrow focus, does not accommodate human subjectivity. Not well defined, hard to compare candidates, inconclusive. Evaluation Outcomes Improved performance Discovery of new approaches, identification of strong points Types of Evaluation TREC PKDD What’s the equivalent of ROBOCUP for a ubicomp environment?

  3. suggests hybrid of qualitative and quantitative approaches A Hybrid Evaluation Framework Environment: • Ubiquitous/pervasive ·Invisible ·Connected ·Context-aware How to evaluate a ubiquitous computing environment? • choose a well-defined environment, for example a smart room • choose some well-defined tasks for a hybrid evaluation What to evaluate in a ubiquitous computing environment? • software infrastructure and services in support of a task • participants can build their own smart room (devices+infrastructure+s/w)

More Related