1 / 11

Open Refine: Clean your messy data

Open Refine: Clean your messy data. Valrie Minson Outreach Librarian for Agricultural Sciences. OpenRefine. OpenRefine.org ( Google Refine) Open Source Runs locally on computer (privacy) Looks like Excel or Google Spreadsheets Data: clean it, transform it, extend it !.

hua
Download Presentation

Open Refine: Clean your messy data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Open Refine:Clean your messy data Valrie Minson Outreach Librarian for Agricultural Sciences

  2. OpenRefine • OpenRefine.org(Google Refine) • Open Source • Runs locally on computer (privacy) • Looks like Excel or Google Spreadsheets • Data: clean it, transform it, extend it!

  3. Excel: my messy data

  4. Data issues • Human/free-text errors • Inconsistent journal titles • Redundant citations • Data (volume/issue) in wrong fields • ARTICLES IN CAPS LOCK

  5. Data in Open Refine

  6. Use filters to edit data

  7. Faceted: journal titles by count

  8. Filtering/faceting • Use filters or facets to select subsets of data • Journal of Agriculture • Journ of Agriculture • Journla of Agriculture • Agriculture, Journal of • Not just for Messy data

  9. OpenRefine Expression Language (GREL) • Transform list into table (create columns) • Merge datasets • Export into Excel, CSV, OpenOffice, Google Spreadsheets, JSON, RDF, etc. • Use with other systems (Excel, SPSS, etc.) • Great videos

  10. OpenRefine.org Valrie Minson vdavis@ufl.edu

More Related