get all existing movie ids

1. Legend: S Datasource Fetcher Datasource Fetcher datasource fetcher <program module> start / end point S E E E E E E E E get all existing movie ids <query source> push <db access> datasource id list datasource id list <merging> datasource id heap pop <work lists> Freebase Updater more eggs Freebase Updater independent parts S datasource mapper datasource updater fetch movie from source Raw DB record in raw DB? update record create record no yes update Prov-O create Prov-O yes no no yes record changed? enqueue URI for merger push RawDB URI heap pop Map DB map record to own ontology create same-as refs fetch record merger S push URI matching URI heap new raw record? push URI pop URI matcher matcher S Main DB update matching record search for matching record fetch record from Main DB update Prov-O found matching record? search for matching record yes no found matching record? create new main record merge into main record yes no update Prov-O create Prov-O re-add URI to heap change same-as ref to match create same-as refs move record: Main DB to Map DB delete Map DB record