210 likes | 445 Views
The EP-INV- Patstat db and preliminary results. Andrea Maurino DISCo - Dip. di Informatica, Sistematica e Comunicazione Universit à di Milano Bicocca viale Sarca 336/14, 20124, Milano (Italy ). Index. APE-INV project EP-INV- PatStat Feedback Web application Preliminary results
E N D
The EP-INV-Patstat db and preliminary results Andrea Maurino DISCo - Dip. di Informatica, Sistematica e ComunicazioneUniversità di Milano Bicoccaviale Sarca 336/14, 20124, Milano (Italy)
Index • APE-INV project • EP-INV-PatStat • Feedback Web application • Preliminary results • Ongoing works ••• ITIS Lab •••http://www.itis.disco.unimib.it
A preliminary truth • The world is dirty! • and • Real world data are dirty! • A mandatory and prelimnary task before to realize any analysis or statistic is • Clean your data ••• ITIS Lab •••http://www.itis.disco.unimib.it
Disambiguation of academic inventors: ESF-APE-INV www.academicpatenting.eu Project chair: Francesco Lissoni (uniBocconi) Technical Manager: Andrea Maurino (uniMiB) Project steps: • Reclassification of all patents by inventor (INV) • Matching between inventors and academic scientists (APE) • Results expected: To produce a freely-available database of “Academic Patenting in Europe” ••• ITIS Lab •••http://www.itis.disco.unimib.it
EP-INV-PatStat PATSTAT_PUBL_NR • PATSTAT_APPL_ID INVENTORS_INFO DISAMBIGUATION ••• ITIS Lab •••http://www.itis.disco.unimib.it
Which is the part of PatStat interested by disambiguation? Users should not consider these tables, SUBSTITUTIVE TABLES with disambiguated inventors and inventors information are provided by APE-INV project Source: PatStat documentation
INVENTORS_INFO • INVENTORS_INFO table • CODINV2 • NAME-SURNAME • COUNTRY / GCOUNTRY • STATE • REGION / GREGION • COUNTY / GCOUNTY • CITY / GCITY • STREET / GSTREET • ZIP / GZIP • LONGITUDE • LATITUDE • GACCURACY • Fields preceded by letter G are the result of Google-based standardization algorithm, all the other fields are cleaned PatStat addresses (eg. CITY and GCITY) • We report Google information only when GACCURACY is larger than or equal to 6 (i.e. Address is available at the level of Street).
From APE-INV to PatStat, PATSTAT_PUBL_NR and PATSTAT_APPL_ID In order to connect DISAMBIGUATION and INVENTORS_INFO tables with PatStat dataset we include in the repository other two tables: • PATSTAT_PUBL_NR • allows to link each inventor (as identified by the CODINV2 code in the APE-INV dataset) to her granted patents (PUBLN_NR). • PATSTAT_APPL_ID • Allows to identify the APPLN_ID corresponding to each PUBLN_NR (NB In the specific case of EP patents there is a one-to-one correspondence between APPLN_ID and PUBLN_NR). • The table reports also the information of the PatStat edition the APPLN_ID refers to.
DISAMBIGUATION.txt • DISAMBIGUATION table • CODINV2: is a stable key generated within the APE-INV project. It identifies uniquely any distinctive combination of inventor and address • CODINV: is a code associated to each CODINV2 after applying the disambiguation procedure. If two or more distinct CODINV2s are found to be the same person, they are assigned the same CODINV
Feedback web application ••• ITIS Lab •••http://www.itis.disco.unimib.it
Why sharing data • Instead of looking for one golden algorithm, APE-INV proposes data dissemination and users’ feedback recording • 2 kinds of users: • Take the data and run (dissemination only): they use the data in their studies a-critically. No benefit for the project, risky for them (data are disambiguated according to the state-of-the-art of dissemination techniques, but we can always do better..). • Critical users (dissemination+feedback): they use the data, usually sub-samples of the whole dataset, and have the possibility to increase the data quality: • Hand checked data and survey work on smaller samples • Algorithms fitting better sub-sample specificities (es. Country, firm, technological field) • Data sources external to PatStat helping the disambiguation effort ••• ITIS Lab •••http://www.itis.disco.unimib.it
How does data dissemination work? • Access http://www.ape-inv.disco.unimib.it/ with id and password • Choose the country(s) of inventors you need (eg. My research is on Italian inventors) • Get the EP-INV dataset and the CONTROVERSY.txt Query results in txt format.
Some results ••• ITIS Lab •••http://www.itis.disco.unimib.it
Ownership distribution of academic patents lower bound estimates
Ownership distribution of academic patents, upper bound estimates
Ongoing works ••• ITIS Lab •••http://www.itis.disco.unimib.it
Temporal Record linkage • “Pantarei” (Heraclitus) everything flows, everything is constantly changing. • Database may keep trace of these never ending changes • Examples • People change names • Xin Dong Xin Luna Dong • People change works • Havely moves from Univ. of Wa. to Google • Nations change • YUGOSLAVIA Serbia-Montenegro Serbia Kosovo • Based on the paper P. Li, X.L.Dong, A.Maurino, D.Scrivistava, linking temporal data, VLDB 2011 ••• ITIS Lab •••http://www.itis.disco.unimib.it
Experimental Evaluation • Effectiveness test: • Data set: patent data, 1871 records, 359 entities, in 1978-2003 • Comparison: three existing algorithms, w./o. decayed similarity
Thanks! 疑问 ••• ITIS Lab •••http://www.itis.disco.unimib.it