40 likes | 160 Views
Properly Incenting Academia (or, how to resist quitting my day job). Mike Carey (UC Irvine) Beckman DB Self-Assessment Meeting October 2013. Our Field Has Contracted Metricitis. Then: What really cool things can I study and build? How (and when) should I disseminate my results?
E N D
Properly Incenting Academia(or, how to resist quitting my day job) Mike Carey (UC Irvine) Beckman DB Self-Assessment Meeting October 2013
Our Field Has Contracted Metricitis • Then: • What really cool things can I study and build? • How (and when) should I disseminate my results? • How useful does unit of work W seem to be? • What has been the overall impact of X’s work? • Now: • What can I write a paper on? • What (smallest piece of) work will be required? • How different does unit of work W seem to be? • What is X’s (i) paper count or (ii) H-index?
Let’s Look at a Case Study:XML Query Processing • I did some “XML time” in industry (1999-2008) • BEA offered XML-based data integration • Being “ex-research”, my team looked around for useful ideas to borrow and to implement • Lore (Jennifer et al), TIMBER (Jag et al) were very helpful (e.g., query algebras and approaches) • But not so much for the other 1000+ papers on QP inside the world’s biggest single XML document… (Apologies to anyone I’ve just offended with this caricature of the angle bracket situation … but ….)
Unfortunate Consequences • This has (badly) warped the academic culture • We no longer seem to evaluate impact ourselves • Instead, we count survivors of a reviewing process that many whine about as itself being random & broken (?!?) • We value quantity and (gratuitous) differences over quality or real potential usefulness • Other sciences value refinement and step-wise progress • But we would seem to prefer to keep making new stuff up • This also affects our product (student) pipeline • Impacts what agencies like NSF will fund • Impacts how students think about their primary goal • Discourages doing things that actually take some time • One aspect of which is making sure something is really feasible • Which seems especially dangerous in a smoke-and-mirrors discipline • Hopefully our case of Metricitis is not yet in Stage 4 ….