1 / 4

SysML World Cup?

SysML World Cup?. Purpose? Unleash ML researchers to solve systems problems? Frame the problems more rigorously? Shape some benchmarks to shape the field? Win the prize? Who will play?. Peter Bonik, Jeff Chase, Nitesh Chawla, Rebecca Isaacs, Emre Kiciman. Why a new game?.

ceana
Download Presentation

SysML World Cup?

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SysML World Cup? • Purpose? • Unleash ML researchers to solve systems problems? • Frame the problems more rigorously? • Shape some benchmarks to shape the field? • Win the prize? • Who will play? Peter Bonik, Jeff Chase, Nitesh Chawla, Rebecca Isaacs, Emre Kiciman

  2. Why a new game? • There are existing annual “cup” challenges in the ML community. • KDD • Why not offer “packaged” systems challenges to KDD cup? • Would meet most of the goals. • How much of the domain knowledge / structure / context can/should we “launder out”? • How black are the boxes? • Which is harder: defining the problem or finding the solution?

  3. Nature of the challenges • What makes the systems problems interesting to ML researchers? What are the unique / interesting / hard aspects of these problems? • Self-optimizing  adaptation • Self-healing  unbalanced training sets • Dueling control loops • Risk management? (reasoning about probabilities)

  4. More Q than A • How to frame a SysML cup challenge? • How much domain context? • Do the “clusters” of research in this area lead to multiple separate challenges? • Show me the data! • And supersize me. • How to frame the “why button” as a Grand Challenge? • More wine?

More Related