1 / 31

Bee Conjuring and Swarm Orchestration Optimizing Collaborative Innovation

Bee Conjuring and Swarm Orchestration Optimizing Collaborative Innovation. April 12, 2006 Ned Gulley The MathWorks, Inc. Conjuring a crowd Keeping them busy Social issues Future directions. Conjuring a crowd Keeping them busy Social issues Future directions. Problem design

lew
Download Presentation

Bee Conjuring and Swarm Orchestration Optimizing Collaborative Innovation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Bee Conjuring andSwarm OrchestrationOptimizing Collaborative Innovation April 12, 2006Ned GulleyThe MathWorks, Inc.

  2. Conjuring a crowd • Keeping them busy • Social issues • Future directions

  3. Conjuring a crowd • Keeping them busy • Social issues • Future directions Problem design Micro-rewards War stories Next big thing

  4. Contest features • Entries are automatically scored, ranked, and displayed immediately • Code, author, and score are visible at all times • Anyone can modify anyone else's code and resubmit it as their own

  5. How it works rules standings view entry 1 karim 2 carol 3 eric karim. fcn f(x) ... standings ned. fcn f(x) ... 1 ned 2 karim 3 carol 4 eric new entry

  6. What makes a good problem? • Low cost of admission • Plenty of headroom

  7. Blockbuster

  8. What to reward? • A good answer • Gotten quickly

  9. Better Wednesday Monday Time

  10. Better Better Answer Faster Result

  11. 1000!

  12. Social issues • hacking • tweaking • obfuscation • acknowledgment • scoring inequities • tweak bombs • clone bombs

  13. Obfuscation function A = domove(A,mv) N(:) = false; findNeighbors(mv(1),mv(2),A(mv(1),mv(2))); anyN = any(N); for j = 1:size(A,2) if anyN(j) …

  14. Obfuscation zzz1018=zzz1018+zzz1032;for zzz1069=2:zzz1014 if zzz1048(zzz1018),zzz1041(zzz1018)=zzz1018; zzz1053=zzz1018-zzz1032; if zzz1048(zzz1053)==zzz1048(zzz1018) zzz1041(zzz1053)=zzz1018;end …

  15. Alan Chalker says… Two can play at this game. It's sad that this has sunk to this level. Can't we return to the spirit of the contest?

  16. Dr. Seuss says… …"spirit of collaboration" vs "spirit of competition"?! This is a competition right? Otherwise, anyone up for a round of cum-ba-ya?

  17. Stijn Helsen says… It is a competition, but with certain rules and goals. One of the goals is collaboration and improving other codes. The darkness and twilight zones are added to give people time to develop their own algorithms without being tempted too much for just tweaking others codes.

  18. Titles as conversation • Scrambled Eggs • Rotten Eggs • I didn't start the fire • don't get obfuscated ... follow the light • You Call This Collaboration? Give Me A Break

  19. Titles as conversation • Tweak Tweak Tweak • tweakfest • tweak-o-rama • slippery ground (tweak me) • Seems like everyone's just tweaking • I said to myself not to do this kind of things.... • Poopdeck Pappy gives in to peer pressure

  20. Titles as conversation • I wish I knew how this works

  21. Player types • Spectators, Lurkers • Drop-ins, Visitors • Tweakers, Top-grazers • Algorithm Artists • Churners, Integrators • Warriors, Obfuscators

  22. Player types Tweaker (many) 1. 2. 3. 4. … Churner (few) Drop-in (many)

  23. First use of conv First leader with conv

  24. Features we’ve added • Leaderboard • Lots of realtime stats • Mini-contests • Mid-contest analysis • Darkness and twilight • Newsgroup discussion • Contest blog • File differencing

  25. Future directions What’s the goal? • Fun == Optimizing innovation. How do we optimize? • Modulate diffusion • Modulate testing • Listen to the contestants!

  26. Putting the bees to work • Contest to create shipping code • Rent-a-swarm • Create your own contest

  27. The Big Lesson: Focus on the small • Approachable problem • Low start-up cost • Acknowledge effort with micro-rewards • Many small prizes

  28. Similarity Distance Contest Evolution Virus Evolution

More Related