430 likes | 561 Views
Event Models. James Landay, UCB. Outline. Event overview Windowing systems Window events Event dispatching and handling. Sequential Programs. Program takes control, prompts for input Examples include command-line prompts (DOS, UNIX) LISP interpreter The user waits on the program
E N D
Event Models James Landay, UCB
Outline • Event overview • Windowing systems • Window events • Event dispatching and handling
Sequential Programs • Program takes control, prompts for input • Examples include • command-line prompts (DOS, UNIX) • LISP interpreter • The user waits on the program • Program tells user it’s ready for more input • User enters more input
Sequential Programs (cont.) • Architecture Program reads in a line of text Program parses the text Program evaluates the result Maybe some output Loop back to beginning • But how do you model the many actions a user can take? • For example, a word processor? • Need to do printing, editing, inserting, etc.
Sequential Programs (cont.) • Usually end up with lots of modes • Lots of state variables • Other examples of modes • Paint programs (line, bucket-fill, rectangle, etc) • Universal remotes with TV / VCR mode • VI edit mode and command mode • Problems with modes?
Sequential Programs (cont.) • Problems with modes? • Gets confusing if too many modes • Can be easy to make errors • Need feedback as to what mode you are in • How to switch between modes? • We’ll need a more advanced model to simplify windows programming
Event-Driven Programming • Instead of the user waiting on program, have the program wait on the user • All communication from user to computer is done via “events” • An event is something “interesting” that happens in the system • Mouse button goes down • Item is being dragged • Keyboard button was hit
Event Example close box title bar folder scroll bar size control
Major Issues • How to decompose the UI into interactive objects? • How to distribute inputs to the interactive objects • How to partition between application & system software? • Models for programming interactive objects • Models for communications between objects
Windowing Systems • Partitioning to prevent chaos • Infrastructure to support common services • Two major aspects • software services to applications • create and organize windows • implement interaction in those windows • window manager • UI allowing user to control size & placement of windows
Interactor Tree • Decompose interactive objects into a tree • interactive objects also known as “widgets” • based on screen geometry of objects • nested rectangles • Used for dispatching events • Events are dispatched (sent) to code in widget • The code then handles the event • Variety of methods for dispatching events • Return to this later
Interactor Tree Display Screen “F:\cs160\Public” window Inner Window title bar horizontal scroll bar contents area “CDJukebox” folder “Home Ent…” folder … size control … “Web Newspaper” window …
93.54 9 6 - 3 0 7 4 1 2 + 8 5 = ENT Interactor Tree Display Screen Outer Win [black] ?????
93.54 3 - 6 9 1 0 4 7 + 5 8 2 = ENT Interactor Tree Display Screen Outer Win [black] Inner Win [green] Result Win [tan] Result String Keypad [Teal] = button - button + button 0 button
93.54 3 - 6 9 1 0 4 7 + 5 8 2 = ENT Interactor Tree (Java) Display Screen Frame [black] Panel [green] Text Entry [tan] Result String Keypad Panel [Teal] Button(“=”) Button(“-”) Button(“+”) Button(“0”)
Windows • Top level windows known as root windows • provide UI abstraction for multiple apps • windowing system arbitrates interactive resources • Each root window belongs to an app. • all descendant windows belong to same app • violated by OLE (ActiveX) and OpenDoc (dead?)
Windows (cont.) • Windows vs. widgets/controls • X, NeXTStep, MS Windows • everything is window • Mac: only roots are windows - controls manage rect. space in a window (Motif gadgets similar)
Network X Server std system software Client app software User Networked Windowing Systems • X Window & NeWS designed to allow apps to run on remote machines • Uses client-server model
X Window • Note backwards terminology • User is on “server” not “client” • X Server • interprets X commands and can send events • determines which window receives events and forwards over network to proper client • X Client • software interface to X (Xlib) • assembles the output from Xlib routines into packets for transmission to server
Bandwidth (bps) Latency (time) X Window • Interaction Problems? Network X Server std system software Client app software User Network Bandwidth is bits per second Network Latency is time to transfer and process data. Relation to Model Human Processor?
scroll bar thumb (elevator) Network Round Trips (NRT) • Every mouse move on thumb involves NRT • Solutions? • download code that knows how to scroll • NeWS used display PostScript to do this
Window Events • User interacts with input device • action translated into software events • must distribute events to appropriate window • doesn’t need IPC, use method/procedure call • Events have • type • mouse position or character key • the window the event is directed to
Input Events • Mouse button events • mouse up and down • modifier (shift keys, etc.) • double click (X doesn’t have this -> fakes it) • Mouse movement events • implement painting with mouse • mouse drag • can “mask off” mouse moves w/o button down • Mouse enter and exit events • e.g. if you entered / exited a button region
Implementing Buttons Button mouse enter mouse exit Button (But using mouse move events would be overkill)
Events (cont.) • Keyboard events • must translate raw “scan codes” into ASCII • Windowing events on window • creation / destruction • opening / closing • iconifying / deiconifying • selection / deselection • resize • redraw • redraw newly exposed portions of the window (rect.)
Main Event Loop • Main event loop Initialization While (not time to quit) { Get next event E Dispatch event E } • The meat of the program is in the code that handles the “dispatch”
0 9 6 - 3 4 1 0 7 8 5 + 2 = ENT Event Dispatch Dispatch (event E) { switch (E.window) { ... case FIVE-KEY: if (E.type == left-down){ cur = 5 + 10*cur; display (cur); last-op = NUMBER; } ... Hit the ‘5’ key
5 9 6 - 3 4 1 0 7 8 5 + 2 = ENT Event Dispatch Dispatch (event E) { switch (E.window) { ... case TWO-KEY: if (E.type == left-down) { cur = 2 + 10*cur; display (cur); last-op = NUMBER; } ... Hit the ‘2’ key
52 9 6 - 3 4 1 0 7 8 5 + 2 = ENT Event Dispatch Dispatch (event E) { switch (E.window) { ... case ENTER-KEY: if (E.type == left-down){ push (cur); cur = 0; last-op = COM; } ... Hit the ‘enter’ key
0 9 6 - 3 4 1 0 7 8 5 + 2 = ENT Event Dispatch Dispatch (event E) { switch (E.window) { ... case SIX-KEY: if (E.type == left-down) { cur = 6 + 10*cur; display (cur); last-op = NUMBER; } ... Hit the ‘6’ key
6 9 6 - 3 4 1 0 7 8 5 + 2 = ENT Event Dispatch Dispatch (event E) { switch (E.window) { ... case PLUS-WIN: if (E.type == left-down){ if (last-op == NUMBER) push (cur); result = pop() + pop(); push (result); display (result); cur = 0; last-op = COM; } Hit the ‘+’ key
58 9 6 - 3 0 1 7 4 + 8 5 2 = ENT Event Dispatch J
Event Queues • Input events are placed in a queue • Ensures events are processed in order • Main event loop removes them from the queue (get_next_event) & dispatches for processing Mouse move (22, 33) Mouse move (40, 30) Mouse down left (45, 34) Mouse up left (46, 35)
Event Queues (cont.) • Can use event masks to filter unwanted events • e.g., filter mouse moves in a forms-based program • just get enter/exit events
Object-Oriented Event Handling • Older methods prone to programmer error • OO languages more naturally handle passing messages between independent objects • Basis for NeXTStep, Mac App, Visual C++, Java
Object-Oriented Event Loop • Tool kit defines an application class • provides a run method which contains event loop • technique used by Visual C++ and MacApp Application myApp; Intialize windows & application data structures Set any special event masks by sending messages to myApp myApp.Run();
Dispatching Events • If user scrolls the text, the software must: • direct the mouse events to the scroll bar • update the scroll bar display during the drag • notify the text editing window it needs to scroll itself so that the text appears to have moved
Dispatching Events (cont.) • Algorithm selects the bottom-most, front-most region in the interactor tree • scroll bar or contents over outerwin (bottom-most) • scroll bar over contents (front-most) • each window need only consider its own events • difficult to impose a high level of control • known as bottom-first event dispatch • Top-down event dispatch • events passed to top-most, front-most window • it dispatches to one or more of its children...
Event Focus • Where should keyboard events go? • mouse-based • attach mouse position to all key events and dispatch events in the same way as mouse events • click-to-type (Mac) • send all key events to last window where mouse down occurred • key focus • windows take and give away keyboard focus • Mouse focus • long narrow scrollbar...
Simple Event Handling • Event tables (in the early days…) • indexed by event types (integer from 0 - 255) • holds pointers to functions that handle each event • one table per / window • lots of things to maintain when attached to a widget that you want to make reusable • Callbacks • separate things like labels/colors into resources read from files • each kind of widget defines a set of named callbacks which it will invoke
Callback Example • How do we notify text window to scroll when the scroll bar is moved? • create a vertical scroll bar widget • write a callback procedure which has code to notify text windows of their new position • register callback with scroll bar as callback to invoke when the scroll bar is moved • also register a pointer to the text window as the callback data -> knows which window to scroll
Simple Event Handling (cont.) • WindowProc style (MS Windows) • newer and better than older models • define window classes, each of which have a WindowProc (similar to callback) • whenever event dispatch algorithm identifies a window that should receive an event, that window’s WindowProc is invoked • body of WindowProc is a switch on the event type with a handler for each event • 100s of events, but most is inherited/delegated
Summary • Windowing systems • special problems with networked WS • Interactor trees • Input events • Main event loop • Dispatching events • Event focus • Simple event handling