This compilation and all annotations are copyright © Jean Renard Ward, 1993, 2004, 2011.
Permission is granted to use this information in publication, including confidential reports, provided that accompanying text clearly makes reference to the URL for this page, along with the statement:

      Main Reference Page      

• [AbrahamRI95] (*) Abraham, Robert I; Moore, Richard E.; Rich, William L.; Shackelford, Floyd W.; Tiller, John R. Jr.; and Briggs, Richard S. Jr. "Slot Objects for an Object Oriented Programming System", United States Patent 5,410,702, April 25, 1995
  • Implementation of a slot object: citations back to 1982
• [ActiveDesk95a] (*) Buxton, Bill "The Active Desk and Prototyping the Future", Alias/Wavefront, 1995, Toronto Canada. Link to video on www.buxton.com (2011)
  • Active Desk whiteboard / collaborative drawing space prototype using large Scriptel digitizer tablet and rear-projection display. Compare with Microsoft Surface, Digital Desk
• [Agulnick94] (*) Agulnick, Todd; Carr, Robert; Hoeber, Tony; Kaplan, S. Jerrold; Low, David R. and Ouye, Michael "Control of a computer through a position-sensed stylus", United States Patent 5,347,295 assigned to GO Corp, Foster city, California, September 13, 1994
  • Describes using a pen stylus for entering commands via character recognition / gestures into a computer, recognizing and executing command after out-of-proximity/end-of-stroke/time-out. Compare with Ledeen, which did not have gestures made on the display. Specific reference to first, second and third gestures in a sequence for a compound gesture (multiple flicks, multiple taps, etc.). Specific reference to direction of motion of the gesture. Animated marquee on selection after press-and-hold. Describes feedback to user (idealized form of gesture displayed, or question mark in a circle) on what gesture recognized. If gesture not appropriate in context, error returned (displayed). Proximity sensing for termination of gesture.
• [Aha92a] (*) Aha! Software Corporation "aha! InkWriter with SmartInk reference card / Basics", Aha! Software corporation, 1992
  • Manual for InkWriter for PenPoint: electronic-ink scribble editing software, later acquired by Microsoft. Supports delays/deferred handwriting recognition, indexes ink by the recognition results. Editing gestures generally similar to PenPoint: X to delete, caret gesture to insert, B to make bold, press-and-hold to start selection. Compare with van Raamsdonk.
• [Aha93a] (*) Aha! Software Corporation "aha! InkWriter Handbook", Aha! Software corporation, 1993
  • Manual for InkWriter for PenPoint: electronic-ink scribble editing software, later acquired by Microsoft. Supports delays/deferred handwriting recognition, indexes ink by the recognition results. Compare with van Raamsdonk.
• [AhmadS95a] (*) Ahmad, Subutai "A Usable Real-Time 3D Hand Tracker", Proc. 28th Asilomar Conf. on Signals, Systems, and Computers, 1995
  • Optical (camera) hand tracking system for smart desk: track hand, multiple fingertips, finger joints.
• [AllenD92] . Allen, Dennis "Pen-Input Systems", BYTE Magazine, April 1992, P. 10
  • Part of a series on pen-input systems and PDAs
• [AllenG93] (*) Allen, Gregory "Data Input Grid for Computer", United States Patent 5,214,428, May 25, 1993
  • mechanical grooves restrict the motion of a digitizer stylus to octant chain-code directions: shows a set of single-stroke characters for recognition
• [AlsonS91a] (*) Alson, Stewart "NCR takes Expo by storm with pen-based computer", InfoWorld, July 1, 1991
  • NCR 3125 pen computer runs either PenPoint for Windows for Pen-based Computing (sic).
• [Amstrad93] (*) Amstrad93 "Amstrad PenPad PDA 600", Reference available at www.old-computers.com/museum/doc.aps?c=876
  • Z-80 handheld pen-computer, 1993, styled as fold-out notebook. Contains quotes from project manager Cliff Lawson, Mark Stevenson, Wulf Broening: software by German company Wiedmann
  • Additional materials in file -- shows touch buttons on outside edge of display area?
• [AndrewC94a] (*) Andrew, Christopher and Bloomfield, Marc. A. "Palette Manager in a Graphical User Interface Computer System", United States Patent 5,371,844, December 6, 1994
  • Select new color from a palette, drag onto a UI element to change its color in OS/2. Dynamic themes/scheme manager via GUI.
  • File also contains EP published patent application 0 591 571 A1.
• [Apiki93] . Apiki, Steve "A Unified Ink Standard", BYTE Magazine, September 1993, p. 26
  • JOT standard for electronic ink storage?
• [AppleNewton93a] (*) Apple "Apple Newton product", (various)
  • File of references to Apple Newton: August 1993 introduction? Hand-held PDA, resistive touchscreen, scribble/rubout gesture.
• [AppleNewton94a] (*) Apple "Welcome to Newton (promotional video)", Apple computer, Inc. 1995
  • Video demonstration of Apple Newton user interface, including "heavy mark" gesture. Video in electronic files: transcript fetched from guidebookgallery.org 2010. Text file has complete transcription of text. Zigzag gesture to rubout (gesture). Copy-and-paste by moving text to edge of (small) screen.
• [AppleNewton95a] (*) Apple "Newton: Apple MessagePad Handbook, 1995", Apple computer, Inc. 1995
  • Apple Newton: describes various gestures and UI features, including "heavy mark" selection gesture
• [ApplePenlite93a] (*) Apple "Apple PenLite Tablet Computer", (Various)
  • Electronic file of references to Apple PenLite, a pen-computer based on Apple PowerBook Duo from 1992/1993. Project cancelled 1994 in favor of Apple Newton PDA. Most of material in German. See also video "Watch Apple PenLite Video". References obtained October 2012.
• [ApplePenlite93b] (*) Apple "Watch Apple PenLite Video/TITLE> Youtube.com
  • Video of Apple PenLite pen-computer prototype.
• [Apte93] (*) Apte, A. and Kimura, T.D. "A Comparison Study of the Pen and the Mouse in Editing Graphic Diagrams", Proc IEEE 1993 Symposium on Visual Languages, 1993, Bergen, Norway, pp 352-357
  • Citrin96 sites for single-stroke graphical editing gestures: comparison of NoteTaker on PenWindows / Windows for Pen Computing without gesture (menu picks only) and the GDE gesture-based graphical editor in GO/Penpoint. Concludes that for drawing, gesture-based editor with a pen/stylus is preferred by users because modes do not have to be changed to a menu.
• [ArmbrusterJL93] (*) Armbruster, Jeffrey L. "PenRight! Pro SDK 3.1", Windows/DOS Developer's Journal, Vol 4. No. 3, March 1993, pp. 45-48
  • Abstract only: PenRight
• [ATTHobbit93a] (*) A.T. & T. "ATT Hobbit pen computer running PenPoint (functional unit)", Personal collection of Jean Renard Ward, jrward@alum.mit.edu
  • (May not be functional) PenPoint "Hobbit" pen computer from AT&T, includes manuals. Appears to be functional as of April 2011, PenPoint Operating System.
• [ATT95a] (*) A.T. & T. "ATT Video of ATT Personal Communicator Videon", AT\&T 1995, fetched from YouTube (URL on file)
  • Vision of future technology. Shows personal hand-held video communication (like Skype) with pen touchscreen interface.
• [Avitzur92] (*) Avitzur, R. "Your own handprinting recognition engine", Dr. Dobb's Journal, April 1992, Vol 17 No 4, pp 32-37
  • combination Chain-code/zone-based handprinting/handwriting recognizer. Open-source. Csspne.tk blog posting says Avitzur also author of Milo mathematical equation editor for Apple Mach.
• [Baecker91] . Baecker, Ronald M. "Scriptel inks pact with Apple: Pen-based computer only a year away?", The Daily Reporter, Tuesday, November 26 1991
  • Scriptel electrostatic digitizer with Apple pen computer
• [Baecker95a] (*) Baecker, Ronald M.; Grudin, J.; Buxton, W.A.S. and Greenberg, S. Baecker, Ronald M. "Readings in Human-computer Interaction: Toward the Year 2000, Second Edition", Morgan Kaufmann Publishers, 1995
  • Case study C: Wang Freestyle, pen-based voice/electronic-ink annotation system. Describes substantial public interest and acclaim when Freestyle released in 1988 (citations)
  • Cited in MyersB96: ITS from IBM Research as automatic generation/generator tool for user interfaces.
• [BallBR91] (*) Ball, Brian R. "Readings in human-computer interaction: Toward the Year 2000", Morgan Kaufmann Publishers, 1995, ISBN 155860-246-1
  • Chapter "Touch, Gesture, and Marking": device independence and virtual devices, equivalence of various pointing/locator devices, mouse/joystick, button/blow-suck tube, touchscreen, etc.
  • partial copy in files only
• [BarrettDM93a] (*) Barrett, David M., McNally, J. Michael, Martin, Patricia A., Huntington, Monathan T. II and Douthart, Robeert M. "Computer with separate display plane and user interface processor", United States patent 5,260,697, November 9, 1993
  • Divisional application of UI work by Ward, this one is for the hardware. UI include handwriting recognition bar and simulated devices. Handwriting bar on The Guide at Wang.
• [BartholomewJ92] (*) Bartholomew, Jim "Microsoft Visual Tools Suite for Windows Ver 1.5", www.accu.org, 1992
  • Review of Microsoft development tool suite. Mentions VBX controls added to Control Palette in Visual C++ App Studio or Visual Basic Toolbox, four controls for Windows for Pen Computing Windows for Pen Computing development environments: Visual C++ App Studio graphical environment support VBX controls for Windows for Pen Computing.
• [BaudelT93a] (*) Baudel, Thomas and Beaudouin-Lafon, Michel "Charade: Remote Control of Objects Using Free-Hand Gestures", CACM, Vol 36, No 7, July 1993, pp. 29-35
  • Hand-gesture control of presentation graphics using DataGlove: next-chapture gesture is open hand (start) wiping movement of hand (flick gesture to right), close hand. Syntax is Start/Dynamics/End. Gesture recognized by angle/orientation of hand, open and closed fingers and thumb, bendings of fingers.
• [BedersonB94a] (*) Bederson, Benjamin B.; Stead, Larry; and Hollan, James D. "Pad++: Advances in Multiscale Interfaces", Proc. CHI '94, April 1994, Short Papers pp. 315-316
  • Infinite resolution multimedia sketchpad: infinite resolution display windowed into smaller display area: parallel lazy loading, only load/render data that is current viewable: example is browsing photos.
• [BedersonB94b] (*) Bederson, Benjamin B. and Hollan, James D. "Pad++: A Zooming Graphical Interface for Exploring Alternate Interface Physics", Proc. UIST '94, Nov. 2-4, 1994, pp. 17-26
  • Alternative graphical user interface to icons menus and windows, show small snapshots / postage-stamps of simulated desk objects. Directory browser is array of small thumbnail images of pages/documents.
• [BedersonB94c] (*) Bederson, Benjamin B. and Hollan, James D. "Pad++: A Zoomable Graphical Interface", Proc. CHI 94
  • Multiple scale / multi-scale data visualization user interface: example is directory browser, with thumbnails inside of thumbnails and multiple levels
• [Bederson95] (*) Bederson, Benjamin B. and Hollan, James D. "Advances in the Pad++ Zoomable Graphics Widget", Third Annual Tcl/Tk Workshop, July 1995, www.usenix.org
  • Multiple graphical representations of data, constraint-based graphical editing
• [BedersonB95a] (*) Bederson, Benjamin B. and Hollan, James D. "Pad++: A Zoomable Graphical Interaface System", Proc. CHI '95
  • Zoomable user interface, example is "world view" of documents, similar to thumbnail. Compare with Telesis "world view".
• [BennettWE91] (*) Bennett, William E., Boies, Stephen J., Davies, Anthony R., Etzold, Karl-Friedrich, Rodgers, Todd K. "Optical Stylus and Passive Digitzing Tablet Data Input System", United States Patent 5,051,736, September 24, 1991
  • Optical stylus digitizer utilizing extremely small patterns within a cell, some similarity to Anoto
• [BierEA91a] (*) Bier, Eric A. "EmbeddedButtons: Documents as User Interfaces", Proc. UIST '91, Nov 11-13, 1991, pp 45..53
  • Arbitrary document elements may behave as buttons, including graphics and text, and document may be control panel for an application. Describes multi-state button
• [BierEA94a] (*) Bier, Eric A.; Stone, Maureen C; Fishkin, Ken; Buxton, William; and Baudel, Thomas "A Taxonomy of See-Through Tools", Proc. CHI '94, pp. 358-364
  • Two-handed input (trackball and mouse cursor: multitouch?) trackball moves a virtual transparent layer, such as a transparent selection/framing tool and a mouse click to make an action happen.
• [BierEA94b] (*) Bier, Eric A.; Stone, Maureen C; Pier, Ken; Fishkin, Ken; Baudel, Thomas; Conway, Matt; Buxton, William; and DeRose, Tony "Toolglass and Magic Lenses: The See-Through Interface", Proc. CHI '94, pp. 445-446
  • Two-handed input (trackbal and mouse cursor: multitouch?) trackball moves a virtual transparent layer, such as a transparent selection/framing tool and a mouse click to make an action happen, for example a virtually-transparent color selector or shape selector. drop-shadow selector
• [BlandfordRR94a] (*) Blandford, Robert R. "Personal Computer Diary", United States Patent 5,347,579, September 13, 1994
  • PIM/Diary that keeps change/delta diff record of changed entries so that previous entries can be reconstructed, and automatic monitoring for dates and other phrases to prompt user to add to diary
• [Blaszczak93] (*) Blaszczak, Mike "Presentations delivered: Mike Blaszczak", www.nwlink.com/~mikeblas/speaks.htm
  • Presentations on Windows for Pen computing in Visual Basic, 1993.
• [Blickenstorfer95] (*) Blickenstofer, Conrad H. "Editorial: Vertical market hardware manufacturers growing stronger, but they'r enow facing a challenge from consumer electronics giants and their marketing savvy", Pen Computing Magazine, Issue No. 6, August/September 1995
  • Mentions Scriptel WriteTouch front-mount digitizer for Windows95 and Windows for Pen computing: cites Windows 95 as having better pen-computing support than Windows for Pen Computing 1.0, although tablet drivers are not included. Norand PEN*KEY6100 vertical market pen tablet device.
• [Bloombert92] (*) Bloomberg, Dan S. and Tow, Robert F. "Adaptive Scaling for Decoding Spatially Periodic Self-clocking Glyph Shape Codes", United States Patent 5,091,966, February 25, 1992
  • DataGlyphs: see other references
• [Borucki94] (*) Borucki, Gregory "Surface acoustic wave touchscreen sealing system", United States Patent 5,332,238, July 26, 1994
  • Sealing for SAW touchscreen tablet: see citations for actual surface acoustic wave touchscreen technologies
  • Elographics IntelliTouch Systems Manual, 1988
• [Bosscher94] (*) Bosscher, Peter J. and Yeazel, Dean "Phase I Report: Using handheld Data Collectors in Highway construction for Accounting and Materials Management", Report to the Wisconsin Department of Transportation, January 10, 1994
  • Recommends PenRight! Pro as leading pen-centric development environment, Windows for Pen Computing lacks pen-centric features, non-pen-centric development tools are unfeasible. No mention of Newton or PenPoint.
• [BoyceJ92a] (*) Boyce, Jim "Maximizing Windows 3.1", New Riders Publishing, 1992
  • Multiple color schemes defined in control.ini file of Windows 3. Dynamic themes/scheme management in Windows for color schemes.
• [Bricklin93] . Bricklin, Dan "JOT defines electronic ink", BYTE Magazine, Vol. 18 No 11., October 1993, page 110
  • (abstract only) Short description of JOT standard for electronic ink data for GO/PenPoint and Microsoft Windows for Pen Computing.
• [BrocklehurstER91a] (*) Brocklehurst, E.R. "The NPL electronic paper project", International Journal of Man-Machine Studies, Vol 34 No 1, January 1991, pp 69-95
  • Abstract only
• [BrocklehurstER91b] . Brocklehurst, E.R. and Kenward, P.D. "Preprocessing for Cursive Script Recognition", NPL Report DITC 132/88, 1988
  • Cited in FordDM91a
• [Brugge92] (*) Brugge, John "Introduction to PenPoint", MacTECH,The Journal of Macintosh Technology: available at http://www.mactech.com/articles/frameworks/6_2/PenPoint_Brugge.html
  • Overview article from about one year after PenPoint OS announced in Apple journal
• [BryanM93a] (*) Bryan, Marvin "The MacWrite Pro Book", Sybex MacIntosh Library, 1993
  • MacWrite word processing / electronic publishing
• [BucklandMK92] (*) Buckland, Michael K. "Emanuel Goldberg, Electronic Document Retrieval, and Vannevar Bush's Memex", J. Am. Soc. for Information Science, Vol 43 No 4, May 1992, pp 284-294
  • Vannevar Bush's Memex likely anticipated as a technical development by 1931 patent by Emanual Goldberg, and reference would/should have been known.
• [BurnsJ95] (*) Burns, John and Lloyd, Sheelagh A. "Position-sensing Apparatus", United States Patent 5,442,147, August 15, 1995
  • Opticial digitizer tablet: Note similarity to Anoto: printed surface of pattern cells, making use of sub-patterns. Refers also to a "single-pixel" sensor stylus.
• [Bursky92] (*) Bursky, Dave "Chip Set Simplifies the Design of Pen-Based PCs", Electronic Design, November 2, 1992
  • PICK (Pen Interface Controller Kit) digitizer interface chip set from TriTech Electronics, to support Scriptel electrostatic digitizer in pen-computing. Refers to changes in pen-position frequency (from 100KHz?) to deal with environmental noise from backlight, etc.
• [BusinessWeek95] (*) Business Week "PenRight! launches first cross platform pen-based mobile computing application development tool", Business Week magazine (Business Wire), July 24, 1996
  • Abstract/Summary only: PenRight cross-platform development environment
• [Buxton91b] (*) Buxton, Bill "GEDIT - The Use of Single-Stroke Marks (Marking Menus) in Graphical Interaction", www.billbuxton,com, http://www.youtube.com/watch?v=0A21YfqEa1c
  • Video posted by Bill Boxton in 2010 on GEDIT, marking menus with single strokes in 1991. Menus pop up either on a stationary hold or on a radial stroke ending with a starionary hold.
• [Buxton92a] (*) Buxton, W. "The Active Desk", www.billbuxton.com, fetched 2011
  • The Active Desk: posting by Bill Buxton on Xerox research project on surface computing, display and digitizer (Scriptel) in physical desktop, rear projection display. Used in Bricks graspable user interface, collaborative drawing/whiteboard, prototype for VisionMaker Digital Desk.
• [Buxton94x] . Buxton, W. "Combined keyboard / touch tablet input device", Xerox Disclosure Journal, 19(2), 109-111.
  • See also http://www.billbuxton.com: User flips keyboard top over to expose touchscreen: touch tablet is multi-touch sensitive and pressure (force) sensitive, with virtual sliders and further touch elements.
• [Buxton94y] (*) Buxton, W. "Two-handed Document Navigation", Xerox Disclosure Journal, 19(2), 103-108.
  • Two overlapping operations by user as same time using pointing input in both hands. Describes scrolling gestures: smooth scrolling as touch-slide-release, page turning with touch-rapid flick-release, and jumping to scrollbar touch location on a touch surface. Also mentions wireless touch tablet PARCtab.
  • See also http://www.billbuxton.com
• [Buxton95a] (*) Buxton, William A.S. and Kurtenbach, Gordon P. "An improved graphical keyboard", European Patent Application 94120248.3, Publication Number 0 660 218 A1, June 28, 1995
  • Graphical on-screen keyboard using gestures for modifier keys such as shift and control: e.g. tap "a" key for lower-case a, upward flick for Upper case, right flick gesture for Control-a, right-upward angle gesture for control-shift-A, etc. Mentions interchangability of other types of input devices: mouse, tablet, trackball, etc. press-and-wait / PenStill
• [Buxton95x] (*) Buxton, Bill "Chapter 7: Touch, Gesture and Marking", http://www.dgp.utoronto.ca/OTP/papers/bill.buxton/haptic.html
  • haptic input overview.
  • Date approximate based on dates of most references, this draft obtained 2002.
• [CabralAW95a] (*) Cabral, Authur W. et alet al "Obect-Oriented Graphic System", United States Patent 5,455,599, Oct. 3, 1995
  • Object-based graphical development system with polymorphic inheritance
• [CaldwellDW92a] (*) Caldwell, David W and Medendorp, Nicholas W. "Touch-sensitive Control Circuit", United States Patent 5,153,572, October 6, 1992
  • Multiple-touch-pad touch sensor, if there are multiple touches on more than one pad (detected by impedence change) output is inhibited to reject multi-touch input.
• [CallowayJD92a] (*) Calloway, Jack D.; Holzer, Raymond F;, Matheny, Stephen E.; and Orwig, Gary W. "Electronic Maintenance Support Work Station", United States Patent 5,146,404, September 8, 1992
  • Compare to Kaplow; Allow user to pick through exploded views of a parts assembly diagram at multiple levels. An item picked in a text list is automatically shown in a graphical representation.
• [CappsS94a] (*) Capps, Stephen et al "Method and apparatus for correcting words", United States Patent 5,367,453, November 22, 1994
  • Handwriting recognition that let use display pop-up list of alternative recognition results for words (from spelling dictionary) by entering a gesture to bring it up, user can pick appropriate word, or use virtual keyboard to type in correct word.
• [CappsS94b] . Capps, Stephen et al "Method for manipulating objects on a computer display", United States Patent 5,345,543, September 6, 1994
  • Rotate an object with a stylus by means of a center axle mark, and a handle used to rotate.
• [CappsS95a] (*) Tchao, Michael C. and Capps, Stephen P. "Pointing gesture based computer note pad paging and scrolling interface", United States Patent 5,398,310
  • Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton.
  • Gestures on buttons or command-input areas to edit electronic-ink notes: notes not necessarily ink.
  • Few if any references before. Compare with van Raamsdonk, Pencept, and CIC.
• [CappsS95b] (*) Capps, Stephen, and Beernink, Ernest H. "Method and apparatus for formatting paragraphs", United States Patent 5,479,596, December 26, 1995, Assigned to Apple Computer Inc
  • Automatic re-flow / formatting of paragraphs from handwritten (or "pointing" input): compare to van Raamsdonk.
  • Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton.
  • Few references before 1990 Compare with van Raamsdonk, Pencept, CIC
• [CappsS95c] . Capps, Stephen et al "Method and apparatus for the manipulation of text on a computer display screen", United States Patent 5,442,742, August 15, 1995
  • Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton.
  • Patents cite little or no prior art before 1990 ... Compare with van Raamsdonk, Pencept, CIC
• [CappsS95d] . Capps, Stephen et al "Visible clipboard for graphical computer environments", United States Patent 5,404,442, April 4, 1995
  • Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton.
  • Patents cite little or no prior art before 1990 ... Compare with van Raamsdonk, Pencept, CIC
• [CarrDA94a] (*) Carr, David A. "Specification of Interface Interaction Objects", Proc. CHI '94, Boston Massachusetts
  • Shows graphical/touchscreen slide switches and toggles, three-state "secure switch" toggle.
• [CarrDA95a] (*) Carr, David Andrew "A Compact Graphical Representation of User Interface Interaction Objects", Ph.D. dissertation, Dept. of Computer Science, Univ. of Maryland, 1995
  • User Action Notation for user interface objects. Example: Secure switch graphical object for preventing accidental manipulation of a device under computer control, such as master power switch for factory machinery. Compare to Apple slide-to-unlock gesture?
• [CarrR91] (*) Carr, Robert and Shafer, Dan "The Power of Penpoint", Addison Wesley, 1991, ISBN: 0-2015-7763-1
  • Technical background and information and rationale for design of PenPoint operating system by GO corporation for pen computing, incorporating gestures and handwriting recognition, integrated digitizer tablet and display. Includes sections on applications that do not rely on handwriting recognition. Option sheets, writing pads in UI.
• [Casio93a] (*) Casio, Inc. "Casio Z-7000 Zoomer product information", Casio, Inc.
  • Casio Z-7000 Zoomer PDA: GEOS Operating system, Handwriting recognition (Graffiti?). File contains additional information.
• [CerdaM95a] (*) Cerda, Michael "EO Interest Document", www.utexas.edu/ftp/microlib/eo/html
  • Personal note on EO with PenPoint: lists of collected EO/PenPoint materials. EO based in UK?
• [ChangL94] (*) Chang, Larry and MacKenzie, I. Scott "A Comparison of Two Handwriting Recognizers for Pen-based Computers", Proceedings of CASCON '94, pp. 364-371, Toronto: IBM Canada
  • Compare Pen-Windows and CIC Handwriter recognizers: the CIC handwriting recognizer performed better, both with and without constraints.
• [ChattyS95] (*) Chatty, Stephane; Lecoanet, Patrick; and Mertz, Christophe "Toward pen-based interaction with ATC tools", Air Traffic Control Quarterly, Vol 3 No 4, 1995, pp 205-228
  • GRIGRI (French slang for "scribble") system using pen-computing gesture recognition in user interface for air traffice control ATC. Modeled on flight strips for air traffic control. See also "Digistrips". Numeric entries for flight numbers via menus. Cites PenPoint. Lists fifteen single-stroke gestures, some of which are alphabetic. Mentions that pen-based computing is bad for large ATC display screens (arm fatigue). Refers to gesture input as "mark-based input".
• [Chefalas92] (*) Chefalas, Thomas E.; Fujisake, Tetsunosuke; Kim, Joonki; and Tappert, Charles C. "Robust Prototype Establishment in an On-line Handwriting Recognition System", United States Patent 5,121,441, June 9, 1992
  • Averaging out the training sets in a trainable recognizer to get a better prototype for elastic matching
• [CHI92a] (*) Plaisant, Catherine and Wallace, Daniel "Touchscreen Toggle Design", Proc. CHI '92, May 3-7, 1992, pp. 667-668
  • Video presentation at CHI 92: "Touchscreen Toggle Design" showing virtual toggle and slider switches: See also -- See also Plaisant92a
• [CIC92] (*) CIC Communications Intelligence Corporation "CIC Press Release: CIC PenDOS Handwriter Recognition Systems licensed exclusively to IBM", Software Industry Report: October 19, 1992
• [CloughWA91] (*) Clough, William A.; Ouelette, Daneil; De La Sablonniere, Serge "Portable Computer with Touch Screen and Computer System Employing Same", PCT International Patent Application @0 91/12578, 22 August 1991
  • Portable slate pen-computer using touch screen (not proximity digitizer): Microslate, Inc. of Canada.
• [CloughWA95] (*) Clough, William A.; Ouelette, Daneil; De La Sablonniere, Serge "Portable Computer with Touch Screen and Computer System Employing Same", United States Patent 5,379,057, January 3, 1995
  • Portable slate pen-computer using touch screen (not proximity digitizer): Microslate, Inc. of Canada. Describes having an automatic application generator. Refers to drop-down pick list as a "library" of answers for touch-screen selection.
• [CohenO93] (*) Cohen, Oryx; Meyer, Shawna; and Nilsen, Erik "Studying the Movement of High Tech. Rodentia: Pointing and Dragging", InterCHI '93 Conference on Human Factors in Computing Systems, Amsterdam, 1993, pp 135-136.
  • Comparison of MousePen, Microtouch UnMouse, Touch Pad, Mouse, trackballs, joystick: UnMouse lower accuracy than touchpad for human use (dragging, pointing): not clear that UnMouse was used in absolute or relative mode; refers to poor placement of barrel buttons on PenMouse stylus
• [Comerford93] (*) Comberford, Liam D., Ellozy, Hamed A., Jelenek, Frederick, Levy, Stephen E., and Nahamoo, David "Method and Apparatus for Improving the Paper Interface to Computing Systems", United States Patent 5,243,149, September 7, 1993
  • Electronic clipboard tablet computer with audio recording, optical scanner, digitizing tablet
• [ComputerBusinessReview92a] (*) Computer Business Review "Pen Announcements", Computer Business Review, Feb 25, 1992, Issule No. 1867
  • Slate announces vendors for Day-timer Pen Scheduler PIM personal information management software: NCR, Poqet, Momenta, MicroSlate.
  • Kurta cordless pen/stylus for digitizer, Kurta Lite-Touch pen, PenPoint, PenWindows, Pen-DOS (CIC). SunDisk Flash memory for pen-computing market.
• [Computerwoche93b] (*) Computerwoche "Pen-computing-Anbieter setzen nicht alle technischen Trends um", Computerwoche V. 22, 1993: available at http://www.computerwoche.de/heftarchive
  • Comparison of pen-enabled products Windows for Pen-Computing by Microsoft and Pen-DOS from CIC with more radical approach of PenPoint by GO Corporation, with operating system designed from the ground up, but none have met market estimates for success. Mentions that Windows for Pen Computing allows the definition of gestures. CIC Handwriting recognition licensed by IBM as best performing. Also Pen-Right from Grid computing. Microsoft includes support for Visual Basic and C 7.0 MFC.
• [Computerwoche93c] (*) Computerwoche "Ein kleiner Ueberblick ueber die Betriebssysteme fuer Pen-Computer", Computerwoche 26 Feb 1993: available at http://www.computerwoche.de/heftarchive
  • Listing of pen-computing operating systems and development environments: PenRight from Grid, PenDOS from CIC, penPoint from GO, and Pen-Windows. Mentions one problem of using mouse-type drivers with pen computing is low resolution, less than that of digitier. Mentions Pen Pal scripting language.
• [Cornett91] (*) Cornett, Johnny A. and Corbett, James D. "Touchscreen Control Panel with Sliding Touch Control", United States Patent 5,053,758, October 1, 1991
  • Touchscreen GUI technique, where user slides finger to target, and releases on target: intended to get past inaccuracies/mis-registration of touchscreen film digitizer with display. Compare to Litvin techniques, which are not cited.
  • Contains reference to Minsky gesture article, 1984
• [CraneHD93] (*) Crane, Hewitt D. and Rtischev, Dimitry "Pen and voice unite: Adding Pen and Voice Input to Today's User Interfaces Opens the Door for More Natural Communication with Your Computer", BYTE Magazine, Vol 18 No 11, October 1993, pp. 98-102
  • (abstract only) compare with Anoto-technology products incorporating voice recording for electronic ink notes? "The strengths of pen and voice technologies complement each other to create a powerful, natural user interface." "Speech to text systems must deal with a wide range of homophones words that sound the same but have different meanings."
• [Cripps95] (*) Cripps, Marcus "Introduction to PenWindows", Available at http://tawny.cs.nott.ac.uk/AMI/apprentice/INTERNAL/tech08.htm
  • Architectural overview of the PenWindows / Windows for Pen Computing system from Microsoft: hedit and bedit controls, Pen Extensions, normal and inking mode, RC handwriting recognition manager, PenWin.dll
• [Csspne.tk92a] (*) www.csspne.tk "Interacting with computers through pen gestures", www.csspne.tk/newton, March 10 1992 (?)
  • Spreadsheet with gestures on Apple Newton: mentions Numero by PenMagic, and AtHand @Hand by Slate / Dan Bricklin. Refers also to pen-computing pen-based extension to Apple MacIntosh, Milo, supporting editing of mathematical expressions. Slate PenApps application builder IDE, PenMagic Numero spread-sheet and database, Pensoft Perspective personal information manager PIM.
• [Cubictechcorp95a] (*) cubictechcorp "LabView User Manuals", cubictechcorp.homestead.com/Manuals.html, fetched 2009
  • LabView manuals from early 1990's for visual programming language
• [CushmanWH91a] (*) Cushman, William H. and Rosenberg, Daniel J. "Human Factors in Product Design", Elsevier Science Publishing Company Inc., 1991, ISBN 0-444-89031-9
  • Chapters on Keyboards and Input Devices for Computers, Theory and Design Strategies for User Interface Software. Practical Considrations for the Design of User Interface Software. Brief section on auditory displays (speech output interfaces)
• [CypherA91a] (*) Cypher, Allan "EAGER: Programming Repetitive Tasks by Example", Proc. CHI 91, New Orleans, April 28-May 2, pp. 33-39
  • UI detects pattern of repeated action sequences (command input) by user (e.g. moving mail messages to different folders), displays "EAGER" icon in pop-up list, user can select that icon or another. Gestures on buttons?
• [CypherA91b] (*) Cypher, Allan "EAGER Demo Movie", acypher.com/Eager, fetched 2010
  • Web page describes video (on file) from CHI 91 of Eager. UI learns repeated action sequences by user (e.g. moving mail messages to different folders), displays "EAGER" icon in pop-up list, user can select that icon or another. Gestures on buttons?
• [DamoreK93a] (*) Damore, Kelley "Borland C++ 4 adds visual controls", InfoWorld, November 8, 1993, page 19
  • IDE with object browser, class expert, floating palettes, events.
• [DaoJ91] (*) Dao, James; Foyt, David C.; and Allen, Kenneth R. "Keyless Flat Panel Portable Computer - Computer Aided Notebook", United States Patent 5,049,862, September 17, 1991
  • Notebook style (fold-out) pen computer, similar in appearance to Reefalo. Corded stylus. Two flat panel displays in the two sides of the notebook, provision for ring binder at the hinge to hold paper. Rotatable orientation to accomodate landscape format, or for left-handed writers.
• [Dauphin92] (*) Dauphin "Dauphin 5000 Pen-Based Notebook", Press release, Dauphin Computer, Lombard Illinois
  • Pen-computer slate format using Scriptel electrostatic digitizer
• [deBaarDJMJ92a] (*) deBaar, Dennis J.M.J.; Foley, James D; and Mullet, Kevin E. "Coupling Application Design and User Interface Design", Proc. CHI '92, May 3-7, 1992, pp. 259-266
  • UIMS/UIDE with automatic GUI layout: data model is not separate from user interface model, user interface is generated automatically from (enhanced) data model for different UIs. Examples include Open Look, OSF/Motif, Apple, and CUA.
• [DeTar94] (*) DeTar, Jim "NCR, Scriptel push cordless digitizer - NCR Microelectronic Products and Scriptel Holding Inc. develop WriteTouch cordless electrostatic digitizer", Electronic News, Nov 14, 1994, Available on http://findarticles.com
  • Electrostatic / capacitive digitizer from Scriptel, can sense finger input as well as stylus
• [DigitizerTechnology91] (*) Digitizer Technology Company "User's Guide to the Virtual Tablet Editor", Digitizer Technology Company, Redmond WA, 1991
  • Graphical editor for defining macros, regions, virtual/simulated devices on digitizing tablet: compare with Kaplow? Related to WinTAB specification?
• [DrDobbs93] (*) Dr. Dobb's Journal "New Products: Lattice Introduces PenBase Database management Library", Dr. Dobb's Journal, April 1, 1993
  • Database library for use with PenRight for pen computers: compare with PenDBase for PenApps
• [DuwaerAL83a] (*) Duwaer, ARne L. "Data Processing System with a Touch Screen and a Digitizing Tablet, Both Integrated in an Input Device", United States Paten 5,231,381, July 27, 1993
  • Stylus detector digitizer and finger detector touchscreen on top of each other: refers to ITO for sensors, grid for stylus detector sheet for touch detector, but not specific to any particular digitizer technology,
• [DysonE91a] (*) Dyson, Esther "GO Corporation: our friend the pen - promoting pen-based input system", Release 1.0: Jan 22, 1991
  • PenWares: comparison of GO Corporation developer's conference to introduce PenPoint operating system (Bill Campbell), and Microsoft similar conference for Pen Windows. The style, pacing, and features of the Microsoft PenWindows presentation closely paralleled the GO/PenPoint presentation.
• [DysonE91b] (*) Dyson, Esther "Component software", Release 1.0: 25 February 1991
  • Page 22: discusson of component software and component reuse, as in GO/Penpoint and Component WorkShop, ParcPlace systems
• [DysonE91c] (*) Dyson, Esther "Act III -- Notepads: A New Environment, or a Pen off the old block?", Release 1.0: 25 February 1991
  • Page 24: PenPoint easier to program for more advanced features than PenWindows. Active Book: PDA based on Smalltalk -- compare with Self and with Newton PDA / NewtonScript? Also mentions PenPal software from PenSoft, and Eden Group VPi386 notepad with PenWindows and touch-screen-enabled AutoCad.
• [DysonE91d] (*) Dyson, Esther "PenBook: Just the Pages Please", Release 1.0: 30 September 1991
  • Page 14: PenBook, simple (no editing) e-Book / e-publishing application for PenPoint OS, similar to Kindle. Limited text mark-up (white-out, highlighting).
• [DysonE92a] (*) Dyson, Esther "The Electronic Frontier: Where Personal Computing Goes from Here", Proc. IFIP 12th World Computer Congress, Madrid, September 1992, pp. 13-22
  • Pens and Groupware: Critieus GO PenPoint and Microsoft Windows for Pen Computing (Pen Windows) as too expensive ($2000 in 1992), Cites Pen/GEOS (Graphical Environment Operating Systems) and Palm Computing. Quotes Jeff Hawkings regargind Slate for beeing cross-platform. Sidekick 2 from Borland.
• [EatonJK94a] (*) Eaton, John K. and Eaton, Laura "LabTutor: A Friendly Guide to Computer interfacing and LabVIEW Programming", Oxford University Press, 1994
  • LabVIEW graphical programming language.
• [EdwardsMJ93a] (*) Edwards, Martin J. "Touch sensor array systems and display systems incorporating such", United States Patent 5,194,862, March 16, 1993
  • Array/matrix of touch sensors (touch switches) for multi-touch input in a graphics tablet: addressing technique for dealing with large number of touch sensors: touch sensors are bi-stable (maintain state after touched), so that touched locations in the array can be determined. Mentions capacitive touch sensor grids relying on physical displacement of conductors under force. Cited in Ure patent as technology for multi-touch.
• [EliensA95a] (*) Eliens, A. "Hush -- a C++ API for Tcl/Tk", The X Resource, Issue 14, April 1995, O'Reilly & Ass., pp 111-155
  • Refers to mapping of events to mouse buttons in user interface. Compare to press-and-hold.
• [Ellozy91] (*) Ellozy, Hamed A; Jeanty, Jenry H; and Tappert, Charles C. "Handwriting recognition employing pairwise discriminant features", United States Patent 5,005,205, April 2 1991
  • Pairwise analysis of characters against prototypes, then voting, then highest score of the winning pair: appears similar to the Pencept technology (not patented)
• [EloTouch95] (*) Elo TouchSystems, Inc. "DOS and Windows Driver Guide, version 2.0", Elo TouchSystems, Inc. 105 Randolph Road, Oak Ridge, Tennessee 37830. Copyright 1987..1995
  • Contains description of touchscreen implementation of mouse menus for DOS application which are not "mouse-aware". See also Microsoft documentation on MENU.COM and mouse menus. Tablet drivers for mouse emulation in DOS and Windows.
• [ElrodS92a] (*) Elrod, Scott; Richard, Bruce; Gold, Rich; Goldberg, David; Halasz, Frank; Jannsen, William; Lee, David, McCall, Kim; Pedersen, Elin; Pier, Ken; Tang, John; and Welch, Brent "LiveBoard: A Large Interactive Display Supporting Group Meetings, Presentations, and Remove Collaboration", Proc. CHI '92, SIGCHI conf. on Human Factors in Computing Systems, 1992, pp. 599-607
  • Multi-user remote whiteboard using rear-projection screen and wireless digitizer pen with four additional buttons (for menus, etc.) Cordless pen digitizer projects light onto screen, detected optically. Sweeping gestures for scrolling and panning, also for turning pages in a slide-show application: tap as gesture? Multi-touch: up to three users with three pens at same time, therefore can share the tools. Other references state as multi-user / multi-touch: up to three simultaneous pens/users.
• [Endo91] (*) Endo, Yasuo; Akimichi, Shinji; Hirose, Tadayoshi; Furukawa, Motonori; Yoshida, Kyoko "Context-Base Input/Output System", United States Patent 5,012,521, April 30, 1991
  • Gesture recognition user interface: refers to recognition of patterns (sketch recognition?) of elements of on-line drawing (curves, arcs, lines), but emphasis is on gestures: X for erase, clash for cut (of two segments), closed wrap (circle or lasso) to cause recognition of handwriting, wrap/lasso plus arrow for magnify, copy, reduce. No modal input, gestures can be input at any time, compare with Tablet PC gestures. Integrated tablet digitizer and display.
• [EO93a] (*) EO "The World of Messaging: An Introduction to Personal Communications", EO, Inc., 1993
  • User documentation provided for EO personal communicator, running PenPoint operating system. Describes E-mail, FAX, AT\&T Mail services, Applelink. See also ATTHobbit file (functional device)
• [EO93b] (*) EO "Lookup Guide to the EO Personal Communicator", EO, Inc., 1993
  • User documentation provided for EO personal communicator, running PenPoint operating system. Describes basic function of PenPoint and EO "Hobbit" hardware: caret, check/tick, circl, cross out, undo, flick up gestures. Press (hold) gesture for move, tap+press two stroke gesture for copy. See also ATTHobbit file (functional device), Agulnick file
• [EO93c] (*) EO "EO Personal Communicator: Applications", EO, Inc., 1993
  • PenPoint/EO: InkWare Notetaker, Longhand by Lexicus, MHS link for GO mail by GO: PenASCII, penHost, Slate PenApps Application Builder, Pensoft Perspective, PenMagic Numero, PenCross
• [EO93d] (*) EO "Getting Started with your EO Personal Communicator", EO, Inc., 1993
  • User documentation provided for EO personal communicator, running PenPoint operating system.
• [EO93e] (*) EO/ATT "How to Appease a fat cat FROM a gondola", AT\&T / EO, Inc., 1993
  • Sales brochure for ATT/EO Hobbit personal communicator pen computer tablet. Shows functional unit (actualy display) running PenPoint operating system. Applications include Slate Corporation PenApps (similar to Visual Basic?), Pensoft Corporation Perspective forms/reports/planner, PenMagic Software Numero spreadsheet and LetterExpress letters/fax editing, Ink Development Corporation NoteTaker, fax software. Deskin Research Group Gnosis database and document storage software with remote server storat.
• [Essex95] (*) Essex, David "Rewriting Handwriting Recognition", Byte Magazine, June 1995
  • Refers to reduced expectations on handwriting recognition accuracy, not to read human-illegible handwriting. Reference to Doonesbury commentary, use of point-and-tap selections and digital ink. Shows modified Graffiti character set (neography), Lexicus Cursive Recognition
• [FaughnanJ95] (*) Faughnan, John "bar coding journal articles - DataGlyphs", Posting to ftp.org/mailmain discussion list, December 29, 1995
  • Proposal to use a DataGlyph (two-dimenstional barcode) to having indexable/scannable information at the start of published articles. Compare to Silverbrook patent 2004, and to Anoto. Note: there was a similar technology already in place in the 1980's?
• [FeinerS91a] (*) Feiner, Steven "Hybrid User Interfaces: Breeding Virtually Bigger Interfaces for Physically Smaller Computers", Proc. UIST '91, Nov 11-13, 1991, pp 9..17
  • Combine two head-mounted displays (low resolution and high resolution) and two pointing inputs (low resolution and high resolution: use Polhemus 3-D electromagnetic digitizer to track head). Cites to Sutherland 1965 for head-mounted dipslay. Mentions combination of dataglove and stylus for pointing.
• [Fenwick95] (*) Fenwick, Daniel J. "Generation of Interdependent Font Characters Based on Ligature and Glyph Categoriations", United States Patent 5,412,771, May 2, 1995, assigned to Signature Software Inc., Hood River, Oregon
  • Creating of a "handwriting-looking" font from samples of someone's handwriting: refers in claims to automatic classification/categorization based on slope and other characteristics of the characters
• [FitzmauriceG95a] (*) Fitzmaurice, George W.; Ishii, Hiroshi; Buxton, William "Bricks: laying the Foundations for Graspable User Interfaces", Proc. CHI 1995
  • GraspDraw project: Physical devices coupled to "virtual" objects via position sensors: blocks (bricks) that may be moved on a position-sensing surface. Refers to multiple-value input being either time-multiplexed (one mouse or stylus) or space-multiplexed (two hands).
• [Forcier93] (*) Forcier, Mitchell D. "Script/Binary-encodedcharacter Processing Method and System with Moving Space Insertion Mode", United States Patent 5,220,649, June 15, 1993
  • Editing of handwriting/electronic ink without recognition of characters, use of editing gestures distinguished from handwritten character/glyphs based on context: word-wrap, inserting spaces, editing of handwritten lines of text: Compare with van Raamsdonk.
  • Press reports from 1999 of Forcier accusing Microsoft of infringement: see correspondence with Forcier
• [Forcier93a] (*) Forcier, Mitchell D. "Script/Binary-encoded Character Processing Method and System", United States Patent 5,231,698, July 27, 1993
  • Editing GUI of handwriting/electronic ink without recognition of characters, use of editing gestures distinguished from handwritten character/glyphs based on context
  • Editing of electronic ink: word-wrap, inserting spaces, editing of handwritten lines of text
  • Distinguishes handwritten electronic ink from other non-handwriting input during editing
  • Compare with van Raamsdonk.
  • Press reports from 1999 of Forcier accusing Microsoft of infringement
• [FordDM91a] (*) Ford, David Malcom "On-Line Recognition of Connected Handwriting", Ph.D Thesis, University of Nottingham, U.K., May 1991
  • Contains review of handwriting recognition techniques for discrete, connected, and cursive writing: primitive sub-strokes, elastic matching, feature matching, Freeman chain codes. Digitizer used was a Pencept PenPad, specifically engineered for use in a handwriting-input system.
• [Fox92] (*) Fox, Abijah Shawhan; Greanias, Evon Constantine; Kim, Joonki; and Tappert, Charles Carson "A system for automatic adjustment and editing of handwritten text images", European Patent Publication Number 0176715B1, Proprietor International Business Machines, Armonk, NY.
  • Stroke segmentation and alignment to a base writing line
• [FrancikE91a] (*) Franci, Ellen; Rudman, susan Ehrlich; Cooper, Donna; Levine, Stephen "Putting Innovation to Work: Adoption Strategies for Multimedia Communication systems", CACM, Dec. 1991, Vol 34 No 12, pp. 53-63
  • Report on adoption plan for Wang Freestyle as pen-based system for cooperative/collaborative work, syncronized voice/electronic-ink annotations. Refers to conversational turns enabled in whiteboarding system. Cites to early resistance to telephone as an electric toy (citations)
• [Frankish95] (*) Frankish, Clive; Hull, Richard; Morgan, Pam "Recognition Accuracy and User Acceptance of Pen Interfaces", CHI '95 Proceedings, available at http://www.acm.org/sigchi/chi95/Electronic/documnts/papers/crf_bdy.htm
  • Short study of Windows for Pen Computing accuracy, compares to Neisser60, cites also LaLomia94
• [FrederickV93a] (*) Frederick, Vivian and Yasuda, Phyllis, with Yamada, Judy and Koda, Ann "Using Windows 3.0/3.1", McGraw-Hill, 1993
  • Color and pattern Scheme GUI in Windows 3.0/3.1
• [FrickeJ93a] (*) Fricke, Jeorg "Tactile graphic computer screen and input tablet for blind persons using an electrorheological fluid", United States Patent 5,222,895, June 29, 1993
  • Tactile display for the blind, uses a fluid that changes state in response to a voltage. Intended to display braille.
• [Fried-Nielson94a] (*) Fried-Nielsen, Lars K. "Symbol Browsing in an Object-Oriented Development system", United States Patent 5,339,433
  • IDE development environment with object, code browser, links reference to source code. No layout editor for GUI shown.
• [FriedlandM91] (*) Friedland, Mary "They Made It Happen (Momenta)", Pentop Magazine, Nov. 1 1991
  • Kamran Elahian, founder of Momenta pen-computing company: Portia Isaacson compares MADE (Momenta Application Development Environment) with PenPoint and Pen-Windows.
• [FriendJ95a] (*) Friend, John; Freedman, Mike; Bricklin, Dan "Input Device with Deferred Translation", United States Patent 5,455,901
  • Delayed translation/Deferred recognition of electronic ink, part of Slate/Bricklin thinking of ink as a data type. Implemented for PenPoint and Pen Windows in PenApps, a Visual-Basic like language. Refers to leaving electronic ink displayed if handwriting not recognized, or handwriting recognition result not found in dictionary. User can also display ink instead of recognized text. Gestures?
• [FrohlichD93] (*) Frohlich, David "The History and Future of Direct Manipulation", Hewlett-Packard internal publication, 1991
  • Broad psychological comparision of direct manipulation GUIs (a la Shneiderman) with virtual partners, virtual reality systems. Cites to Shneiderman for three-point definition of "direct manipulation"
• [Garnet94a] (*) Brad A. Myers, Dario Giuse, Andrew Mickish, Brad Vander Zanden, David Kosbie, James A. Landay, Richard McDaniel, Rajan Parthasarathy, Matthew Goldberg, Roger B. Dannenberg, Philippe Marchal, Ed Pervin "The Garnet Reference Manuals: Revised for Version 3.0", CMU Computer Science report CMU-CS-90-117-R5, December 1994, and additional materials
  • Collection of reference manuals and papers for Garnet IDE (see other refs) from CMU archive web site: includes directory listings.
• [GeisslerJG95a] (*) Geissler, Joerg "gedrics: The Next Generation of Icons", Proc. 5th Int'l Conf. on Human-Computer Interaction (INTERACT '95), Lillehammer, Norway, June 27-29 1995, pp. 73-78
  • Critique of Pen Windows / W4PC as only encompasing double-click, not drawing of gestures. Gedrics: gesture-driven icon. Gestures (of single stroke, to be fast) are performed on an icon: tab to activate, right-left to open, single-stroke question mark for help menu, closed "X" to delete, press/hold or hold/drag for copy/paste/move-to-parent, etc. circle left and circule right. Implementation on Newton. Does not mention "marking menus".
• [GemmellM92a] (*) Gemmell, Mark; Robson, Christopher "Input device with tactile feedback", PCT Patent Application PWO9200559A1, January 9, 1992
  • Stylus and digitizer with haptic feedback, conveying texture by vibrational/noise
• [GeneralMagic94a] (*) General Magic "General Magic Phone Predates Smartphones", General Magic Corporation. Video available at http://www.youtube.com/watch?v=wko0m6XA9yg, Fetched 2011
  • Video presentation of General magic smart phone / PDA. Slate computer with stylus touchscreen from Sony. Appears to be resistive film tablet. Calendaring, virtual keyboard, electronic ink for notetaking, Personal Link communiation network services from AT&T for email, etc.
• [GeneralMagic94b] (*) General Magic "Video Telescript General Magic: A 1994 Vision of the Future", General Magic Corporation. Video available at http://www.youtube.com Fetched 2011
  • Video presentation of General magic smart phone / PDA. Slate computer with stylus touchscreen from Sony. Appears to be resistive film tablet. Focus is on Telescript: early messaging/email service?
• [GeneralMagic95a] (*) General Magic "Telescript Language Reference, October 1995", General Magic Corporation
  • Telescript: Prototype-based programming language for pen-centric pen computing applications for General magic platform.
• [GerlachJD94a] (*) Gerlach, John D. and Weiblen, Michael E. "System for Relocating a Multimedia Presentation on a Different Platform by Extracting a Resource Map in Order to Remap and Relocate Resources", United States Patent 5,317,732, May 31, 1994
  • Visual programming language / GUI for creating programmed multimedia presentations
• [GerpheideGE94a] (*) Gerpheide, George E. "Methods and apparatus for data input", United States Patent 5,305,017, April 19, 1994
  • Capacitive/electrostatic grid tablet ("dipole electrodes"), finger affects capacitance at intersections. Interpolates for higher resolution? Proximity sensing
• [GesslerS95a] (*) Gessler, Stefan and Kotulla, Andreas "PDAs as mobile WWW browsers", Proc. WWWF '94, Computer Networks and ISDN Systems, 1995. Available at ww.teco.uni-karlsruhe.de/~stefan/papers/wwwf94/www_pda.html
  • Speculative (forward-looking) paper on web-browser for PDA Apple Newton: advantage is ubiquity and portability, disadvantage was high wireless data charges while mobile, small display and small memory.
• [GoldbergD91] (*) Goldberg, D. and Goodman, A. "Stylus User Interfaces for Manipulating Text", Proceedings of the Fourth ACM SIGGRAPH Symposium on User Interface Technology (UIST'91), 127 - 135
  • Cited by Bill Buxton: Shows "undo" graphically, using electronic ink: Scriptel electrostatic digitizer. Shows markup editing as a good application for handwriting recognition and input: cites Suenaga and Nagura. Note: did not cite van Raamsdonk. Cites to PenPoint, but specifically mentioned before PenPoint: penpoint recognizer can make errors in gesture recognition. Cites parallax problem with Scriptel digitizer above display. Discusses U-V recognition, boxed versus boxless, but no reference to PenCept. Segmenting cursor: initially one writing box, box is moved when you start writing outside the current box. Tap gesture to replace (incorrect) single-character recognition with recognizers second alternative. ("tap-correction"). Tap-twice to correct manually.. Mentions two differences between stylus and mouse pointing: precision, and multiple-buttons on mouse, does not mention lift-vs-down, relative-vs-absolute position, etc.
• [GoldbergD93] (*) Goldberg, D. and Richardson, C. "Touch-typing with a stylus", INTERCHI '93 Conference Proceedings, Amsterdam, April 1993, pp 80-87
  • See also SIGGRAPH Video Review 88, New York: ACM., 1993.
  • Unistroke handwriting character recognition
• [Goodisman91] (*) Goodisman, Aaron "A Stylus-Based User Interface for Text: Entry and Editing", S.M. Thesis, Massachusetts Institute of Technology, Dept. of EE and CS, May 1991.
  • General study and overview of stylus-based user interface for text input and text editing, including the use of gestures. Makes comparisons to PenPoint, but is not specifically about PenPoint. Mentions differences between Stylus and Mouse GUI user interfaces, such as activate-button-on-touch versus activate-button-on-lift, scroll-up flick versus pull-scroll-bar-down. Supervisor was David Goldberg of Xerox PARC, who later patented similar work on mark-up editing using gestures, boxes, with handwriting recognition (Unistroke)
• [Gookin92] (*) Gookin, Dan "Oh, to Find a Better Mouse", Also Available at www.wambooli.com/fun/dang/mouse
  • Unpublished manuscript for PC Computing Usability Labs on mouse, trackball, and similar devices: includes low-cost tablets and touchpads such as AceCat, UnMouse, PortaPoint. Also MousePen (note on writing with a mousepen). Unmouse: default (only?) behavior is non-absolute relative motion, mentions problem of double-click with a touch pad.
• [Gore93] (*) Gore, Andrew and Ratcliffe, Mitch "Newton's Law: A Digital Nomad's Guide", Random House Press, 1993, ISBN 0-679-74647-1
  • Handwriting recognition on page 157 ff. Mentions JOT electronic ink standard with Slate, but not supported on Newton. Handwriting recognition "not well explained" by Apple. Appears to show a scrub-out gesture for erasing text: text is selected (alternatively) before the scrubbing gesture, or y the scrub gesture itself. Gestures: caret gesture. Due to problems with recognizer, recommends deferred recognition and searchable electronic ink.
• [Greanias91] (*) Greanias, Evon C. and Donaldson, Robert L. "Remotely Sensed Personal Stylus", United States Patent 5,007,085, April 9, 1991
  • Transparent digitizer overlaid on a display (CRT example, not flat LCD: see other Greanias). Appears to be a patent on using the same stylus on any of several workstations, and logging on with the stylus by identifying the particular stylus. Compare with SecureID token from RSA.
• [Greanias92a] (*) Greanias, Evon C.; Stein, Frank L; Donaldson, Robert L.; and Gray, Michael "Remotely Sensed Personal Stylus", United States Patent 5,117,071, May 226 1992
  • Capacitive grid Finger touch touchpad, and electromagnetic digitizer in one device. Describes touch mechanism (tip switch?) as solving a problem of not knowing when stylus is actuall in contact with surface
• [Greanias92b] (*) Greanias, Evon C.; Stein, Frank L; Donaldson, Robert L.; and Gray, Michael "Stylus Sensing System", United States Patent 5,149,919, September 22, 1992
  • Electrostatic (capacitive?) digitizer using a single globe pickup receiver in the stylus, to avoid tilt errors. Special contact sensing mode: appears not to use a physical switch in the stylus, uses height / proximity distance instead. Alternating grid of grounded and signal wires.
• [Greanias92c] (*) Greanias, Evon C.; Verrier, Guy F.; Arbeitman, Gordon W.; Tannenbaum, Alan R; and An, Yu L "Advanced User Interface", United States Patent 5,157,384, October 20, 1992
  • Gesture/voice/speech input with multiple user profiles for different commands to differnet programs. Circle gesture mentioned. Translation of gestures to simulated input for other, pre-exiting devices, such as keyboard and/or mouse, to maintain compatibility with pre-existing applications. Compare to Pencept CAD and other interfaces from 1985, which translated "recognition macro" gestures to defined sequences of keyboard/mouse input. If no meaning yet associated with gesture, pop up a menu for user to define the meaning on the fly.
• [GreaniasEC92d] (*) Greanias, Evon C.; Stein, Frank L.; Donaldson, Robert; and Gray, Michael "Stylus Sensing System", United States Patent 5,149,919, September 22, 1992
  • Stylus for transparent grid conductor tablet digitizer. Grid is transmitter, round tip on stylus to have no tilt error (capacitive sensing?). Grid can be either electromagnetic or electrostatis signal source. States disadvantage of 332 patent was false touch points because "touch" detected indirectly by signal strength, by energizing entire grid with same signal, thus getting less variation in signal strength across surface.
• [Greanias95] (*) Greanias, Evon C.; Verrier, Guy F.; Donaldson, Robert L. "Touch Overlay for Improved Touch Sensitivity", United States Patent 5,386,219, January 31, 1995
  • Capacitive grid digitizer, transparent on top of display
• [GreenbergS94] (*) Greenberg, Saul "HCI Video Resources", Available at http://www.cpsc.ucalgary.ca/~saul/hci_topics/hci_resources/videos.html
  • Extensive list of video tapes from ACM CHI, CSCW, and ACM SIGGRAPH Vieo Review relating to handwriting recognition, sketch input, signature verification, and pen-computing: 1983 to 1994.
  • 1963 Video: Videotape of Sketchpad system by Sutherland
  • 1985 Video: Software Control at the Stroke of a Pen - Pencept - CHI '85
  • 1989 Video: The Paper-Like Interface, IBM Watson Research Center - CHI '89
  • 1989 Video: Freestyle - Wang Labs - CHI '89
  • 1992 Video: Combining Gesture and Direct Manipulation - CMU
  • 1992 Video: Touchscreen Toggle Design - Univ. of Maryland
  • 1992 Video: Tactile Manipulation on a Digital desk - Rank Xerox EuroPARC
  • Video: Alternate Reality Kit - Xerox PARC
  • Video: The Lapidary Graphical User Interface Design Tool - Univ. of Tennesee
• [GridSystems92a] (*) GridSystems "Grid System Windows for Pen Computing 1.0", Grid Systems installation kit
  • Windows for Pen Computing installation kit: includes Slate applications software Daytimer Pen Scheduler, WinFax Pen Software, Slate PenBook Reader, Slate LooseLeaf Notetaker, Microsoft documentation for Windows for Pen Computing 1.0 and Windows 3.1 User's Guide. Also PenCell spreadsheet program from Grid (compare with Slate spreadsheet program).
• [GridSystems92b] (*) Youtube.com "Grid Pen Computer running Windows 3.1", Youtube.com posted approximately year 2000
  • Video Windows for Pen Computing running on Grid Pen Convertible computer, circa 1992.
• [Griepentrog93] (*) Griepentrog, Scott "David vs. Goliath", Wiki posting at: twiki.stg.net
  • Microsoft Notebook Application for Pen Windows version 1.00a: described Notebook electronic ink (?) as most promissing application for Pen Computing -- compare with Slate Pen Scheduler note-taking application?
• [Gurewich93] (*) Gurewich, Ori and Gurewich, Nathan "Teach Yourself Visual Basic 3.0 in 21 Days", Sams Publishing, 1993
  • Tutorial and workshop on Visual Basic language and development environment
• [Hardock93] (*) Hardock, Gary; Kurtenback, Gordon; and Buxton, William "A Marking Based Interface for Collaborative Writing", Proceedings of the UIST'93, pp 259-266. See also http://www.dgp.utoronto.ca/OTP/papers/bill.buxton/mate.html
  • Collaborative system for marking up text documents: Says modeled on Wang Freestyle: references from 1989
• [HarrisonBL95a] (*) Harrison, Beverly L.; Kurtenbach, Gordon; and Vincente, Kim J. "An Experimental Evaluation of Transparent User Interface Tools and Information Content", Proc. UIST 95, Puttsburgh, USA
  • Show pop-up menus (including pie menus or context menus) semi-transparent or wire-frame over object, so that user can still see context, underlying image/object not obscured. See-through UI tools.
• [HashimotoO92a] (*) Hashimoto, Osamu and Myers, Brad A. "Graphical Styles for Building User Interfaces by Demonstration", Proc. UIST '92, Nov. 15-18, 1992, p. 117-124
  • in Garnet system papers: User can define multiple graphical styles for UI. When a style is edited, all widgets change. Shows Set Style GUI for setting which style.
• [Hawkins92] (*) Hawkins, Jeffrey C. "Object Recognition System", United States Patent 5,125,039, June 23, 1992
  • Compare with Unistroke patent. Recognition of handwriting by dictionary look-up independent of any character set. Uses recognition dictionary: one entry per object, entries involve Boolean operations only to find match: uses inflection points / chain-codes
• [Hawkins92a] (*) Hawkins, Jeffrey C., Daly, John J., McNamara, James H. and Cole, James F. "Hand Held Computer", United States Patent 5,133,076, June 23, 1992
  • Hand-held slate computer with handwriting, convertable to a desk-top computer: shows rotation of display
• [HayesP94] (*) Hayes, P. "NameFinder: software that finds names in text", Proc. of RIAO '94, pp 762-774
  • Abstract only: Commercial product that finds literal names based on capitalization, and dictionary, plus knowledge engineering rules. Compare with regex expressions to find phone numbers.
• [HellerD93a] (*) Heller, Dan "XView Programming Manual / XWindows: Volume Seve, Updated for XView Version 3.2 by Thomas Van Raalte", O'Reilly and Associates, August 1993
  • X-Windows / XView programming and specification
• [HellerD93b] (*) Heller, Dan "XView Reference Manual / XWindows: Volume Seve, Updated for XView Version 3.2 by Thomas Van Raalte", O'Reilly and Associates, August 1993
  • X-Windows / XView programming and specification
• [HenckelJDD95] (*) Henckel, Jonathan D. and Hospers, Paul A. "Data Processing System Graphical User Interface which Emulates Printed Material", United States Patent 5,463,725, October 31, 1995
  • Gesture (?) for turning a page by touching edge of page in a simulated book, and moving animated page(s) to the left or right. Compare with flick gesture, PenPoint OS metaphor of notebook pages?
• [HenryTR91a] (*) Henry, Tyson R, Hudson, Scott E., Yeatts, Andrey K., Myers, Brad A. and Feiner, Steven "A Nose Gesture Interface Device: Extending Virtual Realities", Proc. UIST '91, Nov 11-13, 1991, pp 65-69
  • Tongue-in-check ("DATANOSE"). Used Polhemus 3-D electromagnetic digitizer mounted in a helmet. Cites to nose-twitching as prior reference for nose gestures.
• [HinckleyK94a] (*) Hinckley, Ken; Pausch, Randy; Goble, John C.; and Kassell, Neal F. "A Survey of Design Issues in Spatial Input", Proc. UIST '94, November 1994, Marian del Rey, California, pp. 213-222
  • Hybrid user interface: touchscreen UI can be combined with 3-D input device, because user can reach out to touch touchscreen with the 3-D input device in their hand. Relative vs. Absolute gestures: hard to perform gestures in absolute coordinates. Bi-manual/two-handed input advantageous over sequential single-hand input, because user can (e.g.) position a tool with one hand and use the tool with the other. Mentions using multiple pointing devices in a prototype (trackball and mouse, or two mice). User's spontanteous use two hands for combining translation/rotation/scaling gesture (direct manipulation).
• [HinckleyKP95a] (*) Hinckley, Kenneth P.; Bathiche, Steven N.; Cauthorn, James H.; and Sinclar, Michael J. "Automatic Scrolling", United States Patent 6,975,306, December 13, 2005
  • Scroll to line, paragraph, or other document boundary. Scrolling initiated by minimum gesture movement, with second threshold to stop autoscrolling or scroll back if touch location has not moved on touch-sensitive surface.
• [HopkinsD91a] (*) Hopkins, Don "The Design and Implementation of Pie Menus: There're Fast, Easy, and Self-Revealing (sic)", Dr. Dobb's Journal, Dec. 1991
  • Description of pop-up circular pie menus, developed in 1986 at U. Maryland in uwm window manager for X-Windows, OpenWindows.
• [HopkinsT95] (*) Hopkins, Trevor and Horan, Bernard "Smalltalk: An Introduction to Application Development using Visualworks", Visualworks Object-Oriented Programming Series, 1995
  • Introduction to Smalltalk language and environment. (Electronic file.)
• [HoYL95] (*) Ho, Yung-Lung, and Li, Hwok-Leung "Track Pad Cursor Positioning Device and Method", United States Patent 5,424,756, June 13, 1995
  • Touchpad controller for very small touchpad: uses (optical) sensing of velocity to position cursor faster if touch is moving fast.
• [HP95a] (*) Hewlett-Packard "HP Omnigo 100 PDA product information", Hewlett-Packard
  • Touchscreen PDA with full keyboard, swivel/convertible/clamsheel display. Graffiti Handwriting recognition software, GEOS operating system. File contains additional materials.
• [Hu95] (*) Hu, Jianying, Brown, Michael K., and Turin, William "Invariant Features for HMM Based On-Line Handwriting Recognition", in "Image Analysis and Processing", Braccini, C., DeFloriani, L. and Vernazza, G. (Ed.), Springer Verlag, 1995, pp. 588-593, Lecture Notes in Computer Science #974.
  • Invariant handwriting features (independent of rotation, translation, scale) are ratio of tangents and normalized curvature, for Hidden Markov Model recognizer
• [Hullender92] (*) Hullender, Gregory N. "Method for Recognizing Handwritten Characters Using Shape and Context Analysis", United States Patent 5,151,950, September 29, 1992
  • Deterministic Finite Automata (state machine) for using a dictionary of words in handwriting character recognition on the fly, using probabilities of characters: compare with Viterbi algorithm, which is not cited.
• [IBM93] (partial) IBM "BellSouth/IBM Simon smart phone", (various)
  • Collection of published articles concerning 1993 IBM Simon, a touchscreen-only smart phone with calendar, address book, and other PDA functions built in. Recevied Best Of Show award at 1994 comdex. Design by IBM, manufacturer: Mitsubishi, marketed by Bell South. Touch-screen phone vs. QWERTY cellphone. Pre-internet, send/receive Email by dialing into analog modem on Lotus Notes, send/receive analog Fax. DispatchIt back-end software application for field service. Predictive keying on virtual keyboard. File mentions BellSouth working with Apple to integrate cellular phone service into Newton device. Annotation function (electronic ink) for Fax messages, without handwriting recognition.
• [IBM94] (partial) IBM ""Redbook" IBM Pen for OS/2 and PenDOS", IBM Form Number GG24-4217-00
  • Architecture of IBM Pen for OS/@ V1.0 and PenDOS from IBM, version 2.2: Lists gesture assignments by Session Type, Gesture Commands and Sessions
• [IBM94b] (partial) IBM "Simon Says "Here's How!", Simon Mobile Communications Made Simple, Users Manual", IBM Corp., 1994
  • IBM Simon user manual. Touch screen uses plastic stylus or finger. PredictaKey keyboard shows six most likely characters on virtual keyboard, Other shows next six most likely. User can hightlight numbers in messages and they are dialed from a pop-up menu.
• [IBM94c] (partial) IBM "AIX Version 4 Desktop Handbook", IBM Corp. Document Number GG24-4451-00, December 1994
  • Windowing system uses different control layout from Microsoft Windows. Drag-and-drop to printer icons. Style manager allows color palette for all windows to be updated. Three button mouse, pop-up menu button can be rightmost of leftmost button depending on handedness of user.
• [Impedovo94] (partial) Impedovo, Sebastiano, editor "Fundamentals in handwriting recognition", Proceedings of the NATO Advanced Study Institute on Fundamentals in Handwriting Recognition, Chateau de Bonas, France, June 21-July3, 1993
• [Inforite94] (partial) Inforite "MP100 Writing Pad, Rite-Expressions annotation software for handwriting", BYTE Magazine product announcement, May 1994
  • Appears to have no relation to Inforite82 product, separate company? Several companies have used the name "Inforite"?
• [InfoWorld91a] (*) InfoWorld "Windows for Pens beta adds macros, training", InfoWorld, July 22, 1991, page 7
  • Windows for Pens beta / Pen Windows publicly announced gesture macros definable by user. Refers to new recognizer in December 1991. Additional controls for Visual Basic, compared to PenPoint: delaed recognition a.k.a. "raw ink", ink as a data type, context-sensitive editing (gestures depend on context?) Gestures include tap and double-tap gestures on buttons?
• [InfoWorld91b] (*) InfoWorld "Microsoft Passion for Go May Have Been Just a Ploy to Steal Its Heart", InfoWorld, Feb. 18, 1991
  • Windows for Pens / Pen Windows: Microsoft technical staff met regularly with GO/PenPoint, while also working on PenWindows.
• [InfoWorld91c] (*) InfoWorld "Momenta is a study in compromise", InfoWorld, October 21, 1991
  • Momenta pen-based computer compared with Grid, NCR, PenPoint, and PenWindows. Pop-up context menus / command compass, , trainable handwriting recognition. Operating System is DOS.
• [InfoWorld91d] (*) InfoWorld "The Power of the Pen", InfoWorld, March 4, 1991
  • Article on Tug of War between GO/Penpoint and Microsoft/Pen Windows. Describes PenPoint technology as superior, Microsoft's advantage is business standardization. Review of hardware vendors, architectural comparison of PenPoint and Pen Windows, whether IBM supports PenPoint or PenWindows. Quotes "Information at your Fingertips" from Microsoft.
• [InfoWorld91e] (*) InfoWorld "Is pen computing for real?", InfoWorld, November 11, 1991
  • PenPoint, Windows for Pen Computing (Pen Windows), and PenTop: questions whether users are waiting for technology to deliver as promised. Possible killer apps: Ink Development Inkware (later aha! journal notetaker?), PenBook from Slate, Pensee notepad and outlining, SuperScript improved recognition (?). Companion article "Momenta takes different approach to pen systems",. Quotes preductions of 1 million units to be sold by 1995, mostly felett users, 4 million by 1995.
• [InfoWorld92a] (*) InfoWorld "TouchPen turns PenPoint into touch-based system: MiroTouch System's Inc's digitizer compatible with Go Corp.'s PenPoint", InfoWorld, June 8, 1992
  • MicroTouch working with PenPoint from GO -- OS required proximity sense. Mentions cursor control with finger
• [InfoWorld93a] (*) InfoWorld "Visual C++ is a strong development tool: Microsoft gets the C environment right with this robust Windows application builder", InfoWorld, June 21, 1993, page 94 ff.
  • Visual C++ 1.0 replaces Microsoft C/C++ 7.0: compared with Visual Basic: custom controls of Visual Basic may be used in Visual C++. Development environment: Visual C++ 1.0, available with PenWindows: Shows a tool palette, resource editor, tool palette can add and drag-and-drop VBX components, custom controls
• [InfoWorld93b] (*) InfoWorld "Visual C++ 1.5 integrates OLE, ODBC", InfoWorld, November 8, 1993, page 5
  • Visual C++ 1.5: SDK with AppWizards, ClassWizards, visual editing, and drag-and-drop. Also mentions Borand C++4.0 as released easlier, with templates.
• [InfoWorld93c] (*) InfoWorld "CA challenges Visual Basic with app builder for Windows, OS/2", InfoWorld, November 8, 1993, page 19
  • CA Realizer 2.0 for OS/2, and Windows 3.1.
• [InfoWorld93d] (*) InfoWorld "More tools available for Power Mac programmers", InfoWorld, Kwi 1994, page 23
  • CodeWarrior by Metroworks, Object Master, MacAPP, Workshop
• [InfoWorld93e] (*) InfoWorld "Genetically engineered mice run amok at Windows World", InfoWorld, May 24, 1993, page 34.
  • Report on Windows World conference: Whiskers utility use use middle button (button 3) of mouse, Gliffic Pluse mouse pad that also works with pen/stylus digitizer, used with Pen Windows / Windows for Pen Computing.
• [Intel95a] (*) Intel "Intel386 EX Embedded Miroprocessor MHT9000 Handheld Terminal", Intel Application Note AP-719, August 1, 1995
  • Intel386 embedded processor, includes registers and MTL6560 digitizer controller for resistive touchscreen (digital voltage measurement), controller/co-processor for LCD
• [Isaacson93] (*) Isaacson, Portia "Electronic ink emerges as a launchpad of the future -- While few products exist, Jot 1.0 standard is a step", Computer Resellers News, Jun 28, 1993
  • Review of JOT 1.0 electronic-ink / E-ink format standard for handwriting data. Mentions particularly the tutorial nature of the specification, and open-ended format. Credits Slate as author of the standard: original draft was by Jean Renard Ward, later revised, credit to Dan Bricklin of Slate.
• [Isaacson94] (*) Isaacson, Portia "The Power of 'EINK'", OEM Magagzine, February 1994, Page 93
  • States large hardware business for specialize electronic chips for PDAs with electronic ink, handwriting recognition coprocessor. Mentions immaturity (performance defects) of digitizer tablets. e-ink.
• [Ishigaki94] (*) Ishigaki, Kawasaki Kazushi "Handwriting Entry Processing System Using Keyboard and Mouse Interfaces Requiring No Modification of an Application Program", United States Patent 5,361,310, November 1, 1994
  • Handwriting recognition UI characters translated to keyboard input: no references to Sklarew/Linus or Ward/Pencept?
• [JacobRJK93a] (*) Jacob, Robert J.K.; Leggett, John J.; Myers, Brad A; and Pausch, Randy "Interaction styles and input/output devices", Behaviour and Information technology, Vol 12 No 2, pp. 69-79, 1993
  • gesture and handwriting as alternative to keyboard input. Gesture and other types of input have a probability vector of input, rather than absolute commands. Refers also to two-hand input (Buxton multi-touch) and UI having more than one stream of input events, unlike WIMP architecture, force feedback for haptic display of 3D surfaces.
• [JacobRJK94a] (*) Jacob, Robert J.K.; Sibert, Linda E.; McFarlane, Daniel C.; and Mullen, M. Presont Jr. "Integrality and Separability of Input Devices", ACM Transactions on Computer-Human Interaction, Vol 1 No 1, March 1994, pp. 3-26
  • Describes mouse as absolute position device if not lifted from pad (sic), thus a three-dimensional digitizer is equivalent for two dimensions. Refers to device-independent API interfaces such as ACM CGS. But in practice, practical attributes of input devices are not separable from types of user interfaces and interactions.
• [JohnsonGW94a] (*) Johnson, Gary W. "LabVIEW Graphical Programming: Practical Applications in INstrumentation and Control", McGraw-Hill, INc. 1994
  • LabView graphical programming language for software simulation and control of virtual laboratory instruments, describing dataflow programming. Text refers to RUN switch in examples (p84/92). Introduction gives history of LabVIEW to 1986. User interface: notes that scroll bar on MacIntosh and Windows effectively halts asyncronous/multi-tasking operation.
• [JohnsonWA91] (*) Johnson, Walter A.L.; Faieta, Baldo A.; and Smith, Z. Erol III "Form Utilizing Encoded Indications for Form Field Processing", United States Patent 5,060,980, October 29, 1991
  • Printing machine-readable descriptions, data, and instructions on a paper form, to be used in conjunction with OCR to read the pattern on the special section of the form. Numerous citations to other inventions involving printing data on paper: compare to DataGlyphs, which encoded the whole surface, and to Anoto.
• [Jourjine91] () Jourjine, Alexander "Neural network using random binary code", United States Patent 4,996,648
  • Neural net for handwriting recognition developed during Freestyle project at Wang Laboratories.
• [Jourjine93] (*) Jourjine, Alexander "Method and apparatus for parallel implementation of neural networks", United States Patent 5,224,066
  • Alex Jourjine had a very interesting user-independent cursive handwriting recognizer at Wang Labs, without use of a vocabulary dictionary.
• [KabbashP93a] . Kabbash, Paul, Mackenzie, I.Scott, and Buxton, William "Human Performance Using Computer Input Devices in the Preferred and Non-Preferred Hands", Proceedings of the ACM INTERCHI 1993, pp 474-481
  • multi-hand user interface: prototype used stylus (Wacom pressure) tablet and mouse
  • Cited in Wanderley00
• [Kable92] (*) Kable, Robert G. "Electrostatic Digitizers Performance with Color LCD Displays", Scriptel Corporation, 1992
  • Scriptel electrostatic digitizer, resistive film. Mentions high immunity to backlight and display noise. Front-mounted touchscreen. Describes ratiometric sensing of voltage field
• [KajlerN95a] (*) Kahler, Norbert and Soiffer, Neil "A Survey of User Interfaces for Computer Algebra Systems", J. symbolic Computation, Vol 11 no 1, 1995.
  • Survey of mathematical expression editing, mostly from a keyboard (and mouse?). Section 4.10 talks about pen computing user interfaces: two-dimensional input is good, but large number of symbols used is problematic for handwriting recognition
• [Kaplan94] (*) Kaplan, Jerry "Startup: A Silicon Valley Adventure", Penguin Books, ISBN 0-395-71133-9, ISBN 0 14 02.5731.4, 1994
  • History of GO Corporation and PenPoint, experience with IBM and Microsoft, from point of view of CEO of GO. Compare to account of same events by Marlin Eller in "Barbarians led by Gates" about PenWindows.
  • Additional materials in file: winster.com, etc.
• [KasselRH95a] (*) Kassel, Robert Howard "A Comparison of Approaches to On-Line Handwritten Character Recognition", Ph.D. Thesis, Dept. of EECS, M.I.T., May 12, 1995
  • Study of testing handwriting recognition algorithms using some 87,000 characters from 150 writers. Supported by Microsoft Pen computing Group: Greg Slyngstad and Sunh Rhee. (Cites variability models of Ward and Kuklinski, but does not derive implications about 97,000 being a small sample size.)
• [Kay93] (*) Kay, Alen "The Early History of Smalltalk", ACM SIGPLAN, Vol 28 No 3, march 1993. Appearing in "History of Programming Languages", ACM Press 1996
  • History of object-based programming, back to Burroughs B200
  • Mentions GRAIL and Sketchpad systems, 1960's, early pen computing environment
  • Describes early thought to include handwriting recognition input on Dynabook, not thought would work well
• [KelleyAJ93a] (*) Kelley, A.J. "On the Development of a Force-Feedback Mouse and its Integration into a Graphical User Interface", Dynamic System sand Control, Vol 55 No 1, 1994, pp 287-294
  • Force-feedback "mouse" using position over electromagnetic plate. Haptic features for user interface include tactile feedback for: rectangular constraints for windows, resistance to motion when moing upward into menu bars, contraining input in scroll bars, icon gravitation, viscous feeling when dragging (window, object, scrollbar), etc. Interfaced to X-Windows.
• [KelleyAJ94a] (*) Kelley, A.J. and Salcudean, S.E. "MagicMouse: Tactile and Kinesthetic Feedback in the Human-Computer Interface using an Electromagnetically Actuated Input/Output Device", Technical Report, Dept. of E.E., Univ. of Briish Columbia, October 19, 1993
  • Haptic mouse with force feedback, integrated with X windows. Electromagnetic actuator in mouse, feedback provided external to host CPU because control loop through host application too slow or too low in bandwidth. Turns mouse into absolute position device?
• [Kempf93] (*) Kempf, James "Integrating Handwriting Recognition into Unix", 1993 USENIX Summer Technical Conference, Cincinnati Ohio, June 21-25 1993
  • Block recogizer versus cursive recognizer:
  • HRE API for Linux, for incorporating handwriting character recognition into X-Windows
• [Kempf94a] (*) Kempf, James "HRE API: A Portable Handwriting Recognition Engine Interface", Available at http://playground.sun.com/pub/multimedia/handwriting/hre.html
  • Proposed API for handwriting recognition systems, using pen strokes optimized for point vectors in the X window system, but otherwise independent of OS or windowing system
  • Incremental translation/recognition of handwriting
  • support for context as for Japanese and Cursive English
  • API for character prototype files and dictionaries
  • Data structures for gestures and arbitrary objects
  • Data structures correlations between recognized objects and pen strokes
• [Kempf94b] (*) Kempf, James "Preliminary Handwriting Recognition Engine Application Program Interface for Solaris 2", Available at http://playground.sun.com/pub/multimedia/handwriting/hre.html
• [Kent93] (*) Kent, Joel C. "Contact touchscreen with an improved insulated spacer arrangement", United States Patent 5,220,136, June 15, 1993
  • Resistive sheet digitizer with spacing dots, electrographic tablet
• [Khanide92] (*) Khanide, Fereydun "kurz vorgestellt - Pen-Computer: Pen-Prototyping / Pen-Entwicklungswerkzeuge: PenRight!Pro und PenPal", c't Magazine, September 1992, page 48
  • Abstract/Summary only: Visual Software development packages for pen computers using GRiD API
• [Kim94] (*) Kim, Joonki; Teibman, George J.; and Tappert, Charles C. "Method and Apparatus for Improving Prototypes of Similar Characters in On-line Handwriting Recognition", United States Patent 5,285,505, February 8, 1994.
  • Averaging out the prototypes in adaptive handwriting recognition system
• [KimuraTD92a] (*) Kimura, T.D. "Hyperflow: a visual progrmaming language for pen computers", Proc. 1992 IEEE Workshop on Vistual Languages, 15-18 September 1992, pp. 125-132
  • visual programming langauge with pen input: pen-based multimedia computer system. Lasso/line-through gesture for multiple copying, box and arrow gesture recognition.
• [KnabeK95a] (*) Knabe, Kevin "Apple Guide: A Case Study in User-Aided Deisng of Online Help", Proc. of CHI '95, Short Papers
  • On-line help, with hypertext linking and search for related topics by text
• [KnowltonKC94a] (*) Knowlton, Kenneth C. "Computer Apparatus and Method for Graphical Flip Book", United States Patent 5,283,864, February 1, 1994
  • Simulation of indexed flip book / rollodex in Wang Freestyle, with small edges of pages shown
• [KruegerM91] (*) Krueger, Myron W. "Artifical Reality II", Addison-Wesley Publishing, Reading MA, 1991
  • Limited discussion of "The Glove as a Gesture Technology": simple hand gestures: because its shape is in three dimensions, it has a larger vocabulary of gestures. Suggests that natural hand gestures (e.g. open/close) better than symbolic gestures. Cites earlier VIDEOPLACE ca. 1972 with simulated "touching" of two users to each other via video projection.
• [KruegerMW93] (*) Krueger, Myron W. "Environmental Technology: Making the Real World virtual", CACM, Vol 36 No 7, July 1993, pp. 36-37
  • Multi-hand / multi-user videodesk teleconferencing, both a whiteboard and direct manipulation of graphics. Multipoint control (four finger touch points) for manipulating curves, 3-D wind tunnels, videotouch.
• [Kurtenbach91] (*) Kurtenbach, G. and Buxton, W. "GEdit: A test bed for editing by contiguous gestures", ACM SIGCHI Bulletin, Vol 23, 1991, pp 23-26.
  • Cited in Lipscomb91, Rubin91b: sub-gestures within a stroke
  • Simple gestures to create a small object (square, circle, etc.) using a single-direction flick stroke in one direction: gestures for delete (slash) and select (loop around) with drag mark on the rest of the selection to move
• [Kurtenbach91a] (*) Kurtenbach, G. and Buxton, W. "Issues in Combining Marking and Direct Manipulation Techniques", Proc. 4th ACM SIGGRAPH Symposium on User Interface Technology (UIST), pp 137-144.
  • Simple gestures to create a small object (square, circle, etc.) using a single-direction flick stroke in one direction: gestures for delete (slash) and select (loop around) with drag mark on the rest of the selection to move.
• [Kurtenbach91b] (*) Kurtenbach, G. "Making Marks Self-revealing", SIGCHI Bulletin, October 1991, pp 60-ff.
  • Flick gestures in different directions, pop-up menu for pie-menu if you press-and-hold.
• [Kurtenbach91c] (*) Kurtenbach, Gordon "Editing Time-line Data Using Marking Menus", Video demonstration, Dynamics Graphics Lab, University of Toronto, 1991
  • Also known on YouTube.com as Marking Menus in ConEd Example. Marking menus /gestures in UI to edit video annotations: pop-up menu when mouse/stylus is held stationary (hold/press gesture)
• [Kurtenbach92] (*) Kurtenbach, Gordon and Baudel, Thomas "HyperMark: issuing commands by drawing marks in HyperCard", SIGCHI Conf. on Human Factors in computings systems, Monterey, CA, 1992. pp. 64-64 (poster session)
  • Gesture Markings on buttons in HyperCard
• [Kurtenbach93] (*) Kurtenbach, Gordon and Buxton, William "The Limits Of Expert Performance Using Hierarchic Marking Menus", Proc. INTERCHI '93, 24-29 april 1993, pp. 482-487
  • Heirarchic marking menus: heirarchical levels of pie/radial menus, user can combine "zig-zag" motions through multiple levels of menus. Includes an undo/no-selection gesture by moving pen back to center before lifting stylus, or moving pen to new location before lifting. Undo gesture is pointing to center. Notes that mouse is worse than stylus with digitizer/touchscreen. Test system employed Momenta pen-based computer (which already had marking/pie menus), but Momenta not listed in references.
• [KurtenbachGP93b] (*) Kurtenbach, Gordon P., Sellen, Abigail J; and Buxton, William S.a. "An emperical evaluation of some articulatory and cognitive aspects of "marking menus"", Human Computer Interaction, Vol 8 No 1, pp. 1-23.
  • User usability study of heirarchic marking menus: response time not solely a function of number of menu items
• [KurtenbachGP93c] (*) Kurtenbach, Gordon Paul "The Design and Evaluation of Marking Menus", Ph.D. thesis, Graduate Dept. of Comp. Sci., University of Toronto, 1993
  • Kurtenbach thesis on marking menus: self-revlation (due to pop-up menu on dwelling), guidance (from pie menu), and rehearsal (from stylus motion in pie menu like the mark). Pen item is selected when stylus crosses outer boundary of pie menu radial item. Previewing of menu selections. Animation of demonstrated marks as on-line help. UI works by pen-motion only, barrel buttons are "events distinct from men movement".
• [Kurtenbach94] (*) Kurtenbach, G.; Moran, T.P.; and Buxton, W. "Contextual Animation of Gestural Commands", Computer Graphics Forum, Volume 13 (1994), Number 5 pp 305-314.
  • Use of pop-up radial menus to train users to "gestures" which match the motion used to select from a radial menu. Also display of images of gestures in menus, and pop-up text giving name/meaning of gesture recognized. Circle/lasso gesture around an object brings up a pop-up menu of actions that may be applied to the object. Also shows pig-tail gesture for delete/erase, scroll-up and scroll-down (flick?), lasso gesture for select. Gestures may be recognized using velocity: e.g. Slow flick moves to next page, fast flick to end of document.
• [Kurtenbach94b] (*) Kurtenbach, G.; and Buxton, W. "User Learning and Performance with Marking Menus", Proc. CHI '94, pp. 258-265
  • Marking menus on MacIntosh/Apple. (pop-up pie menus when user hold stylus still, selectedable without first lifting pen). Zig-zag gestures for navigation.
• [KusumotoH94a] (*) Kusumoto, Hiroki and Hasuhara, Hiroshi "Image drawing apparatus for displaying input image on display means", Unite States Patent 5,311,207, May 10, 1994
  • Pressure sensitive tablet digitizer using two conductive sheets and conductive rubber
• [KwokJC92] (*) Kwok, Jac Chak-Lam "An innovative integrated development environment for the Pocket PC PDA", Master's Thesis, Massachusetts Institute of Technology, EE/CS, 1992
  • Mentions digitizer problems with handwriting recognition, based on Ward and Kluklinski articles
• [Kyocera_Refalo91] (*) Kyocera "Kyocera Refalo KX-1601 Product information, 1991", Collection from Mobile Computers Museum, http://www.kako.com/backup/mesum/keyocera/kyocera.html, 2002
  • Kycocera Refalo: fully electronic day-timer, DOS-based Pen palmtop, Handwriting recognition, ATOK, JUST-Window.
  • Unit was shaped like a three-ring binder, with the display and writing surface on the left inside: included separate pointing device (cursor-key pad) in addition to stylus. MS-DOS, additional leaves/pages could be inserted with additional hardware, worked by electromagnetic coupling.
  • Web page Copyright 1995-1999 by Eiji Kako, additional Refalo materials in file.
• [LahtinenPI91a] (*) Lahtinen, Pekka Ilmari "Multi-function telephone apparatus", European Patent Application E 0458563 A2, November 27, 1991
  • Portable telephone user interface that recognizes telephone numbers in messages on the display and lets the user dial them
• [LaLomia94] (*) LaLomia, Mary "User acceptance of handwritten recognition accuracy", Conference on Human Factors in Computing System, Boston, Massachusetts, 1994, pp 107-108.
  • Cited along with Neisser (93% recognition success for humans without context), that users not satisfied with 97% correct character-to-character handwriting recognition success.
• [LaLonde91] (*) LaLonde, Wilf R. and Pugh, John R. "Inside Smalltalk, Volume II", Prentice-Hall International, 1991
  • Introduction to Smalltalk language and environment. (Electronic file.)
• [LambAC94a] (*) Lamb, Arthur C. Jr. "Pop-up Keyboard System for entering Handwritten Data into Computer Generated forms", United States Patent 5,276,794, January 4, 1994
  • pop-up keyboard in GridPad computer, in a particular form application
• [LandayJA93a] (*) Landay, Jams A. and Byers, Brad A. "Extending an Existing User Interface Toolkit to Support Gesture Recognition", Proc. INTERCHI '93, pp 91-92
  • Garnet user interface system extended to support gesture input (Rectangle, Circle, Copy, Delete gestures: delete is one-stroke "X"). Interactor class passes name/ID of gesture, and features (such as bounding box). Compare with PenCept recognition-macro gestures for extents?
• [LandmeierWL95a] (*) Landmeier, Waldo L. "See-through Digitizer with Clear conductive Grid", United States Patent 5,381,160, January 10, 1995
  • Front-mounted electromagnetic digitizer (CalComp) with a display: gives long description of Scriptel front-mounted electrostatic display, discussion of problems of rear mounting. Uses term "pen-driven computing". Two layers of grid are fabricated on two layers of transparent mylar.
• [LawlessMT93a] (*) Lawless, Michael T. and LaVine, Nils D. "Reconfigurable Simulator Specifications for Future Main Battle Tanks Within the Close Combat Test Bed", U.S Army Research Institute for the Behavioral and Social Sciences, Fort Knox Field Unit, Training Systems Research division, Report AD-A268 134, March 1993.
  • User interface for a battle tank simulator: mentions need for reconfigurable glass cockpit, touch screen technology on display has advantages from user interface controls placed on the screen. Touchscreen is a modified Microtouch unMouse using capacitive touch-sensing with a microswitch below the screen. Dragging by clicking and sliding.
• [LeeJ94] (*) Lee, Jack "Pen-based form computer", United States Patent 5,347,477, September 13, 1994
  • Forms-based inputing gestures to control recognition, insert, delete scroll -- compare with GO
  • Refers to smoothing (and averaging?) to obtain the non-distortion point on stylus input filtering?
• [LeedhamCD94] . Leedham, C.G. "Historical perspectives of handwriting recognition systems", IEE Colloquium on Handwriting and Pen-Based Input, 1994, pp 1..13.
  • Abstract only: history of handwriting recognition (?) back to 1950's.
• [LevineS91] (*) Levine, Stephen R.; Harui, Alex J.; Schirpke, Michael W.; Donoghue, Karen; Ajgaonkar, Donna "Apparatus for Manipulating Documents in a Data Processing System utilizing Reduced Images of Sheets of Information which are Movable", United States Patent 5,060,135, October 22, 1991
  • Freestyle from Wang: Pen/stylus direct manipulation for annotating document images. Only made use of electronic ink, no handwriting recognition or gesture shape recognition. Touch-and-lift (similar to tap) and touch-and-move (drag) operations. Allowed for both ink annotations and voice recording annotations, which could be played back as a "recorded" whiteboard session. No actual remote whiteboard communication. Gave the appearance of being an operating environment, but was only for annotating captured images, taken from DOS application screens or Fax input. Separate patent on means for suspending and restoring a running DOS application program.
• [LevineS91b] (*) Levine, Stephen R. and Ehrlich, S. "The Freestyle System: A design perspective", in Human-Machine Interactive Systems, A. Klinger, Ed. Plenum Press, New York, 1991, pp. 3..21
  • Freestyle from Wang: in particular describes voice/electronic-ink annotations with recorded real-time pointing with proximity cursor of Hitachi digitizer tablet
  • Partial copy in files
• [LevineSR93a] (*) Levine, Stephen R; Abrams, Kenneth H; Burns, Raymond S; Harui, Alex J; Lakness, David R.; and Rudis, Ronald F. "Apparatus for Document Annotation and Manipulation Using image from a Window Source ", United States Patent 5,231,579, July 27, 1993
  • Freestyle patent: annotation (electronic ink and voice/audio) of documents in Freestyle. States that documents are produced as snapshots of windows from an application, and the documents are annotated separately from the application.
  • Typo in first inventor name: Levin, LevinSR Stephen R.
• [LewisJR93a] (*) Lewis, James R. "Literature Review of Touch-Screen Research from 1980 to 1992", IBM Corporation, Technical Report 54.694, August 20, 1992
  • Review of touchscreen literature at about the time of PenWindows, PenPoint, PenDOS, and Pen/OS/2. Mentions last contact / lift-off as less error-prone than first contact or touch area. Touch-feedback strategies include highlighting the object the user has selected.
• [Lexicus92] (*) Lexicus "iSKETCH Digital Ink for Wireless Communications", http://www.motorola.com/lexicus/html/isketch.html
  • Compression software for digital ink images on hand-held platforms
• [Lexicus95] (*) Lexicus "Lexicus' Cursive Recognition", Byte Magazine, June 1995: available at http://www.byte.com/arg/9506/img/501026j0.htm
  • Lexicus neural network handwriting cursive recogition: 25,000-word dictionary and statistical methods (compare with Viterbi algorithm?)
• [Lipscomb91] () Lipscomb, James S "A Trainable Gesture Recognizer", Pattern Recognition, Vol 24 No 9, September 1991, pp 895 to 907.
  • Angle filtering and multi-scale/step gesture recognition.
  • Angle filtering very non-invariant recognition, so funny scaling was required.
  • Copy/move using gesture recognition without separate vector part of move: just two circles and arc between as one stroke.
  • Gestures have semantic effect (they do something), are single, so a recognition speed delay less critical than with handwriting character recognition.
• [LoganJD94a] (*) Logan, James D. and Evans, Blair "System and Method for Emulating A Mouse Input Devices with a Touchpad Input Device", United States Patent 5,327,161, July 5, 1994
  • Microtouch touchpad digitizer: press-and-drag distance is a minimum distance threshold before user input does drag automatically by simulating mouse button action
• [Loh91] (*) Loh, Skiu-Chang "On-line Handwritten Character Recognition Apparatus with Non-Ambiguity Algorithm", United States Patent 5,034,989, July 23, 1991
  • Handwritten characters are recognized as a set of primitives / primitive strokes, consiting of short lines, segments, curves.
  • Contains table of single-stroke primitives (unistrokes?) which are labeled uniquely with letters of the alphabetic: recognition of letters/words consists of a dictionary look-up of the resulting strings of characters
• [LoomisJM93a] (*) Loomis, Jack M.; Golledge, Rignald G.; and Klatzky, Roberta L. "Personal Guidance System for the Visual Impaired using GPS, GIS, and VR Technologies", Proc of 1993 Virtual Reality VR Conference, csun.edu
  • GPS aid for visual impaired/blind, giving information about surrounding environment as well as location. Output to user by means of artificial auditory beacons located at correct/appropriate binaural location relative to user.
• [Lopresti93] . Lopresti, Daniel P. and Tomkins, Andrew "Approximate Matching of Hand-Drawn Pictograms", 3rd International Workshop on Friontiers in Handwriting Recognition, Buffalo NY May 1993
  • Avoid need for handwriting recognition when indexing documents by approximate matching of hand-drawn pictograms. Mentions difficulty of handwriting recognition of (Asian) languages
• [Lopresti94] . Lopresti, Daniel P. and Tomkins, Andrew "On the Searchability of Electronic Ink", 4th International Workshop on Friontiers in Handwriting Recognition, Taipei, Taiwan, December 1994
  • Avoid need for handwriting recognition when indexing documents by approximate matching of hand-drawn pictograms. Mentions difficulty of handwriting recognition of (Asian) languages
• [Lopresti95] (*) Lopresti, Daniel P.; Aref, W.G.; Kamel, I. "On handling Electronic Ink", ACM Computing Surveys, vol 27, no 4, December 1995, pp. 564..567
  • Searchability of electronic ink; approximate matching of hand-drawn pictograms, not just comparing with character recognition results to index handwritten text
• [LouieJ95] (*) Louie, Jim "An Analysis of a Pen-Based Tool for Acquiring Engineering Design Information", Master's Thesis, University of Toronto, 1995
  • Review of pen-based computer (PenPoint) with applications for engineering: notetaking, engineering design. Applications written in Slate PenApps. Generally, paper fared better than electronic notebook, in part because notebook was not perfect writing surface and was a bit small (6" by 9"). Notes that engineers dislike doing documentation, in part because words are not the natural medium of expression -- diagrams/sketches are preferred. Cites several other electronic/virtual notebook systems, but most not portable.
• [LuciwWW95a] . Luciw, William W; Capps, Stephen; and Tesler, Lawrence G. "Method and apparatus for deducing user intent and providing computer implemented services", United States Patent 5,390,281, February 14, 1995
  • Determine user intent by applying a pattern template to user interactions in a pen user interface, and then carry out an operation automatically.
  • Also check Capps file
• [Machart92] (*) Machart, Beverly Hellen, and Wang, John Shihyuan "Graphic data display system", European Patent EP 0 226 019 B1, February 5, 1992, assigned to International Business Machines Corporation.
  • Filing date in 1986
  • A signature which has disconnected stroke can be manipulated an transmitted as a single object. To indicate end of signature/character, uses second button on pointing device: appears similar to Pencept PenPad.
• [MackR91a] (*) Mark, Robert and Montaniz, Frank "Comparision of Touch and Mouse Interaction Techniques for a Graphical Windowing Software Environment", Proc. of Human Factors Society 35th Annual Meeting, 1991, pp. 290-294
  • Selection gesture (tap/lift-off) on touchscreen: Application provides visual indication of selection by highlighting before lift off: also mentions auditory feedback (click?). Mentions difficulty of double-tapping (with stylus) for double-clicking (with mouse), but does not mention cause (see PenWindows and Tablet PC notes). Very short "taps" are rejected as unintentional input.
• [MackenzieIS92a] (*) MacKenzie, I. Scott "A Comparision of Input Devices in Elemental Pointing and Dragging Tasks", Proc. GI Graphics Interface '92
  • Performance/usability study: tapping (tap gesture) time vs. Fitt's Law, user timing performance
• [MacNeill93] (*) MacNeill, David "Newton Notes: Messaging Card and NewtonMail: We pick up and deliver", On The Go Magazine, October 13, 1993
  • NewtonMail E-Mail application using electronic ink instead of text
• [MacTech93a] (*) Bresee, Don and Ticktin, Neil "Newton Toolkit: You've seen the Newt and what it can do", MacTech, the Journal of Apple Technology: Vol 9 No 11, November 1993
  • Description of Newton Toolkit, NewtonScript.
• [MacTech93b] (*) Ticktin, Neil "It's a Newt!", MacTech, the Journal of Apple Technology: Vol 9 No 11, November 1993
  • Review of Newton handwriting PDA
• [MagicLink94a] (*) Sony "Video: Magic Link Sony PDA PIC-1000 running Magic Cap OS (General Magic)", Sony circa 1994: Video fetched from YouTube 2011
  • Shows pen/stylus based PDA with office desk / office room and hallway metaphor. Appears to be a resistive touchscreen, looks like it might be a Data Rover 840.
• [MakiK93] (*) Maki, Ken "The AT&T EO Travel Guide", John Wiley and Sons, 1993
  • User guide for EO Personal Communicator. Describes Gestures of GO/PenPoint operating system, including flick gestures, brackets, circle, caret, down-right, up-right, etc.
• [Maryland95] (*) Maryland, Universtify of at College Park "DOCBIB through 1994: Document Understanding Blibliography", http://documents/cfar.umd.edu/biblio/DOCBIBpre95.ps
  • Bibliography of papers relating to document understanding, starting about 1980. Sections include: On-line character recognition; Gestures and Sketches; Script; Foreign optical character recognition; Recognition of mathematics and Formulas; Line drawings; Signature verification; Writer Identification; Synthetic data; Forms processing; Shorthand; Music recognition
• [MartinD95] (*) Martin, David A. "Interactive Display System", United States Patent 5,448,263, September 5, 1995
  • Projection whiteboard system with LCD project panel, overhead projector, digitizer. See other references to MartinD.
  • Describes alignment/calibration method for display and projection vs. tablet, similar to that of PenCept/CIC/etc. for paper versus tablet.
• [MartinP92] (*) Martin, Partricia A; Huntington, John T II; McNally, J. Michael; Barrett, David M.; Ward, Jean R. "Computer with Tablet Input to Standard Programs", United States Patent 5,148,155, September 15, 1992
  • Simulated devices for input to a computer with integrated digitizer/display: devices included writing pad, simulated mouse, simulated virtual tablet, simulated virtual soft keyboard. Devices implemented in a separate control processor, no special device drivers. Long button press on simulated mouse button locks mouse button into "down" state for press-and-drag.
  • press-and-hold as counterexample?
  • See also 5,491,495 Ward et al
• [MaulsbyD92a] (*) Maulsby, David L. "Prototyping an Instructible Interface: MOCTEC", Proc CHI '92, May 3-7 1992, pp. 153-154
  • System learns to recognize patterns in text from examples by user, such as recognizing who won a game in a series from a list of teams and scores. Highlighting of focus items. See also MaulsbyD89.
• [MaulsbyD93a] (*) Maulsby, David L. and Witten, Ian H. "Metamouse: An Instructible Agent for Programming by Demonstration", Chapter 7 in "Watch What I Do: Programming by Demonstration", Halbert, Kurlander, Turransky eds., 1993, acypher.com/wwid
  • System learns to recognize graphical operations of user by pushing a graphical turtle on a display touchscreen, such as sorting graphical objects by size.
• [MaulsbyD94a] (*) Maulsby, David "Instructible Agents", Ph.D. Thesis, Univ. of Calbary, Canada, June 1994
  • (partial copy) Chapter 5: Interactive learning / Concept learning system Cima, Turvy, and Moctec. Example is teaching system to find phone numbers in notes, in different contexts and in various canonical forms, and second component that learn so intract with users and application programs, (dialing numbers)
• [McKeehan94] (*) McKeehan, Julie and Rhodes, Neil "Programming for the Newton: Software Development with NewtonScript", AP Professional Press, division of Academic Press, 1994, ISBN 0-12-484800-1
  • Newtonscript Language
• [McQueenJC95a] (*) McQueen, J. Craig; MacKenzie, I. Scott; and Zhang, Shawn X. "An Extended Study of Numeric Entry on Pen-based Computers", Proc. of Graphics Interface '95, Toronto, pp. 215-222
  • Pie-pad pop-up menu for numeric input, pop-up circular menu with digits. Marking menus. Mentions Goldberg 93 paper on unistroke.
• [MeyerA95] (*) Meyer, Andre "Special Feature: Pen Computing - A Technology Overview and a Vision", ACM SIGCHI Bulletin, July 1995. Also available at http://www.amug.org/amug/sigs/newton/nanug/PenReport/References.html
  • Includes reviews of several experimental systems of the early 1990's, and a lengthy bibliography: several German references included. Almost all the references are from 1991 to 1995, very little before that.
  • Unistrokes. Jotted notes: implying electronic ink as a data type. PenPoint, Windows for Pen Computing. Cites Alan Kay for early visition of handwriting computer (although no such device was ever built?). Cites early paper by Ward, but not the on-line bibliography (1995).
• [MichelS93a] (*) Michel, Steve and Coleman, Dale "MacWrite Pro Inside & Out: A comprehensive Guide to MacWrite Pro", Osborne / McGraw-Hill, 1993
  • MacWrite word processing / electronic publishing
• [Microsoft91a] (*) Microsoft "Microsoft Mouse Programmer's Reference", Microsoft Press, 1991, ISBN 1-55615-336-8
  • Description of MENU.COM, *.MNU files, MENUMAKE.DOC, MENUREAD.ME. Mouse menus allow for support of mouse in DOS applications that are not "mouse-aware". MENU.COM uses static menu definitions, expert menus are *.COM files with specific knowledge of application. Compare with keyboard macros, and with recognition macros by PenCept and CIC for handwritten gestures.
• [Microsoft91b] (*) Microsoft "Microsoft Announces Visual Basic at Windows World '91", Microsoft Knowledge Base on Compuserve, "Visual Basic" through June 25, 1991: fetched 2012 from yfondeur.tripod.com/vbkbase1.htm
  • Announcement of Visual Basic by Microsoft with support for Pen Windows / Windows for Pen Computing.
• [Microsoft92a] (*) Microsoft "Differences Between VB 3.0 Standard and Professional Editions", support.microsoft.com, article Q113334, 1992, republished October 29, 2003 Revision 2.0 as ID 113334
  • Visual Basic 3.0 Pro edition: Pen controls: Bedit, HEdit, PenInk on BitMap for electronik ink, Pen On-screen Keyboard synthetic keyboard for input to the active control.
• [Microsoft92b] (*) Microsoft "The Windows Interface: An Application Design Guide", Microsoft Press, Microsoft Programming Series, 1992
  • Section on The Pen Interface (Pen Windows): pen techniques include tap, press-hold-drag, write-draw. List of gestures include pig-tail, up-right (Tab), down-left (newline), undo, check-mark, with list of keyboard equivalents. Mentions circle gestures, both positional and non-positional for pen-aware and pen-unaware applications. Use of pointers (cursors) to provide feddback for fine positioning, drag areas, what pen actions are currently enabled. Pop-up menus with either mouse button.
  • Two editions: one contains floppies with software, different price, same contenxt except for advertizing in the back.
• [Microsoft93a] (*) Microsoft "Understanding Pen Drive functionality under Windows", support.microsoft.com, article Q94701, republished January 8 2003 as ID 94701
  • Mouse/Pen driver for Microsoft Windows for Pen Computing 1.0 (Pen Windows 3.1). Sample driver was for a Wacom tablet: Scriptel also supported (other reference). States that pen behaves similar to a mouse when Windows for Pen Computing is not present. Includes support for non-integrated separate tablet. Tablet data rate and resolution can be set dynamically.
• [Microsoft93b] (*) Microsoft "Microsoft Visual C++ User's Guides: Visual Workbench User's Guide; App Stuio User's Guide", Microsoft Corporation, 1993
  • Tutorial documentation on Microsoft C++ Development System for Windows Version 1.0. Supplants Programmer's Workbench (PWB). Not same as more expensive professional edition. For Visual C++ 2.0? Describes browser windows, GUI editor with component pallette, similar to SIP Soft Input Panel in Tablet PC.
• [Microsoft93c] (*) Microsoft "Microsoft Visual C++ Programmer's Guides: C++ Tutorial; Class Library User's Guide; Programming Techniques", Microsoft Corporation, 1993
  • Microsoft Visual C++ Development System for Windows.
• [Microsoft93d] (*) Microsoft "Q94701: Understanding Pen Driver Functionality Under Windows", Microsoft Corporation, 1993 (republished 2003 as Article 97401
  • Pen Driver (mentions WACOM tablet) for Windows for Pen Computing / PenWindows 1.0, Windows 3.1. Refers to "Architecture of Windows Pen Drivers"
• [Microsoft94a] (*) Microsoft "Tap and Tap-and-Hold Pointer Events", Article 86921, formerly Q86921, support.microsoft.com: Microsoft Corporation, 1995, last reviewed January 9, 2003
  • Tap and hold (TapNHold) gesture: tap analogous to clicking left mouse button: TapNHold click tip of pen on tablet and holding for a specified amount of time. German edition of (discontinued) support article documents Windows for Pen Computing 1.0, prior to Windows95.
• [Microsoft95a] (*) Microsoft "The Windows Interface Guidelines - A Guide for Designing Software", Microsoft Corporation, Feb. 1995
  • UI guidelines include keyboard, mouse, and Windows for Pen Computing / PenWindows gestures: General circle-around-UC-letter gestures, has circle-M/M-circle pop-up "context menu gesture" / "pen menu gesture". Fundamental behaviors defined for a Pen are Pressing/Tapping/Double-tapping/Dragging. Gestures leave ink. Lasso-tap (circle-tap) selection gesture. Tap on text box brings up text-input handwriting window, with alternative word list or alternative character list from recognizer.
  • Partial print copy in physical file -- see electronic copy at http://www.ics.uci.edu/~kobsa/courses/ICS104/course-notes/Microsoft_WindowsGuidelines.pdf (fetched 2010)
  • stylus or finger, pen can perform equivalent operations of mouse.
• [Microsoft95b] (*) Microsoft "WD: Known Issues Using "Windows 95 for Pen Computing"", support.microsoft.com, article Q164505 / 164505, last Review November 5, 2000 (1995)
  • Defect in tablet/pen driver in Windows for Pen Computing: circle-m context menu gesture does not emulate right mouse button, other problems with barrel button on stylus
• [Microsoft95c] (*) Microsoft "The Windows Interface Guidelines for Software Design", Microsoft Corporation, 1995
  • Similar topic to Microsoft95a -- includes section on special design considerations of Accessibility. Some sections on pen input. Guidelines on targeting of electronic ink to fields. Lasso-tap gesture to select. Need larger tapping (double-tapping) target with stylus than with mouse, similar considersations for targeting of lasso-tap selection gesture on text. Pen menu (context menu) gesture is circle-m. Describes activate-on-lift of mouse being applied for pen: "Do not activate the window unless the user releases the mouse button (the pen tip is lifted) in that window." Press-hold-drag for select instead of barrel button. Auto-scrolling based on velocity. Mentions accessibility "Screen Review Utilites" (screen readers) for the bling, on-screen keyboards. Pop-up/context menus synonymous: refers to contextual interfaces such as pop-up menus, property sheets, and OLE drag and drop. pop-up (context) menu handlers.
  • Partial print copy in physical file -- electronic image file.
• [MicroTouchUnMouse92] (*) MicroTouch Systems Inc. "UnMouse Product information", MicroTouch Systems Inc., Methuen Massachusetts
  • Touchpad (relative motion) digitizer to replace a mouse: includes an absolute-position mode, and the use of pre-defined function templates to define additional programmable keypad.
  • Compare programmable keyboard with Kaplow
  • Presssure/force-sensitive touchpad uses light touch to simualate proximity sensing / mouse tracking on tablet, press harder to simulate touch contact
  • UnMouse marketed as accessibiliy aid device for the handicapped
  • File contains additional materials also
• [MicroTouch95a] (*) MicroTouch Systems Inc. "MicroTouch Touch Controllers References Guide, 1995", MicroTouch Systems Inc., Methuen Massachusetts
  • touchscreen/tablet/digitizer: mentions dual sensing of stylus/pen or finger or both, with positions of each.
• [Mikan94] (*) Mikan, Peter J. "Computer Mouse Simulator Device", United States Patent 5,376,946, December 27, 1994
  • Device to convert absolute co-ordinates of touchscreen to mouse relative-motion coordinates, and having "buttons" recognized on the touchpad for the mouse button: prior art include MicroTouch Unmouse cited 1990
  • Compare to Schumer patent on tablet controller, where driver functions are claimed if located in an external controller for a tablet (or mouse?)
• [MillenDR93a] (*) Millen, David R. "Pen-Based User Interfaces", AT&T Technical Journal, May/June 1993, pp. 21-27
  • Overview of PenPoint OS with core gestures, Windows for Pen Computing core and six additional gestures (does not list tap). GO MiniNote ink-editing/sketch ink note application. Brief description of prototype AT&T PDA communications device with ink communications, handwriting recognition, diamond-shaped icons on display -- few detais.
• [MinasM95a] (*) Mina, M. and Viehstaedt, G. "DiaGen: A Generator for Diagram Editors Providing Direct Manipulation and Execution of Diagrams", Proc. of VL Visual Languages 95, Darmstadt, Germany
  • Sketch/diagram editor employing constraints, and dealing with inconsistent state during direct manipulation editing: flowchart, hypergraphs
• [MinskyMDR95a] (*) Minsky, Margaret Diane Rezvan "Computational Haptics: The Sandpaper System for Synthesizing Texture for a Force-Feedback Display", Ph.D. Disseration, M.I.T, June 1995
  • Force-feedback joystick, with multiple force actuators. Software to create feel of textures, virtual spring and inverse spring forces, etc. Includes reference manual for Sandpaper software.
• [Momenta91a] . Momenta Corp. "Momenta User's Reference Manual", Momenta Corp. Oct 1991
  • GUI for pen computer. Cited in PierK92a for pop-up menus, pop-up keyboard SIP panel. Cited in Kurtenbach93 for minimum distance on press-and-hold to drag.
• [Momenta91b] . Momenta Corp. "The Momenta Computer: Background Information", Momenta Corp. 7/26/91
  • Slate tablet computer, mentions Tin Oxide (ITO?) with weak voltage gradient for touchscreen resistive digitizer, voltage conducted back to computer via tether/cable, which darkings LCD pixel to create electronic ink. Command compass marking menu. Sketch recognition. Soft-pedals handwriting recognition as "not there yet". Applications appear to be based on electronic ink, on MS-DOS. Implementation is SmallTalk 80.
• [MontanizF91a] (*) Montaniz, Frank and Mack, Robert "A Comparision of Touch Interface Techniques for a Graphical Windowing Software Environment", Proc. of Human Factors Society 35th Annual Meeting, 1991, pp. 286-289
  • Selection gesture (tap/lift-off) on touchscreen: Application provides visual indication of selection by highlighting before lift off: also mentions auditory and visual feedback (click?). Tab/hold/drag (press-hold) like click-hold-drag gesture with mouse.
• [MoranTP95a] (*) Moran, Thomas P.; Pedersen, Elin R.; McCall, Michael K.; and Halasz, Frank G. "Time-Space Object Containment for Graphical User Interface", United States Patent 5,404,430, April 4, 1995
  • When selecting objects by selecting a range (drag selection rectangle?), take into account time ordering of when objects were created: user is likely to want to select objects created by the user at about the same time. Uses a white board with rear projection.
• [MoranTP95b] (*) Moran, Thomas P.; Chiu, Patrick; van Melle, William; and Kurtenbach, Gordon "Implicit structure for pen-based systems within a freeform interaction paradigm", Proc. CHI '95, (preprint)
  • Whiteboard system (Xerox Live-Board Tivoli / MeetingBoard on Windows PC) with free-form interaction -- primarily electronic ink scribbling: recognized rough layout of lists, text, tables, and indented outlines in electronic ink, based on informal structure or "visual grammars". Mentions aha! InkWriter which formats/indexes ink based on handwriting recognition, but does not compare with van Raamsdonk which edits directly electronic ink. Selection via various bracket and corner gestures, insert via caret gesture. Has "table clean-up" function to align slanted writing lines of electronic ink.
• [More93a] (*) More, Edward S., and Aiken, John C. "Electro-optic Slate for Direct Entry and Display and/or Storage of Hand-entered Textual and Graphic Information", United States Patent 5,194,852, March 16, 1993
  • digitizer tablet combined with LCD display: shown in a PDA sample, hand-held slate computer
  • also shows chain-code recognition of connected and disjoint characters
  • Handwriting recognition is done in separate area from electronic ink: side-menu GUI for text-editing
• [Mosaic95] (*) Mosaic Input Technologies, Inc. "Gesture Mosaic User Guide", www.amtelcom.com/Mosaic/UserGuide.html
  • Simplified unistroke-like gestures, as substitute for writing full characters. User writes on a 12-segment outline of characters, outline in shape of figure eight, similar to seven-segment display. Punctuation and some other characters input via pop-up keyboard. For Apple Newton. (See also AlphaPad00)
• [MoskowitzD93a] (*) Moskowitz, David and Kerr, David, et al "OS/2 2.1 Unleashed", SAMS Publishing, 1993
  • OS/2 Presentation manager, palette manager, scheme palette: dynamic scheme/theme management via GUI as pop-up context menu on mouse button 2.
  • Partial copy
• [Motif94a] (*) X Window System, Open Source Edition "The Definitive Guides to the X Windows System, Vol. 6a: Motif Programming Manual for Motif 2.1, Open Source Edition", www.opencontent.org/openpub
  • Motif Window Manager: 1994 version, updated as of 2001. resource XmNsnapBackMultiple sets snap-back/bounce distance if use moves mouse cursor too far outside of bounds of scrollbar widget. Automatic Layout of GUI elements? XmNselectThrehold: click and drag minimum distance that pointer must move to select text on a drag.
• [MyersBA92a] (*) Myers, Brad A. and Zanden, Brad Vander "Environment for rapidly creating interactive design tools", The Visual Computer, Springer Verlag, 1992, No 8: pp. 94-116
  • In Garnet system papers: describes Garnet UIMS toolkit. Look and feel independent, examples are lists, buttons, sliders. Humanoid toolkit built on top of Garnet. Prototype-based objects, objects saved to file. Dynamic editing of graphical objects, even while they are being viewed. Automatic graphical update.
• [MyersBA92b] (*) Myers, Brad A. and Rosson, Mary Beth "Survey on User Interface Programming", Proc. CHI '92, May 3-7 1992, pp. 195-202
  • In Garnet system papers: one need cited was problem with code being too tightly coupled to a particular toolkit. Most users used Motif, OpenLook, or commercial windowing e.g. DEC, Microsoft Windows
• [MyersBA92c] (*) Myers, Brad A.; Guise, Dario A.; and Zanden, Brad Vander "Declarative Programming in a Prototype-Instance System: Object-Oriented Programming Wihtout Writing Methods", Proc. OOPSLA 92, pp 184-200, May 3-7 1992, pp. 195-202
  • In Garnet system papers: define (much of) interactive behavior in declarative parameters, fewer call-backs in GUI definition. Compares Garnet to SELF (prototype inheritance?). Edits to prototype object immediate appear in all instances, even in running system: example is buttons. Persistence via retained-object model. Gesture-Interactor class: e.g. free-hand "X" gesture to delete
• [MyersBA92d] (*) Myers, Brad A. "State of the Art in User Interface Software Tools", Carnegie Mellon University report CMU-CS-92-114, Feburary 1992, also in Advance in Human Computer Interaction, Vol. 4, 1992
  • UIMS for Direct Manipulation. Designing a user interface is an iterative design process.
• [MyersBA93a] (*) Myers, Brad A. "Garnet: Uses of Demonstrational Techniques", In "Watch What I Do", Allen Cypher, ed., MIT Press, 1993, pp. 219-233
  • In Garnet system papers: behaviors and styles of UI object can be defined at runtimes. Includes prototype/by-demonstration support for pen gestures. GILT (Garnet Interface Layout Tool) support graphical styles: style is a named set of properties that can be applied to widgets.
• [MyersBA93b] (*) Myers, Brad A.; Wolf, Richard; Potosnak, Kathy; and Graham, Chris "Heuristics in Real User Interfaces: Panel Discussion", Proc. INTERCHI '93, 24-29 April 1993, pp.l 304-307
  • In Garnet system papers: mostly about heuristics in interactive programs, examples are renumbering in word-processing program to be like numbering (to the extent detectable) user has provide as example.
• [MyersBA93c] (*) Myers, Brad A. "The Second Garnet Compendium: Collected Papers 1990-1992", Carnegie Mellon University Report CMU-CS-93-103, February 1993
  • Single publication of multiple Garnet papers on UIMS design systems
• [MyersBA93d] (*) Myers, Brad A. "Why are Human-Computer Interfaces Difficult to Design and Implement?", Carnegie Mellon University Report CMU-CS-93-183, July 1993
  • User interfaces and UIMS difficulties: UI design is iterative, complex, and hard to test due to interactions and usuability considerations, also because new UI technologies (UI, pen-based gesture recognition, Undo for multiple users, etc.) become available.
• [MyersBA93e] (*) Myers, Brad A. "User Interface Software Tools", Encyclopedia of Computer Science and Technology, 1993, pp. 371-405
  • See Myers 95 reference, same title.
• [MyersBA94a] (*) Myers, Brad A. "Challenges of HCI Design and Implementation", Interactions: ACM Trans. on Inf. Systems, Jan. 1994, pp. 73-84
  • in Garnet system papers: Prototyping user interfaces can be difficult, because test-subject users may not behave like real users, may even have a hidden agenda. Coupling of user-interface to application is a nightmare in maintainability.
• [MyersBA94b] (*) Myers, Brad A.; Guise, Daria A.; Mickish, Andrew; and Kosbie, David S. "Making Structured Graphics and Constraints Practical for Large-Scale Applications", Carnegie Mellon University Report CMU-HCII-94-100
  • Garnet system: Contraint toolkit for UIMS, including object management in user interface
• [MyersBA94c] (*) Myers, Brad A.; Dario Giuse; Andrew Mickish, Brad Vander Zanden, David Kosbie, James A. Landay, Richard McDaniel, Rajan Parthasarathy, Matthew Goldberg, Roger B. Dannenberg, Philippe Marchal, Ed Pervin "The Garnet Reference Manuals: Revised for Version 3.0", Carnegie Mellon University Report CMU-CS-90-117-R5, December 1994
  • Garnet system: Contraint toolkit for UIMS, including object management in user interface
• [MyersBA94d] (*) Myers, Brad A.; Giuse, Dario; Mickish, Andrew; Vander Zanden, Brad; Kosbie, David; McDaniel, Richard; Landay, James; Goldberg, Matthew; and Parthasarathy, Rajan "The Garnet User Interface Development Environment: Video Abstract", Proc. CHI '94, April 24-28, 1994, Boston, pp. 457-458
  • Garnet system: Direct manipulation user interface and IDE with Interactor objects for mouse, rotating, text editing, gesture recognition. Include Lapidary to create widgets or objects, Marquise tool to demonstrate/animate user interface behavior of applications
• [MyersBA94e] (*) Myers, Brad A. "User Interface Software Tools", CMU School of Computer Science, Technical Report CMU-CS-94-182, August 1994
  • Garnet system: supersedes CMU-CS-92-114. States gesture UIs used since 1970's in commercial CAD tools.
• [MyersBA95a] (*) Myers, Brad A. "User Interface Software Tools", ACM Trans. on Computer-Human Interaction, March 1995, Vol. 2 No. 1, pp 64-103
  • in Garnet system papers: describes X-Windows lack of agreement on widgets, therefore Xt instrisics so support. 3-D GUI toolkits: Brown Animation Generation System, Silicon Graphic's Inventor toolkit.
  • See also Myers 93 reference, same title.
• [NagaokaM95a] (*) Nagaoka, Makoto and Sugiyama, Soka "Information Input Device", United States Patent 5,440,080, August 8, 1995
  • Transparent X/Y digitizer/touchscreen using transparent electrode wires of ITO indium tin oxide. Stylus/pen uses a plastic film coating to get appropriate writing friction on a metal core stylus.
• [NairA91a] (*) Nair, A. and Leedham, C.G. "Preprocessing of line codes for online recognition purposes", Electronics Letters, Vol 27 No 1, Jan 3, 1991, pp. 1-2
  • (Abstract only) non-linear smoothing and filtering of digitizer tablet input to remove noise: compare with Ward 85/87
• [NationalInstruments94a] (*) National INstruments "LabVIEW Graphical Programming for Instrumentation: Student Edition (Software+Documentation)", National Instruments Corporation, 1994(?)
  • LabVIEW Graphical programming language and software for Windows 3.1: Date approximate. Contains Wells book.
• [NCR92] (*) NCR "NCR 5991 Signature Capture/Electronic Payment Terminal", NCR Corporation, an AT&T Company
  • Signature capture digitizer terminal with integrated display, shows actual sales receipt on display not just opaque signature capture pad. Uses Scriptel electrostatic front-surface digitizer.
• [NCR93a] (*) NCR "NCR 3125 con Windows 3.1", Youtube.com, fetched 2011
  • Video of NCR 3125 pen/touchscreen computer running Windows for Pen Computing / Pen-Windows, circa 1993
• [NCR93b] (*) NCR "NCR 3125 con Windows 3.1", Youtube.com, fetched 2011
  • Additional Video of NCR 3125 pen/touchscreen computer running Windows for Pen Computing / Pen-Windows, circa 1993
• [NewmanW92a] (*) Newman, William and Wellner, Pierre "A desk supporting computer-based interaction with paper documents", Proc. CHI '92, pp 587-592
  • Projected desktop on physical desktop, with machine vision recognition objects: describes projecting a virtual calculator for use on a physical desktop.
• [NeXT92a] (*) NeXT Computer "NeXTSTEP Release 3: A Demonstration with Steve Jobs", NeXT Computer: Video available on YouTube.com and methodshop.com, 2010
  • Date appoximately 1991 or 1992
• [NeXT95a] (*) NeXT Computer "The Project Builder Application", NeXT Computer, 1995
  • Part of NeXT Computer SDK. Overview of GUI tool for building/making applications.
• [NeXT95b] (*) NeXT Computer "The Interface Builder Application", NeXT Computer, 1995
  • Part of NeXT Computer SDK. Overview of GUI tool for building GUI user interfaces.
• [NeXTSTEP92a] (*) NeXT Computer, Inc. "NeXTSTEP General Reference, Volume 1", NeXTSTEP Developer's Library, Release 3, Addison-Wesley Publishing, 1992
  • NeXTSTEP Operating System and application user interface design
• [NeXTSTEP93a] (*) NeXT Computer, Inc. "NeXTSTEP Object-Orientied Software, Development Tools and Techniques", NeXTSTEP Developer's Library, Release 3, Addison-Wesley Publishing, 1992
  • NeXTSTEP Operating System and application user interface design, IDE
• [Norand97a] (*) Norand Corporation "PenKey 6622 Pen Computer User's Guide", Norand Corporiation, Cedar Rapids, Iowa Marcy 1997
  • Pen/slate touchscreen computer with MS-DOS, CIC/Handwriter, PenRight application software. On-screen virtual keyboard. Windows for Pen Computing (Windows 3.1) or Windows 95 Pen Services (pen extensions to Windows 95)
• [NovakJL94a] (*) Novak, James L. and Wiezer, James J. "Non-contact Capacitance Based Image Sensing Method and System", United States Patent 5,281,921, January 25, 1994
  • Electrostatic/mutual capacitance imaging proximity sensor for objects: single pair of electrodes to sense distance, pair of electrodes moved over object in a known plane (or otherwise)
• [Novobilski92] (*) Andy Novobilski "PenPoint Programming", Addison-Wesley, August 1992
  • General application programming tutorial for PenPoint. Chapter 7 "Using the Pen" describes acetate layer for tempory display of electronic ink prior to recognition: thus showing actual shape, compare with early "write anywhere" features of Tablet PC. Field types Integer, Date, Fixed, Text for character recognition by context. Compare with "Factoids" for Tablet PC from Microsoft. Example applications include two-dimensional mathematics/arithmetic calculator, crossword puzzle, direct manipulation of character tile objects.
• [OConner92a] (*) O'Conner, Rory J. "Apple banking on Newton's brain", San Jose Mercury News, April 22, 1992
  • Upcoming release of Apple Newton, describes recognizing "fax Scully" and invoking fax application
• [OlsenDR93a] (*) Olsen, Dan R.; Foley, James D.; Hudson, Scott E.; Miller, James; Myers, Brad "Research directions for user interface software tools", Behavior and Inf. Tech., 1993, Vol 12, No 2, pp. 80-97
  • Listed in Garnet project papers: Overview of UIMS tools, with emphasis on malleable/changeable programing: programming by demonstration, contraint systems, rule-based systems, re-use. Implementations refer to pipes, shell-scripts, and other features more common on Linux than on Windows etc.
• [Oram91] (*) Oram, Andrew and Talbott, Steve "Managing Projects with make, second edition", O'Reilly and Associates, 1993 (reprinted with corrections)
  • Unix "make" project builder. Refers to recursive invocation of make, GNU make. First Edition 1986, Second Edition 1991.
• [Organek93] (*) Organek Technology "PenPut - Beyond character recognition!", Product announcement: PenPut, and SmartCase. Organek Technology, 695 Mariposa Avenue, Suite 304, Oakland CA 94610, (510) 438-9461
  • Zone-based gestures instead of characters: pen moves in one of eight directions and three different distances to make a character, next character is made without lifting the pen:
  • Unistroke character recognition for whole words, using special directional abbreviatsions
  • Unistroke short-hand input of whole words for English: claims input speeds to 35 WPM
• [OSF93a] (*) Open Software Foundation "OSF/Motif Style Guide: Release 1.2", Prentice Hall, 1993
  • Mouse with up to three buttons: BSelect for leftmost button (except for left-handed), BTransfer middle button for moving and copying, and BMenu rightmost button for popping up menus. Also mentions mouse-button gestures such as MultiClick (double/triple/etc. mouse clicks), and MultiPress: clicks of mouse button then a normal mouse hold, and BSelect Motion 2 (notation of click). Pointer shapes (cursors) to show state of interaction: pointing arrow, I-beam for Text, X for outside of application input: fine-point and move cursors, has both hour-glass and watch "busy" pointers. Separate upper-right arrow for menu selection state. Defines pop-up menus as (context menus), in that they relate to the area pointed to.
• [Parizeau93] (*) Parizeau, Marc and Plamondon, Rejean "Allograph Adjacency Constraints for Cursive Script Recognition", Proc of Third IWFHR International Workshop for Handwriting Recognition, Buffalo NY, 1993, pp 252-261
  • Probabalistic segmentation of cursive handwriting into separate characters: operates without word dictionary / linguistic knowledge
• [Paul95] (*) Paul, Lauren Gibbons "Keeping secrets", Ziff-Davis Publishing Company, PC Week
  • Press report on trade-secret theft lawsuit between VMI and Autodesk, concerning Otto Berkes, later director of UMPC/Origami project at Microsoft
• [PavlidisT92a] (*) Pavlidis, Theo; Swartz, Jerome; and Wang, Ynjiun P. "Information Encoding with Two-Dimensional Bar Codes", IEEE Computer, June 1992, pp. 18-28
  • Overview of two-dimensional bar codes circa 1992: Code 16K, Code 49, PDF417, Identcode MLC-2D, Datacode Philips dot code, Softstrip, Manchester code.
• [PedersenER93a] (*) Pedersen, Elin Ronby; McCall, Kim; Moran, Thomas P.; and Halasz, Frank G. "Tivoli: An Electronic Whiteboard for Informal Workgroup Meetings", Proc. INTERCHI '93, April 1993; pp. 391-398
  • Remote whiteboard application on Xerox Liveboard with gesture user interface: line (horizontal) gesture to edit electronic ink to create space, lasso/loop gesture, compound gestures. Double-tap causes previous stroke to be interpreted as a gesture, holding pen barrel button (Pencept?) to indicate gesture. Up to three pens/user simultaneously (multi-touch): users could thus share selections and graphical tools.
• [PenComputing95a] (*) Pen Computing Magazine "Gesture Mosaic: Newton Software Review", Pen Computing Magazine, Issue #6 August/September 1995
  • Review of Mosaic Input, Zone-based handwriting recognition using figure-eight overlay. Awkward to learn, vendor claims 40 words per minute input rate with practice.
• [PenComputing95b] (*) Pen Computing Magazine "IBM ThinkPad 730TE: Product Review", Pen Computing Magazine, Issue #7 November/December 1995
  • Pen tablet PC using Wacom digitizer. Mentions "Dynapad" by Alan Kay: Mistaken reference to Dynabook? Provided with choice of PenPoint, PenDOS, Pen for OS/2 Warp, PenRight!, or Windows for Pen Computing 1.0. Uses ThinkWrite handwriting recognition instead of Microsoft MARS recognizer.
• [PenComputing95c] (*) Pen Computing Magazine "Casio DT-9000 Product Review", Pen Computing Magazine, Issue #7 November/December 1995
  • Casio PDA: does not mention pen or handwriting input. "handy terminal" vendor description. Comparison with Panasonic JT-900PT. Includes printer.
• [PenComputing95d] (*) Pen Computing Magazine "Pen Computing and Windows 95", Pen Computing Magazine, Issue #7 November/December 1995
  • Windows for Pen Computing version 1.0 not easily upgradable to Windows 95 -- now refereed to as pen service Windows for Pen. Windows for Pen Computing development environment: Visual Basic with version 2.0 pen services penctrl.vbx updated to pen2ctrl.vbx.
• [PenComputing95e] (*) Pen Computing Magazine "Programming Visual Basic for Pen Input", Pen Computing Magazine, Issue #6 September 1995
  • Mentions HEDIT and BEDIT (boxed edit) handwriting input controls shipped with Visual Basic. Windows for Pen Computing development environment: Visual Basic with version VB3.0/Pro with provided HEDIT and BEDIT controls.
• [PenComputing95f] (*) Pen Computing Magazine "PenRight! for Windows", Pen Computing Magazine, Issue #5 June/July 1995
  • PenRight by Philip Shoemaker: MSDOS, MSDOS DPMI, and MSWindows pen-enabled platforms. Includes cross-platform support for Graffiti
• [PenComputing95g] (*) Pen Computing Magazine "HOPE! Development Environment", Pen Computing Magazine, Issue #7 December 1995
  • HOPE! for porting applications from Visual Basic to a PDA that does not run Windows: emulated Windows user interface.
• [PenComputing95h] (*) Pen Computing Magazine "First Look: Newton OS 2.0", Pen Computing Magazine, Issue #7 December 1995
  • Description of Newton OS NOS ("Dante") 2.0
• [PenPointPress91] (*) PenPointPress "Press announcements on GO/PenPoint", (Various)
  • Press announcement related to GO/PenPoint: business with IBM, etc.
• [PenPoint91a] (*) PenPoint "PenPoint UI Design Guidelines", GO Corporation, Feb 15, 1991
  • User interfaces / gesture /stylus design guidlines for PenPoint OS operating system. Mentions proportional flicking gestures for scolling: longer flick gesture, scroll farther.
• [PenPoint91b] (*) PenPoint "Video Demonstration, PenPoint Corporation 1991", GO Developers Summit, 1991, Jerry Kaplan
  • Video presentation about PenPoint/GO operating system. Mentions Slate Corporation PenApps, electronic ink mark-up/annotation, ink as a datatype. Mnemonic gestures: e.g. "u" gesture to underline. Square bracket gestures to extend text selection.
• [PenPoint91c] (*) PenPoint "Using Penpoint: Developer Release - Beta Edition", GO Corporation, 1991
  • User interfaces / gesture /stylus design guidlines for PenPoint OS operating system.
• [PenPoint92] (*) PenPoint "PenPoint for the Samsung PenMaster", Samsung Part Number SPM-PON, 1992
  • Unopened software package: PenPoint operating system with user manuals and media for Samsung Penmaster
• [PenPoint92a] (*) PenPoint "PenPoint Architectural Reference Volume 1; PenPoint Architectural Reference Volume 2, 1992", GO Technical Library, Addison-Wesley Publishing,
  • Includes long list of gestures, shown in a Font table
• [PenPoint92b] (*) PenPoint "PenPoint User Interface Design Reference", GO Technical Library, Addison-Wesley Publishing, 1992
  • Page 133 list of gestures, some of which are upper-case character e.g. letter B for Bold: Compare with PenCept recognition macros circa 1985. Flick gestures, compound gestures of multiple uses of the same sub-gesture strokes, with semantically similar meaning. Handles: resize handles at the coners and at the midpoint of the edges of sides of object's bounding rectangle. Selection can be extended by dragging (a handle on a bounding box?)
• [PenPoint92c] (*) PenPoint "PenPoint Application Writing Guide: 1st ed. 1992; 2nd ed. 1993", GO Technical Library, Addison-Wesley Publishing, March 1992
  • Operating system based on Notebook metaphor rather than Desktop methaphor: Running documents are instances of application classes, visual components of anotebook, Section name and page number location combine to form a location in the OS file system. Refers to browser component (for files and other objects). File system is not separate memory, describes installation process as different from MS/DOS.
• [PenPoint92d] (*) PenPoint "PenPoint API Reference Volumne 1; PenPoint API Reference Volumne 2", GO Technical Library, Addison-Wesley Publishing, March 1992
  • Operating system using gestures based on Notebook metaphor rather than Desktop methaphor -- Class Manager, PenPoint Application Framework, ImagePoint; PenPoint UI Toolkit; File System; Text Component for text editing with gestures, System Service; PenPoint Resource Files
• [PenPoint92e] (*) PenPoint "PenPoint Development Tools", GO Technical Library, Addison-Wesley Publishing, March 1992
  • Operating system based on Notebook metaphor and using gestures rather than Desktop methaphor -- PenPoint DB debugger, profiling, Mini-Debugger, DOS file system utilities, S-Shot Screen Capture Utility; Running PenPoint on a PC
• [PenPoint92f] (*) PenPoint "The PenPoint Technical Papers", GO Technical Papers, GO Corporation, 1992
  • Pen-based Operating system using gestures based on Notebook metaphor rather than Desktop methaphor. Technical papers describing main features and market opportunities of mobile pen-computing in general and of PenPoint in particular
• [PenPoint94a] (*) PenPoint "Video: 1994 Demo 1 PenPoint for ATT/ EO", wanderbookman.com, posted September 25 2008 on Youtube.com (three parts)
  • 1994 Video: Demonstration of PenPoint / EO unit. Youtube comments mention direct maniupation and gesture UI, also demonstration of convertible tablet computer before Microsoft did a convertible.
• [PenRight93a] (*) AST Research "PenRight! Application User's Guide", PenRight! Pro Software Development Kit for C programmers version 3.5, July 1993, AST Research, Fremont CA
  • Contains chart of handwritten character shapes for discrete characters, strongly reminiscent of PenCept PenPad and CIC Handwriter. Accented characters, dieresis (umlaut), tilde. Blank is struck-through lower-case B, or underbar, not inverted "U". Boxed fields: Overstrike fields, or insert (compare with PenCept patent?): text-editing UI includes an insertion bar gesture for handwriting, line brake (compare with PenWindows and PenPoint) pop-up keyboard. All for MS-DOS.
• [PenRight93b] (*) AST Research "PenRight! Pro Software Development Kit for C programmers, Version 3.5", AST Research, Fremont CA July 1993
  • Pen development SDK: includes floppies, documentation (6 manuals).
• [PenRight93c] (*) AST Research "PenRight! Pro Tools User's Guide", PenRight! Pro Software Development Kit for C programmers version 3.5, July 1993, AST Research, Fremont CA
• [PenRight93d] (*) AST Research "PenRight! Pro Learning Guide", PenRight! Pro Software Development Kit for C programmers version 3.5, July 1993, AST Research, Fremont CA
• [PenWindows92a] (*) PenWindows: Microsoft Corporation "Microsoft Windows for Pen Computing: Programmer's Reference, Version 1 Designed to work with Windows 3.1", Microsoft Press, 1992
  • Pen Message Interpreter, Pen Macro Layer for gestures: does not contain list of gesture shapes. Pages 16..20, description of differences between mouse and electronic ink drivers, coalescing of mouse messages to report final position (lift) only, etc. Refers specifically to shape recognition for gestures. Uses term "enhanced pen aware" or "pen-enhanced" instead of "pen-centric" for applications designed specifically for pen/gesture/handwriting input. Page 8, difficult to point at single pixels (small targets) with stylus touchscreen accuracy.
• [PenWindows92b] (*) PenWindows: Microsoft Corporation "PenWindows: Overview of the Pen API - PENAPI.HLP", Microsoft Corporation - PENAPI.HLP for PenWindows 1.0
  • HLP file with documentation for Pen Windows 1.0 -- 1992
• [PenWindows92c] (*) Microsoft Corporation "Microsoft Windows for Pen Computing: Programmer's Reference", Microsoft Corporation, 1992
  • Windows for Pen Computing / Pen Windows: also known as Pen Extentions. Programming documentation for Pen Windows 1.0, for Windows 3.1.
• [PenWindows95a] (*) PenWindows: Microsoft Corporation "Pen Computing and Windows 95", Pen Computing, Number 7, December 1995
  • Windows for Pen Computing version 1.0 versus version 2.0, boxed edit control, hedit handwriting edits
  • Lisa Sampfli, PenFact Inc. in Boston Massachusetts
• [PenWindows95b] (*) PenWindows: Microsoft Corporation "Programmer's Guide to Pen Services for Microsoft Windows95", Microsoft Press, ISBN 1-55615-835-1
  • Gestures p. 61: Circle gestures with letter: Lasso: p. 481 shows list of circle gestures by shape, using mnemonic characters -- compare to "recognition macros" of PenCept; HPENDATA object holds chunks of electronic ink data, separate from mouse messages. WM_LBUTTONDOWN / IsPenEvent() / DoDefaultPenInput: electronic ink data is associated as extra data (HPENINFO) attached to a mouse event. Defines stroke pen data between two pen tip transitions, hence touching strokes and in-air/proximimity strokes. (What about out of proximity?) Context menu in bedit (boxed handwriting edit) controls. Single tap and double tap on character bring up a (context) menu/list of alternative characters/words.
• [Perlin93] (*) Perlin, Ken and Fox, David "An Alternative Approach to the Computer Interface", Proceedings of SIGGRAPH 93
  • Virtual workspace, zooming into different sections to simulate the user-interface metaphor of a large physical workspace. Refers to this as a "Pad" interface. Shows zooming into sections of a calendar: compare with Slate "DayTimer" Pen-Scheduler product from 1991 (not cited, perhaps he was not familiar with it: Bricklin patent?).
• [PetzoldC92a] (*) Petzold, Charles "Programming Windows 3.1, Third Edition", Microsoft Press, 1992
  • Windows 3.1 UI and programming guide, 1992. Checker example shows using SendMessage to emulate mouse events from keyboard input.
• [PlaisantC92a] (*) Plaisant, Catherine and Wallace, Daniel "Touchscreen Toggle Design", Proc. CHI '92, May 3-7, 1992, pp. 667-668
  • Touchscreen virtual toggle and slider switches: See also CHI '92 video (reference in file)
• [PLDOS95] (*) www.pldos.pl "PC Dos 2000 Details", www.pldos.pl/pcdos
  • General information on PC DOS and PenDOS: mentions "mouse emulation" in PenDos, separate from tablet/stylus driver: limited use of Gestures in pen-aware Mouse applications. (Web site partially in Polish)
• [PierK92a] (*) Pier, Ken and Landay, James A. "Issues for Location-Independent Interfaces", Xerox PARC Technical Report ISTL92-4, December, 1992
  • Discussion of pop-up menus and gestures for UIs that are physically scalable to work on very large surface, where location of a fixed menu on the surface may be inconvenient: gestures/input should be anywhere on the surface (like Freestyle?). Notes that mouse menus with stylus not usuable. Gestures as accelerators without lifting the stylus: make an E to bring up a pie/marking menu and continue with the pie-selection stroke without the menu actually popping up. Does not mention menus built into multi-button mouse or tablet puck Mentions pie menus in X10 window system 1986 (also press-and-hold-still). X, C, circle, box, press-hold gestures. Refers to ambiguity of input as gesture/application input as "interference problem". Describes stylus button easy to use as a solution for this modality -- compare with Pencept in 1985? Windows for Pen Computing an add-on to Windows 3.1.
• [PierK94a] (*) Pier, Ken and Landay, James A. "Issues for Proximate User Interfaces", Xerox PARC Technical Report, April 19, 1994, available via internet
  • User-interface for large surfaces needs UI without static-placed element (e.g. pull-down menus). Pop-up pie menus, hierarchical menus, pop-up handwriting recognition pads, gestures, vocal user interface. Problems studied in example of Xerox Liveobard whiteboard system. Cites pop-up menus to moveable menus of Wiseman, Xerox Alto 1976. PenPoint, GO, PenWindows, Momenta.
• [Pimax95] . Primax Electronics Ltd. "DataPen User's Guide", Primax Electronics Ltd.
  • Cited in Aries97 for optical digitizer
• [PiwetzC95a] (*) Piwetz, Christian; Eiffert, Frank; Heck, Helmut; and Mueller-Clostermann, Bruno "An Adjustable User Interface Providing Transparent Access to Application Programs for the Physically Disabled", ACM SIGCAPH Newsletter, January 1995
  • Graphical/virtual/synthetic keyboard on-screen keyboard on Apple MacIntosh, usable with mouse without physical keyboard. Also includes predictive type-ahead. Main use is as accessiblity technology, combined with dwell-mouse for handicapped use.
• [PollackA91a] (*) Pollack, Andrew "Technology: Positioning the Electronic Stylus", The New York Times, March 17, 1991
  • Report on tablet digitizer for the new products known as pen computers: Wacom, Scriptel, Kurta, Calcomp, Summagraphics, Numonics, Seiko, Hitachi adapting opaque digitizers, Resistive coating from Gridpad, Microtouch. Electrostatic from Scriptel. Cites Jean Renard Ward on digitizer impact on handwriting recognition accuracy.
• [PollackA91b] (*) Pollack, Andrew "A Battle in Pen-Based Computers", The New York Times, January 22, 1991
  • Report on PenPoint from Go Corporation, plus Microsoft hot on the heels of PenPoint. Big Market expected. Mentions also Grid Systems (owned by Tandy/Radio Shack). Investors in Go include Mitch Kapor, Apple. Bill Gates following Mitch Kapor to Japan. Quotes Phillipe Kahn saying Microsoft was copying Go. Quotes Vern Rayburn of Slate, storying electronic ink image itself.
• [Poyner94] (*) Poyner, Rick "Wintab Backgrounder", LCS/Telegraphics, Cambridge Massachusetts, 1994
  • Industry-standard driver from www.pointing.com/LCS-Telegraphics to allow all (DOS) applications to use pointing devices (mouse/tablet/touchscreen/joystick/etc.) interchangeably. Wintab/Windows/Pen Windows: mentions tablet sharing, multiple application accessing tablet at once with different services: different tablet context objects for different (concurrent) applications, tablet packets with data for a high report rate. Driver supports command-input area, WT_PACKET window messages.
  • Wintab also mentioned in Windows95/W4PC/TabletPC documents.
  • Also exists in version from about 2003 with minor updates from Wacom (see file)
• [Quinnell95] (*) Quinnell, Richard A. "Cover Story: Touchscreen Technology", EDN Magazine, November 9, 1995. Available from http://www.end.com/archives
  • Technology review of touchscreens: flexible resistive film (a la Elographics), Capacitive, Capacitive zone, SAW surface acoustic wave or SAW guided acoustic wave, IR infra-red touchscreens, strain gauge. Refers to problems with capacitive touchscreens. Mentions that acoustic SAW screens can sense multi-touch more than one point of contact. Capacitive proximity sensing (Microtouch zones). Does not use the word tablet. Cites Scriptel/Symbios electrostatic tablet with proximity sensing. Describes fabrication expense of rear-mounted electromagnetic digitizers. Electronic ink in windows 95.
• [RamanaR92a] (*) Ramana, Rao; Card, Stuart K.; Jellinek, Herbert D; Mackinlay, Jock D., and Robertson, George G. "The Information Grid: A Framework for Information Retrieval and Retrieval-Centered Applications", Proc. UIST 92, Nov 1992, pp. 23-32
  • X-buttons.
• [RashidR93a] (*) Rashid, Richard "Speech Transcript - Rick Rashid, Microsoft Professional Developers Conference 2003, October 29, 2003", www.microsoft.com - Microsoft News Center
  • Asserts that Tablet PC came out of work at Microsoft Cambridge research lab, Charles (Chuck) Thacker. Demo applications (from Pen Computing group at Brown University? see Andries van Dam) are Math Pad, Magic Paper (sketch recognition) by Randall Davis at MIT AI lab. (No mention of Pen Windows)
• [RegisterDS95a] (*) Register, David S. "Stylus Operable Computer with Wireless Keyboard in Storage Bay", United States Patent 5,440,502, August 8, 1995
  • Handheld computer with slide-out/detachable keyboard: Mentions Momenta
• [RheingoldH93a] (*) Rheingold, Howard "The Virtual Community: Homesteading on the Electronic Frontier", Addison-Wesley Publishing Company, Reading, MA 1993
  • Electronic copy only
  • General Magic, former architests of Apple Macintosh created personal intelligent communicator, stylus based PDA similar to Apple Newton. Thrust of book is electronic democracy: world network communiication (later: blogs and email and internet) will make democratic revolutions hard to prevent.
• [Robertson91a] (*) Robertson, George G., Henderson, D. Austin Jr. and Card, Stuark K. "Buttons as First Class Objects on an X Desktop", Proc. UIST 91, Nov 11-13 1991, pp. 35-44
  • Gesture-based buttons, actions tailorable/definable by user/designer, as for other first-class objects e.g. icons, menus, windows. Gestures mentioned include flick left/right/up/down, click, rubout, check, insert (inverted "V"?) Electronic ink ("mouse track") shows actual marking, removed after recognition. Gesture must start inside button due to X-Windows, therefore gestures such as circling/lasso not possible. Caret/insert/edit gesture brings up gesture (actualy macro) editor to define which of standard gestures should be associated with an object, and what they should do.
• [RubinSM94] (*) Rubin, Steven M. "Computer Aids for VLSI Design, Chapter 10: Human Engineering", Web reference at www.rulabinsky.com/cavd/text/chap10-6.html
  • Bibliography only: contains reference to Ledeen Recognizer in Newman/Sproull textbook, other interactive editors (without character recognition): Application GUI using Ledeen recognizer
• [Rubine91] (*) Rubine, D. "Specifying gestures by example", ACM SIGGRAPH '91 Proceedings, Computer Graphics Vol 25 No 4, 1991, pp 328-337.
  • Trainable, unistroke/single-stroke gestures, single-stroke X and delete symbols, using hotspots, etc. Recognition of gesture on every input point "eager recognition", allows transition to direct manipulation without lifting stylus. Multi-touch gestures (LeeSK85)
  • Cited in Lipscomb91, Arvo00. File also contains numerous reference *to* Rubine for gesture UIs, sketch understanding and recognition, etc.
• [Rubine91a] (*) Rubine, D. "The Automatic Recognition of Gestures", PhD Thesis, Carnegie Mellon University, 1991, technical report CMU-CS-91-202
  • Gesture recognition and definition system: trainable recognizer, simple API programming language for defining semantics/operations using GRANDMA Smalltalk MVC Model/View/Controller or Model/View paradigm. Refers to single-path gestures (mouse/status) and multi-path gestures (multi-touch finger input with several fingers). Cited in Goodisman as comprehensive reference. Multi-touch input using DataGlobe, Sensor Frame, or multiple-finger touch pad. Trainable classifier/recognizer for multi-touch gestures. G-clef music score editor patterned after Buxton (but used recognition of shapes, not of directional changes?)
• [Rubine91b] (*) Rubine, D. "Integrating gesture recognition and direct manipulation", Proc. of the summer '91 USENIX Technical Conference, 1991, available at http://reports-archive.adm.cs.cmu.edu/anon/itc/CMU-ITC-100.pdf
  • Describes mouse gestures in a trainable system; refers to "eager recognition" where recognition starts before stylus lift / end of stroke. "GRANDMA": Gesture recognition and direct manipulation in the same interface, by using sub-gestures in a direct-manipulation stroke, recognition of gestures within a stroke. Shows similar (single-stroke) gestures for moving text and moving drawing objects (taken from Buxton).
• [Rubine91c] (*) Rubine, Dean Harris "The Automatic Recognition of Gestures", Ph.D. Thesis, Carnegie Mellon University, December 1991, CMU-CS-91-202
  • Describes mouse gestures in a trainable system; refers to "eager recognition" where recognition starts before stylus lift / end of stroke. "GRANDMA": Gesture recognition and direct manipulation in the same interface, by using sub-gestures in a direct-manipulation stroke, recognition of gestures within a stroke. Shows similar (single-stroke) gestures for moving text and moving drawing objects (taken from Buxton). Mentions 95% recognition rate means 1/20 gestures misclassified, therefore need easy access to abort and undo operations in user interface. Mentions Nakatani multi-touch device observed at Bell Labs to track up to 10 fingers simultaneously, and radio drum to sense 3-D positions of multiple styli/fingers. Brief review of PenPoint with press-and-hold, and Button Box press-and-hold. Mentions multiple-finger gesture recognition via MDP software. Refers to multiple-fingure gesturs as multi-path, since more than one path/position may be traced using multiple fingers. Describes GRANDMA, a tool for building gesture-based applications using single stroke gestures (continuous lines); includes defi nition of gesture.
• [Rubine92] (*) Rubine, Dean Harris "Combining Gestures and Direct Manipulation", Proc. ACM Conf. on Human Factors in Computing Systems (CHI'92) pp 659-660, May 1992
  • Defines gesture as handmade mark to give a command to a computer, using placement/size/orientation of mark also. Gestures terminated and recognized on dwell (gesture), user may continue input (e.g. line gesture, dwell, drag line). GDP: Single stroke (Unistroke) gestures only, for mouse-baed drawing program. GSCORE: Musical score editing. Eager recognition when user pauses, rather than at end of stroke.
  • See also CHI Video, 1992.
• [Ruggedware94] (*) RuggedWare "Using Pen on the Road", RuggedWare Ltd., Denver Colorado
  • Sales Automation application using Windows-based pen computer. Input into "letter guides", boxed character recognition input, makes distinction between character cells which are empty, and those which contain a space. Compare with Ward patent on simulated keyboard input using handwriting input.
• [RusD94a] (*) Rus, Daniela and Subramanian, Devika "Designing structure-based information agents", Report SS94-03-012, Working Notes of 1994 AAAI Spring Symposium on Software Agents, pp. 79-86",
• Automatic software agents recognize text, but also figures, tablet, paragraphs of interest, via detectors and add information links (actions).

      Main Reference Page