(1996..2000) History of Pen and Gesture Computing

History of Pen and Gesture Computing:
Annotated Bibliography in On-line Character Recognition, Pen Computing, Gesture User Interfaces and Tablet and Touch Computers

References from the approximate years 1996 to 2000.

This compilation and all annotations are copyright © Jean Renard Ward, 1993, 2004, 2011.
Permission is granted to use this information in publication, including confidential reports, provided that accompanying text clearly makes reference to the URL for this page, along with the statement:

Source: Annotated Bibliography in On-line Character Recognition, Pen Computing, Gesture User Interfaces and Tablet and Touch Computers Copyright Jean Renard Ward
These are items in my personal collection, either as physical items or (sometimes) as PDF files. I can be contacted at jrward@alum.mit.edu.
Copyright © Wed Feb 27 19:47:33 EST 2013 .

Mirrors of this page can be found at:

http://users.erols.com/rwservices/pens/biblio00.html
http://216.15.114.196:81/pens/biblio00.html
http://rwservices.no-ip.info:81/pens/biblio00.html (Generally most up-to-date)

Main Reference Page

[AkamatsuM96a]
(*) Akamatsu, Motoyuki and MacKenzie, I. Scott "Movement characteristics using a mouse with tactile and force feedback", Int'l. Journal of Human-Computer Stides, 1996, Vol 45, pp. 483-493
- Mouse with tactile and forc (haptic) feedback: slight improvement in targetting when mouse has "drag" fource in addition to touch sensing ("drag" force by magnetic coupling)

[AllardD97]
(*) Allard, David J; Canova, Francis J. jr.; Johnson, Debra A.G.; Lanier, Charles S.; Lewis, James R.; Tiller, Byron K.; Villafana, William; and Yee, Raymond L. "Personal Communicator Having Improved Zoom and Pan functions for Editing Information on Touch Sensitive Display", United States Patent 5,615,384, March 25, 1997
- Pan and Zoom in single gesture (with one finger, not multi-touch) with touch input on handheld device

[AllInAccess00a]
(*) AllInAccess.com "All in Access", allinacces.com/happ, 2010
- Web site with archived files for DOS and other screen readers and accessibility software: include Hal Lite, ScreenPower, ASAP, Tinytalk, Proxy 7, Vocal Eyes. Also Speech synthesizers such as Dectalk. Contact addresses (?) tspivey@pcdesk.net, or David Holladay david@duxsys.com

[AlphaPad00]
(*) American Tel-A-Systems Inc. "About AlphaPad -- AlphaPad technical information", www.alphapad.com
- Full-alphabet recognition using 12-key keypad, alternative to Mosaic zone-based handwriting recognition for PDAs by the same group

[AltmanD97a]
(*) Altman, Dan et al "System and Methods for Spacing, Storing, and Recognizing Electronic Representations of Handwriting, Printing and Drawing", United States Patent 5,613,019, March 18, 1997
- Editing of electronic ink with automatic insertion of spaces: references van Raamsdonk

[AmantRS98a]
(*) Amant, Robert St. and Dulberg, Martin S. "An Experiment with Navigation and Intelligent Assistance", Proc. IUI 98, San Franciso CA, pp. 171-178
- Experiment in showing suggestions from an intelligent assitant in a tree-view / heirarchy.

[AndoH97]
(*) Ando, Haru and Kitahara, Yoshinori "Display system Capable of Accepting User Commands by use of Voice and Gesture Inputs", United States Patent 5,600,765, Feb. 4, 1997
- GUI using touch input with both gesture and direct manipulation: cites to Put-That-There

[Anstice96]
(*) Anstice, Janice; Bell, Tim; Cockburn, Andy; and Setchell, Martin "The Design of a Pen-Based Musical Input System", Sixth Australian Conference on Computer-Human Interaction, 24-27 November, 1996, pp 260-267. IEEE Press
- Presto: Handwriting input for musical scores, including editing gestures for pop-up menus, add tails, add dots, etc. based on context of information. Scribble/scrub mark for deleting. Shows writing styles and stroke order for musical notes and stems. Notes that this is easier than normal musical writing, and faster than OCR of music using 1995 technology.

[Apple96a]
(*) Apple Computer Inc. "Newton 2.0 User Interface Guidelines", Addison Wesley, 1996, ISBN 0-201-48838-8
- Newton gestures and handwriting recognition pp 6-13 ff. Printed (block), cursive, mixed handwriting. Also shapes and sketches. Scrubbing (delete) gesture may be made in any orientation: delete shows animation (puff of smoke) for delete status. Gesture caret, caret plus long line,

[Apple96b]
(*) Apple Computer Inc. "Newton 2.0 Programer's Guide", Addison Wesley, 1996, ISBN 0-201-48838-8
- Newton gestures and handwriting recognition. Intelligent Assistant compent may be used in applications (must be programmined in explicily?): automates scheduling to calendar, reminding to to-do list, mailing, faxing, printing, calling: user can write "call" "phone" "ring" or "dial" to make a phone call, extensible to new tasks (by user?). Passes current text selection or most recent text entry to assistant. Assistant attempts to associate input string templates and dictionaries that classify the words as actions, targets, or unknown: matching done by lexical dictionaries: classification includes classifying as phone number. If Assistant cannot determine intended action, Please Picker pops up offering more options.

[Apple96c]
(*) Apple Computer Inc. "Newton MessagePad 120 (physical unit)", Apple Computer Inc, 1996
- Apple Newton (working unit), copyright and default text in unit indicates 1996.

[Apple96d]
(*) Apple Computer Inc. "Newton Programmer's Reference 2.0", Apple Computer Inc, 1996
- Programmer's reference manual for Apple Newton software development

[Apple96e]
(*) Apple Computer Inc. "The NewtonScript Programming Language", Apple Computer Inc, 1996
- Software programming language for Newton: see other references to NewtonScript

[AppleNewton96d]
(*) Apple Computer Inc. "Newton Press User's Guide for Windows", Apple Computer Inc, 1996
- Apple Newton eBook application for windows: mentions gestures and UIs of Apple Newton, including "heavy mark"

[AppleNewton97a]
(*) Apple Computer Inc. "AppGen application generator for Apple Newton", www.archive.org, Tucows Inc., April 28, 1997
- Application generator for data collection applications for Apple Newton -- see also Apple file.

[AppleNewton97b]
(*) Apple Computer Inc. "Newton MessagePad 2000 User's Manual", Apple Computer Inc, 1997
- User's manual for Apple Newton. Handwriting recognition, gestures, "Assist" function that reads a word and selects possible actions to be performed based on what the user wrote (or at least, what the Newton *thinks* the user wrote). File contains additional materisas: newton Works Word Processor User's Manual, Connection Utilities for Windows and MacIntosh, Internet Enabler.

[AppleNewton97c]
(*) Apple Computer Inc. "Newton Toolkit User's Guide for Windows", Apple Computer Inc, 1997
- User's manual for Apple Newton. Mentions drag to select via "heavy mark" gesture

[AppleNewton97d]
(*) Apple Computer Inc. "Apple Newton model", Apple Computer Inc, 1997
- Functional Apple Newton unit

[Arai97]
(*) Arai, T. et al. "PaperLink: A Technique for Hyperlinking from Real Paper to Electronic Content", CHI 97 Electronic Publications: Papers, March 22-27, 1997 (13 pages)
- VideoPen: rough laboratory prototype of small video camera mounted on a pen to capture documents as they are written, or as a hand-held OCR/image capture as documents are marked up: paper states that prototype not developed enough for realistic user studies. Cited in Jared01 re Anoto and similar technologies for optical tablet digitizer

[ArnstGJ00a]
(*) Arnst, G. Jeffrey "Schumer v. Laboratory for Computer Systems", July 6, 2000
- Report Shumer patent on virtual tablets

[Arvo00]
(*) Arvo, James and Novins, Kevin "Fluid Sketches: Continuous Recognition and Morphing of Simple Hand-Drawn Shapes", Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, San Diego, California, November 2000
- Says that providing initial recognition results while input is still being drawn (with sketches, not characters) allows lower-quality recognition to be used, because the user can stop as soon as the correct result is displayed

[Arvo00a]
(*) Arvo, James and Novins, Kevin "SmartText: A Synthesis of Recognition and Morphing", AAAI Spring Symposium on Smart Graphics, Standford California, March 2000, pages 140-147
- Shows a UI for handwriting where handwritten characters are gradually replaced by font recognition results, and pretty-fied / normalized in position

[AtkinsonR96a]
. Atkinson, Randall "Intermediate Network Authentication", United States Patent 5,511,122, April 23, 1996
- File contains additional materials, contemporaneous comments by inventor regarding internet standards. See also folder for Network Signatures

[Bagley96]
(*) Bagley, Steven C;, Kopec, Gary E. "Editing text in an image", United States Patent 5,548,700, August 20, 1996
- Editing of (static) electronic ink without character recognition, by recognizing bounding boxes of individual characters. Did not cite van Raamsdonk, did cite Facsimile editing by Suenega

[Bagley98]
(*) Bagley, Steven C. "Editing Scanned Document Images using Simple Interpretations", United States Patent 5,734,761, March 31 1998
- Editing of (static) electronic ink without character recognition, by recognizing bounding boxes of individual characters. Refers to editing groups of graphical objects by pretending that they are a set of letters/words, but does not used specific character recognition, merely recognition of text-like elements

[BalakrishnanR99a]

(*) Balakrishnan, Ravin and Hinckley, Ken "The Role of Kinesthetic Reference Frames in Two Handed Input Performance", Proc UIST 99, Asheville, NC, pp. 171-178

Study of asymmetric two-handed / two-pointer user interface using Wacom two-puck digitizing tablet

[Barnett99]
(*) Barnett, Shawn "Jeff Hawkins: The man who almost single-handledly revived the handheld computer industry", Pen Computing Magazine, 1999. Archive at www.pencomputing.com/palm/Pen323/hawkins1.html
- Interview with Jeff Hawkins: GridPad, Handspring, Palm, Zoomer, Newton, Graffiti

[BarrettGL98]
(*) Barrett, Gary L. and Wolfe, Andrew L. "Curvilnear linearization device for touch system", United States Patent 5,736,688, April 7, 1998

[BartlettJF00a]
(*) Bartlett, Joel F. "Rock 'n Scroll is Here to Stay", IEEE CGA, May/une 2000WRL Report 2000/3, Compaq Western Research Laboratory, Palo Alto
- Embodied user interface: Hand-held device with accelerometer in a display: user input is by gestures moving device: pitch, roll, slosh, snapping, tapping, fanning. Device automatically changed from portrait to landscape mode based on how it was held: compare with iPhone accellerometer. Cites to earlier work on accelerometers, graspable user interfaces.

[Baudel97]
(*) Baudel, T., Buxton, Fitzmaurice, G., Harrison, B., Kurtenbach, G. and Owen, R. "Clickaround tool-based graphical interface with two cursors", United States Patent 5,666,499, September 9, 1997
- Two-handed user interface using two input cursors or stylus, one hand positions a menu or tool with various buttons or action elements, the other operates on the tool and the object selected underneath

[BaxterLK96a]
(*) Baxter, Larry K. "Capacitive Sensors: Design and Applications", IEEE Press Series on Electronics Technology, Wiley-IEEE Press, ISBN 978-0-7803-5351-0, September 1996
- Comparison with ultrasonic proximity sensors (6.2.4): variation of speed of sound varies with tempuratur, humidity, frequency (!), little effect from pressure.

[BedersonB96a]
(*) Bederson, Benjamin B.; Hollan, James D., Perlin, Ken; Meyer, Jonathan; Bacon, David; Furnas, George "Pad++: A Zoomable Graphical Sketchpad for Exploring Alternate Interface Physics", Jnl. of Visual Language and Computing, 1996, Vol 7, pp. 3-31
- Zoomable user interface, refers to "user-interface physics" to describe semantic zooming (showing more information) as contrasted to larger image (fatter pixels), see also Data Lens.

[BedersonB98a]
(*) Bederson, Benjamin B. and Meyer, Jon "Implementing a Zooming User Interface: Experience Building Pad++", Software - Practice and Experience, Vol 28 No 10, Aug. 1998, pp. 1101-1135
- Zoomable user interface: spatial vs. temporal indexing, user builts up a model in her or his head about thed relationships of data. For faster response while zooming or roaming, may show a lower-resolution image, and then perform "refinement" to higher resolution. Similarly, show fake "greekified" text at first, during refinement render actual text.

[Beernink97a]
(*) Beernink, Ernest H., Aguste, Donna M. and Meier, John R. "Method and Apparatus for Recognizing Handwriting of Different Users of a Pen-Based Computer System", United States Patent 5,666,438, September 9, 1997, assigned to Apple computer Inc., Cupertino, California
- Improves recognition non-adaptively, by letting user input setting for spacing of words, cursive/mixed/printed, time-out for end of character, and other preference settings.

[BeerninkEH97b]
(*) Beernink, Ernest H.; Foster, Gergg S.; and Capps, Stephen P. "Gesture sensitive buttons for graphical user interfaces", United States Patent 5,612,719, March 18, 1997
- Gesture on a GUI button: examples are tap, check-mark, X.

[BelfioreJD97a]
(*) Belfiore, Josph D. et al "Auto-Scrolling during a Drag and Drop Operation", United States Patent 5,611,060
- Auto-scrolling based on speed of mouse as well as limit of scrollable distance

[BermanAH96]
(*) Berman, Andrea H. and Whitmore, Mihriban "Initial Usability Testing of a Hand-held Electronic Logbook Prototype for the Human Research Facility", NASA Contractor Report NAS9-18800, April 1996, LM31992
- Apple Newton hand-held pen computer very awkward to use in microgravity environment, because it was hard to write and hold either the pen computer and/or the user still at the same time. Handwriting input rated "marginal".

[BermanER98a]
(*) Berman, Eric Robert et al "Methods and apparatus for interacting with data objects using action handles", United States Patent 5,760,773, June 2, 1998
- Context menu for an object by clicking/tapping on a handle on the object. Tap on handle brings up context menu and not press-and-hold.

[BierEA96]
(*) Bier, Eric A. and Buxton, William A. S. "User interface having movable sheet with click-through tools", United States Patent 5,581,670, December 3, 1996
- Simulated keyboard user-interface, other devices, positions on a movable menu of user-interface components (simulated selector, rotator, etc.) on a virtual sheet or grid which can be positioned over the object for the action to be applied to

[BierEA97]
(*) Bier, Eric A.; Buxton, William A. S. and Stone, Maureen C "User interface having click-through tools that can be composed with other tools", United States Patent 5,617,114, April 1, 1997
- See also http://www.billbuxton.com

[BierEA99]
(*) Bier, Eric A. "Customizable User Interfaces for Programmed Computer Systems", United States Patent 5,862,395, January 19, 1999
- Mentions GUIDE hypertext system. says "the actions performed by the buttons can refer to the contents or appearance of the button itself, and hence to any properties that the document editor supports. Thus buttons can be used to modify their own appearance or to transfer their properties to other objects in the same document editor."

[Bigelow98]
(*) Bigelow, Stephone J. ""Understanding Pen Systems and Touchpads"", Chapter 34, in "Troubleshooting, Maintaining, and Repairing PCs -- a Technician's Guide", McGraw-Hill, 1998
- Has listing of Gestures for Pen Windows, and for PenPoint, including pigtail gestures and other gestures not used in later Tablet PC from Microsoft

[BillinghurstM98a]
(*) Billinghurst, Mark "PutThatWhere? Voice and Gesture at the Graphics Interface", Computer Graphics, Nov 1998, pp. 60-63
- Cites to multi-modal voice and hand-gesture input in 1992, multi-model allows user to perform multiple tasks. Title refers to "Put That There" multimodal interface with hand and hand-pointing gestures at M.I.T. Refers to context: microtemporal, macrotemporal, and context.

[BissetSJ96]
(*) Bisset, Stephen; Miller, Robert J.; Allen, Timothy P., and Steinbach, Guenter "Touch Pad Driven Handheld Computing Device", United States Patent 5,543,588, August 6, 1996
- Capacitive touch-screen and display

[BissetSJ98a]
(*) Bisset, Stephen and Kasser, Bernard "Multiple Fingers Contact Sensing Method for Emulating Mouse Buttons and Mouse Operations on a Touch-Sensor Pad", United States Patent 5,825,352, October 20, 1998
- Capacitive touch-screen and display, limited use of multi-touch input for emulating mouse buttons. Could be interpreted as applying to gestures? Mentions human factors problems of emulating mouse clicks with single-touch digitizer without proximity sensing.

[BissetSJ99a]
(*) Bisset, Stephen J.; Kasser, Bernard; Joss, Berni; Tareyev, Aleksey "Touch Sensing Method and Apparatus", United States Patent 5,920,309, July 6, 1999
- Capacitive matrix touch-screen sensor for simultaneous proximity of one or more fingers

[Blickenstorfer00]
(*) Blickenstorfer, Conrad "PenLab: A much faster, extensively reworked pen tablet", Pen computing magazine, June 2000. Available at www.pencomputing.com
- Fujitsu 3400 PenLab portable/docking pen computer, Windows 95 with Microsoft pen extensions. Mentioned design change to avoid rear-mounted electromagnetic digitizer, in favor of front-mounted resistive film digitizer. Optical plate to reduce visual parallax.

[Bloomberg99]
(*) Bloomberg News "Microsoft, others sued over pen patent", CNETNews.com, April 29, 1999
- Mitchell Forcier patent lawsuit against Microsoft, claims that technology missappropriated by Aha! Software and licensed to Microsoft

[BlouinF99a]
(*) Blouin, Francois "Touch Pad Panel with Tactile Feedback", United States Patent 5,977,867, November 2, 1999
- Adding a haptic vibrator for tactile feedback to any kind of touch input: tablet, keypad, keyboard, etc. Tactile feedback is in acoustic range: 100 to 5000 Hz.

[Bohan99]
(*) Boha, Michael; Phipps, Chad A.; Chaparro, Alex; and Halcomb, Charles G. "A Psychophysical Comparison of Two Stylus-Driven Soft Keyboards", Proceedings of Graphics Interface GI'99
- Comparison of QWERTY and "T9" (TegicCommunication) simulated keyboard layouts: QWERTY wins, because users can find the keys more easily. References to papers comparing performance and usability of handwriting recognizers

[Boling98]
(*) Boling, Douglas "Programming Microsoft Windows CE: The definitive guide to programming the Windows CE API", Microsoft Press, 1998
- Windows CE: Describes SIP Supplementary Input Panel for touch/handwritng (?) input: IsSIPInputMethod call

[Boritz98]
(*) Boritz, James "The Effectiveness of Three Dimensional Interaction", Graduate Thesis, University of British Columbia
- Primarily deals with visual feedback, human factors in three-dimensional pointing methods

[Bowyer97]
(*) Bowyer, Kevin "Case Study Resources for an Ethics and Computing Course", 1997 ASEE/IEEE Frontiers in Education Conference
- Otto Berkes, trade-secret ethics example, lawsuit between VMI and Autodesk

[BricklinD96a]
(*) Bricklin, Daniel; Johnson, Eirc E.; Friend, John; Kelley, Winslow B; and Levin, Peter H. "Graphic Indexing System", United States Patent 5,539,427, July 23, 1996
- Slate pen-computing DayTimer-like calendaring and notetaking application: data shown as electronic ink, lasso gesture to select for deferred/delayed recognition for indexing. Electronic ink may be shown in multiple views/pages: Month/Day/Week/other calendar pages.

[BricklinD98a]
(*) Bricklin, Daniel; Lynch, William T; and Friend, John "Method and Apparatus for Entering and Manipulating Spreadsheet Cell Data", United States Patent 5,848,187, December 8, 1998
- Slate @Hand / At-Hand patent, pen-computing spreadsheet product. Targeting of ink to a cell/button that is smaller than the electronic ink gesture. Both electronic ink and recognition result are displayed and can be preserved. Refers to multi-tiered handwriting/gesture recognition.

[BricklinD98b]
(*) Bricklin, Daniel; Lynch, William T; and Friend, John "Method and Apparatus for Entering and Manipulating Spreadsheet Cell Data", United States Patent 5,717,939, February 10, 1998
- Slate @Hand / At-Hand spreadsheet patent. Targeting of ink to a cell/button that is smaller than the electronic ink gesture. Both electronic ink and recognition result are displayed and can be preserved. Refers to multi-tiered handwriting/gesture recognition. Original implementation on GO/PenPoint, ported to Pen Windows.

[BrownA98]
(*) Brown, Andrew R. "Composing by Pen: Exploring the effectiveness of a system for writing music notation on computers via pen input", Unpublished manuscript: available at http://www.academo.qut.edu.au/music/browna/NoteWriter.htm
- unistroke handwriting input for music notation

[BrownCM99a]
(*) Brown, C. Marlin "Human-Computer Interface Design Guidelines", intellect, Exeter England 1999
- Compendium of user-interface guidlines and principles from many reference. Sections 8.4 refers to accidental touch activation with a touchscreen: 1985 reference on switch?

[BrownH98b]
(*) Brown, Heather; Harding, Robert; Lay, Steven; Robinson, Peter; Sheppard, Dan; and Watts, Richard "Active Alice - using real paper to interact with electronic text", Proceedings of 7th Internal Conference on Electronic Paper, Saint Malo, April 1998. Reprint available at www.globis.ethz.ch
- Bibliography of other papers by Robinson on file.

[BrownH99]
(*) Brown, Heather and Robinson, Peter "Integrating Paper and Digital Documents", in section 'Intelligent Paper' of "Electronic Documents, Artistic Imaging, and Digital Typography", Roger D. Hersch, Editor. Available at http://www.cl.cam.ac.uk/~pr/publications/dmf99/dmf99.pdf
- Review of various work on intelligent paper: compare with Anoto (not cited?). Mentions TEI Text Encoding Initiative for encoding data in printed documents, dataglyphs, electronic ink on paper. Xlibris Active Reading Machine and Dynomite appear similar to Slate DayTimer Notebook product of approximately 1992 (not cited?)

[BrowneH00a]
(*) Browne, Hilary; Bederson, Ben; Druin, Allison; Sherman, Lisa; and Westerman, Wayne "Designing a Collaborative Finger Painting Application for Children ", Univ. of Maryland Technical report HCIL-2000-17, CS-TR-4184, UMAICS-TR-2000-66, September 2000
- Multi-touch finger-painting educational prototype using keyboard-sized Multi-Touch Surface (MTS). For children, gestures are too complicated, suggest template of menus / control areas along with drawing: Compare with Doster and Oed?

[Bull00a]
(*) Bull Electronics Angers, France "AIX Command Reference Vol. 6, X to zcat", Bull Electronics Angers, France, Order Reference 86 A2 43JX 02, April 2000
- AIX Windowing system command reference: drag-and-drop, X11 color database for color management in windows.

[Buxton98a]
(*) Buxton, W. and Bier, Eric A. "User interface having simultaneously movable tools and cursor", United States Patent 5,798,752, Aug. 25, 1998
- User interface using a digitizer tablet with a puck, the puck has user input buttons on it (like a traditional digitizer puck), but also reports the rotational orientation of the puck. Puck also contains a trackball.

[Buxton98b]
(*) Buxton, W. and Fitzmaurice, G.W "System for editing time-based temporal digital media including a pointing device toggling between temporal and translation-rotation modes", United States Patent 5,790,769, Aug. 4, 1998
- (Six dimensions) User interface using a digitizer tablet with a puck, the puck has user input buttons on it (like a traditional digitizer puck), but also reports the rotational orientation of the puck. Mentions toggling (via button?) between temporal and positional input modes,

[Buxton99]
(*) Buxton, William "Case Study 1: Touch Tablets; Chapter 5 of "Haptic Input", Draft Document", www.billbuxton.com
- Short overview of touch tablets: refers to "dual pressure" sensing and infrared sensing proximity (but not touch) to simulated proximity sensing. States that touch tablets do not actually send signal that stylus is not pressing on tablet, but instead this must be infered from timing of touch tablet data (tablet stops sending) (Was he sure on this?).

[Buxton00]
(*) Buxton; William A.S.; Harrison; Beverly L., Vicente; Kim J "Graphical user interface with optimal transparency thresholds for maximizing user performance and system efficiency", United States Patent 6,118,427, September 12, 2000
- See also http://www.billbuxton.com

[Buxton00a]
(*) Buxton; William Arthur Stewart, Bell; Jeffrey Allen "System for maintaining orientation of a user interface as a display changes orientation", United States Patent 6,115,025, September 5, 2000
- Keep user interface elements in display at constant orientation for the user, as the display itself is rotated in a multi-user system

[Buxton00b]
(*) Buxton, William A.S. and Kurtenbach, Gordon P. "Graphical keyboard", United States Patent 6,094,197, July 25, 2000
- See also http://www.billbuxton.com

[ByongK97]
(*) Byong, K. Ko and Yang, Hyun S. "Finger mouse and gesture recognition system as a new human computer interface", Science Direct / Elsevier, pp. 551-561, September-October 1997
- Finger-mouse gestures in contrast to Stylus and Mouse gesture input devices. Data capture by video image capture, not by Data Globe etc.

[Camaisa98]
(*) Camaisa, Allan J.; Wadkins, E. Tracy; and Gayda, Karen M. "Interactive Visual Ordering System", United States Patent 5,845,263, December 1, 1998
- Touchscreen sales terminal with menus (as in food) for restaurants

[CappsS96]
(*) Capps, Stephen P. "Method for selecting objects on a computer display", United States Patent 5,523,775, assigned to Apple Computer, Inc., June 4, 1996
- Recognition of a selection gesture over objects on a display: makes use of overlap, displays pen path on display as electronic ink; selection can be shown before the gesture is complete and the pen stylus is lifted. Compare with lasso selection in PenPoint and Buxton?

[CappsSP96b]
(*) Capps, Stephen et al "Method and apparatus for indicating a change in status of an object and its disposition using animation", United States Patent 5,544,295, August 6, 1996
- Animating an icon or other object to show its change in status: e.g. crumping an object to show that is status is now as "deleted"

[CappsSP97a]
(*) Capps, Stephen P. "Method and apparatus for indicating a change in status of an object and its disposition using animation", United States Patent 5,596,694
- Animating an icon or other object to show its change in status: e.g. crumping an object to show that is status is now as "deleted"

[CappsSP97b]
(*) Capps, Stephen P. "Graphical User Interface using Historical Lists with Field Classes", United States Patent 5,666,502
- Tap on field with stylus, get recently-entered history values for that type of field to select from.

[CappsS98]
(*) Capps, Stephen, Beernink, Ernest H., and Temkin, David T. "String inserter for pen-based computer systems and method for providing same", United States Patent 5,778,404, July 7, 1998, assigned to Apple computer Inc., Cupertino, California
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??8]
. Capps, Stephen et al "Interface for a computerized database having card and list views", United States Patent 5,446,882
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??9]
. Capps, Stephen et al "Method and apparatus for manipulating inked objects", United States Patent 5,465,325
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??10]
. Capps, Stephen et al "Method and apparatus for providing computer-implemented assistance", United States Patent 5,477,447
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??12]
. Capps, Stephen et al "Method and apparatus for setting a clock in a computer system", United States Patent 5,487,054
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??13]
. Capps, Stephen et al "Graphic editor user interface for a pointer-based computer system", United States Patent 5,513,309
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??17]
. Capps, Stephen et al "Interface for a computerized database having card and list views", United States Patent 5,544,358
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??18]
. Capps, Stephen et al "Resetting the case of text on a computer display", United States Patent 5,555,363
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??19]
. Capps, Stephen et al "Method and apparatus for formatting a communication", United States Patent 5,579,467
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??20]
. Capps, Stephen et al "Pointing gesture based computer note pad paging and scrolling interface", United States Patent 5,581,681
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??21]
. Capps, Stephen et al "Method for deleting objects on a computer display", United States Patent 5,583,542
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??22]
. Capps, Stephen et al "Method and apparatus for setting a clock in a computer system", United States Patent 5,583,833
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??23]
. Capps, Stephen et al "Status bar for application windows", United States Patent 5,588,105
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??24]
. Capps, Stephen et al "System for executing different functions associated with different contexts corresponding to different screen events based upon information stored in unified data structure", United States Patent 5,588,141
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??25]
. Capps, Stephen et al "Method for manipulating notes on a computer display", United States Patent 5,590,256
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??26]
. Capps, Stephen et al "Method and apparatus for computerized recognition", United States Patent 5,592,566
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??27]
. Capps, Stephen et al "Method and apparatus for correcting words", United States Patent 5,594,640
- Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton. Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??28]
. Capps, Stephen et al "System and method of reflowing ink objects", United States Patent 5,596,350
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??30]
. Capps, Stephen et al "Method for routing items within a computer system", United States Patent 5,596,697
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??31]
. Capps, Stephen et al "Method for deleting objects on a computer display", United States Patent 5,602,570
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??33]
. Capps, Stephen et al "Method and apparatus for deducing user intent and providing computer implemented services", United States Patent 5,621,903
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??34]
. Capps, Stephen et al "System and method for event parameter interdependence and adjustment with pen input", United States Patent 5,634,100
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??35]
. Capps, Stephen et al "Methods and apparatus for a selectable backdrop", United States Patent 5,634,102
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??36]
. Capps, Stephen et al "Method for locating and displaying information in a pointer-based computer system", United States Patent 5,644,657
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??37]
. Capps, Stephen et al "Method and apparatus for providing implicit computer-implemented assistance", United States Patent 5,644,735
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??38]
. Capps, Stephen et al "Graphical user interface using historical lists with field classes", United States Patent 5,666,502
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??39]
. Capps, Stephen et al "Method and apparatus for the manipulation of text on a computer display screen", United States Patent 5,666,552
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??40]
. Capps, Stephen et al "Method and apparatus for formatting paragraphs", United States Patent 5,671,438
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??41]
. Capps, Stephen et al "Boxed input correction system and method for pen based computer systems", United States Patent 5,682,439
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??42]
. Capps, Stephen et al "Method for correcting handwriting on a pen-based computer", United States Patent 5,710,831
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??43]
. Capps, Stephen et al "Method for searching and displaying results in a pen-based computer system", United States Patent 5,710,844
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??44]
. Capps, Stephen et al "Method and apparatus for tab access and tab cycling in a pen-based computer system", United States Patent 5,745,716
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??45]
. Capps, Stephen et al "Method for locating and displaying information in a pointer-based computer system", United States Patent 5,764,818
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??47]
. Capps, Stephen et al "Rotating toy with electronic display", United States Patent 5,791,966
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??48]
. Capps, Stephen et al "System for computer with interface and scripting systems cooperating in interrated fashion by sharing frame objects of common unified data structure stored in object system", United States Patent 5,805,869
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CappsS9??49]
. Capps, Stephen et al "System and method for organizing recognized and unrecognized objects on a computer display", United States Patent 6,021,218
- Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CardS97]
(*) Card, Stuart "Information Visualization and Information Foraging", Cseriac Gateway, Volume VIII No 1, 1997, pp 9..10
- Summary of talk on information visualization by Stuart Card at Xerox PARC: mentions Memex, mostly talks about zooming (including non-graphical) and linking (via Hypertext)

[CardelliL97]
(*) Cardelli, Luca "Everything is an Object", Digital Equipment Corporation Systems Research Center, May 30, 1997
- Presentation on prototype-based languages

[CarrollTouch96a]
(*) Carrol Touch Touch Products "Touch System Programmer's Guide", Carroll Touch, August 1996
- Infrared (optical) touch systems, guided wave (acoustic SAW) touch systems. Refers to "beam averaging" (interpolation?) as distinct from non-contigous (unintended second) touches, and "failed beam" on infrared touch tablet.

[Casio96a]
(*) Casio Inc. "Casio NX-6000 Planeo", Casio Inc.
- Product information on NX-600 touchscreen PDA / digital diary. Includes sketch input.

[Casio98a]
(*) Casio Inc. "Casio PV-200 Pocket Viewer", Casio Inc.
- Product information on PV-200 Pocket Viewer: touchscreen PDA. File contains additional information, including product manuals.

[Casio00a]
(*) Casio Inc. "Mobile Datenerfassung: Hand-PC mit Touch-Panel und Belegdrucker IT-2000", CASIO Computer Deutschland, D-22848 Norderstedt, Germany, Dec 12 2000
- Product information on IT-2000, hand-held touchscreen/pen computer for data collection.

[Casio00b]
(*) Casio Inc. "IT-2000 Data Collector User's Guide, 2000", CASIO Computer Deutschland, D-22848 Norderstedt, Germany, Dec 12 2000
- Product information on IT-2000, hand-held touchscreen/pen computer for data collection. Refers to stroke keys (physical buttons) and touch keys (virtual buttons): virtual buttons can show multiple user-selectable keyboard layouts.

[CERT00]
(*) CERT Cordination Center "Results of the Security In ActiveX Workshop", Security in ActiveX Workshop, Pittsburgh, Pennsylvania USA, August 22-23, 2000. Published at the CERT Coordination Center, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA 15213, December 21, 2000
- Review of ActiveX security problems and measures

[ChanA96a]
(*) Chan, Albert "Hypermenu: Integrating Function Access and Work Object Representation in Graphics Applications", Masters's Thesis, Univ. of Texas School of Engineering Science, 1996
- Show active elements in context (in a document or graphical object) that have a pop-up menu. Has review of upll-down/linear and circular menus.

[ChanCF99a]
(*) Chan, Chow Fong; Maisy, Mun Lan Ng; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Touchpad Pen-Input and Mouse Controller", United States Patent 5,995,084, November 30, 1999
- Tap, drag, tap-and-drag gestures on touchpad digitizer, with check for moving out of working area. Note: press-and-hold: tap-and-drag does *not* have a hold. Switches between pen-input and mouse-input mode. Refers to light pen.

[ChanCF99b]
(*) Chan, Chow Fong; Maisy, Mun Lan Ng; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Touchpad Pen-Input Controller", United States Patent 5,883,622, March 16, 1999
- Force/pressure sensing touchpad digitizer tablet using resistive film: compare with Elographics

[ChanCF99c]
(*) Chan, Chow Fong; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Automatic Cursor Motion Control for a Touchpad Mouse", United States Patent 5,880,717, March 9, 1999
- simulated velocity/momentum when scrolling when object moves outside/into work area boundary: compare with artificial reality project?

[ChanCF00a]
(*) Chan, Chow Fong; Maisy, Mun Lan Ng; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Touchpad Mouse Controller", United States Patent 6,057,830, May 2, 2000
- Tap, drag, tap-and-drag gestures on touchpad digitizer, with check for moving out of working area. Note: press-and-hold: tap-and-drag does *not* have a hold.

[ChanCF00b]
(*) Chan, Chow Fong; Maisy, Mun Lan Ng; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Command Set for Touchpad Pen-Input Mouse", United States Patent 6,061,051, May 9, 2000
- tap/click, move, press and drag gestures on touchpad/touchscreen digitizer.

[ChattyS96]
(*) Chatty, Stephane and Lecoanet, Patrick "Pen computing for air traffic control", Proc. of SIGCHI Conference on Human factors in computing systems, Vancouver 1996, pp. 87-94
- Study of a direct-manipulation input system for air traffic control, versus previous lightpen/keyboard systems. Mentions gesture recognition error rate, suggestion for use of application object context and other factors to improve recognition and input accuracy.

[Chefalas96]
(*) Chefals, Thomas E. and Tappert, Charles C. "Silent training by error correction for on-line handwriting recognition systems", United States Patent 5,544,260, August 6, 1996
- "Silent" training of any trainable handwriting character recognition system by displaying possibilities to user to make corrections to the training set. User writes directly over a character shown on the display.

[ChewCH99a]
(*) Chew, Chee Heng; Konzen, Neil; Guzak, Christopher J.; Laney, Stuart T.; Pitt, George H. III; Ellison-Taylor, Ian M. and Gery, Ron O. "System Provided Child Window Controls", United States Patent 5,889,522, March 30, 1999
- UI Window controls: image lists, hot keys, hot key configuration. Specification includes verbatim excerpts from Microsoft documentation for Header Controls

[CHI00a]
(*) CHI 2000 "Touchscreen Toggle Design - Slider", CHI posting, dated 2000/2001
- Digitization of 1992 CHI demonstration Video of "Touchscreen Toggle Design"?

[ChiuP98a]
(*) Chiu, Patrick and Wilcox, Lynn "A Dynamic Grouping Technique for Ink and Audio Notes", Proc. UIST '98, 8/6/98
- Dynomite prototype system: Modeless note-taking interaction for electronic ink and audio notes: mentions Apple Newton, Aha! InkWriter (Pen Windows) etc. but not Wang Freestyle. Audio delimited by periods of silence (200 msecs), electronic ink by minimum distance between strokes. Refers to whitebard and sketching systems as related topics.

[ChokSS98a]
(*) Chok, Sitt Sen and Marriot, Kim "Automatic Construction of Intelligent Diagram Editor", Proc. UIST '98, San Francisco CA pp. 185-194
- Sketch recognition / sketch editor /Diagram Editor: context sensitivity / syntax in graph-based visual language (mathematical notation)

[Citrin96]
(*) Citrin, Wayne and Gross, Mark D. "Distributed Architecture for Pen-Based Input and Diagram Recognition", Research Report, Dept. Of Electrical and Computer Engineering, Univ. of Colorado, Boulder CO USA, http://wallstreet.colorado.edu/projects/dds/Papers/AVI96.html
- Co-operative drawing surface (whiteboard system using Apple Newtons). Part of SmartPad project: Electronic Cocktail Napkin

[ClarkeJ97]
(*) Clarke, J. "Shorthand for the Palmpilot?", posting to newsgroup alt.comp.sys.palmtops.pilot, 09/13/1997, available at www.dejanews.com
- Mentions commercial companies by name

[CloughWA97]
(*) Clough, William A.; Ouelette, Daneil; De La Sablonniere, Serge "Portable Computer with Touch Screen and Computer System Employing Same", United States Patent 5,675,362, October 7, 1997
- Portable slate pen-computer using touch screen (not proximity digitizer): Microslate, Inc. of Canada. Generic claim appears to be having an automatic application generator. Refers to drop-down pick list as a "library" of answers for touch-screen selection.

[CohenPR97a]
(*) Cohen, Philp R, et al "QuickSet: Multimodal Interaction for Distributed Applications", Proc. Fifth Int'l Multimedia Conference (Multimedia '97), Seattle, WA, November 1997, pp. 31-40
- Multimodal simulation of combat environment: mentions use of pen-gestures, marking for military map symbols: e.g. Routes, areas, mortars, tank platoon. alpha/pigtail delete gesture. Pointing hand-gestures triggered by voice recognition of diectic noun phrases (e.g. "this one").

[Constanble97]
(*) Constanble, Frederick "Xerox sues USR over patents", posting to newsgroup alt.comp.sys.palmtops.pilot, 04/30/1997, available at www.dejanews.com
- Xerox sues US Robotics / Palm / Graffiti over unistroke character recognition, Goldberg patent

[Crosspad97a] (*) A.T. Cross Pen Company "Crosspad", A.T. Cross Pen Company, www.cross.com (fetched 2011)
File with product information on Crosspad, stand-alone digitizer clipboard with electronic recording of notes/ note-taking in electronic ink. Appears to be addressing similar applications to Anoto LiveScribe pen. Product introduced 1997, discontinued 2001. Off-line dynamic handwriting recognition applications provided by IBM. Could be used a mouse/digitizer with additional connection to PC.

[CullenJF98] (*) Cullen, J. F.; Penirs, Mark; and Hart, Peter E. "Computer User Interface for Manipulating Image Fragments, Using Drag, Drop and Merge Operations", United States Patent 5,732,230, March 24, 1998

User interface for editing image sections on a copier UI, using a touchscreen: user touches and drags, rotates.

[DAmicoVE99a] (*) D'Amico, Vincent E.; Gehrig, Jay J.; Surprenant, Joseph E.; and Robsky, Steven R. "Touchscreen Controller with Pen and/or Finger Inputs", United States Patent 5,956,020, September 21, 1999

Dual mode digitizer for finger input or stylus/pen input. Says "finger and pen", but only reports one, with pen/stylue getting priority. Includes built-in calibration for active area by touching two corner locations via controller commands. Capacitive film digitizer technology (refers to 4,198,539 for sensor details)

[DammCH00a] (*) Damm, Christan Heide; Hansen, Klaus Marius; and Thomsen, Michael "Tool Support for Cooperative Object-Oriented Design: Gesture Based Modeling on an Electronic Whiteboard", Proc. CHI 2000, April 2000, pp. 518-525

Knight tool: Gesture-based multi-user whiteboard user interface. Says unfortunately no multi-touch (single users must take turns) on prototype hardware (Smart Board), unlike Xerox Liveboard (Tivoli). Gestures include sketch recognition, e.g. UML rectangle objects. Context-dependent pie menus (marking menus) for large surface. "Radar window" shows small image of entire workspace drawing. Notes that Xerox Liveboard could accept multiple pen touches at the same time.

[DanielsPT96] (*) Daniels, Peter T. and Bright, William "Shorthand", "The World's Writing Systems", pp 807-ff, Oxford University Press, 1996

Examples of many short-hand handwriting systems, including Greek (1934), Tironian (1934), Bright's. Shows Medieval short-hand systems, including single-stroke / Unistroke systems.

Willis' Stenography, Unistroke characters except for one "plus"-like two stroke from for "H", 1934.

Early terminology for short-hand writing included symbolicals, arbitraries, wordsigns, tachyogrphy, logographic, phonotypy

[DavisTR99] (*) Davis, Tom R. "Bibliography on Handwriting, natural, taught styles, copy-books", University of Birmingham, U.K.

Shorthand, taught handwriting styles by education, single-stroke writing, Pittman

[deIpina00] (*) de Ipina, Diego Lopez "Building Components for a Distributed Sentient Framework with Python and CORBA", Unknown conference proceedings, date approximate

The title is odd, but the paper makes substantial references to 2D circular barcode (ringcode) tags, and inferring the approximate location, orientation, and identifier of the tags using optical scanning / visual processing. Compare with Sekendur.

[DelBimbo97] . Del Bimbo, Alberto and Pala, Pietro "Visual image retrieval by elastic matching of user sketches", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol 19 No 2, pp 121-132, February 1997

Cited in Arvo00

[DellaBonaMA98a] (*) Della Bona, Mark A.; Dorfman, Jonathan; and Hamlin, Jay F. "Method and Apparatus for Contacting a Touch-Sensitive Cursor-Controlling Input Device to Generate Button Values", United States Patent 5,764,218, June 9, 1998

Activating UI buttons from a touchscreen digitizer based on gap intervals: how long the stylus/finger is pressed, and how log it is lifted. Compare with Kaplow and with Microtouch?

[Dingledein98] (*) Dingledein, Dennis "Computer Graphics and Graphical User Interfaces", Available at http://www.zgdv.de/www.zgdv-uig/papers/gui/contents.html

Informal research group on user-interface design: mentions work on single-stroke/unistroke gesture recognition by Rubine, others

[Ditzik97] (*) Ditzik, Richard J. "Desktop Computer with Adjustable Flat Panel Screen", United States Patent 5,668,570, September 16, 1997

Portable computer (laptop) with fold-out screen, as contrasted to clamshell design. Mentions touchscreen input.

[DitzikRJ99a] (*) Ditzik, Richard J. "Modular notebook and PDA computer systems for personal computing and wireless communications", United States Patent 5,983,073, November 9, 1999

Electronic notebook/PDA/smartphone, stylus/touchscreen, clamshell/convertible/detachable display, wireless networking

[DouglasSA97a] (*) Douglas, Sarah A. and Mithal, Anant Kartik "The Erognomics of Computer Pointing Devices", Springer Verlag, 1997, ISBM 3-540-19986-1

(partial copy) Joystick, including velocity joystick, slower and less usable than a mouse for pointint

[DrobneS99] (*) Drobne, Samo "Prenosno in Terenski Racunalnistvo", Master's Thesis in spatial planning, University of Ljubljana, Faculty of Civil and Geodetic Engineering, 1999

Contains examples of gestures: spiral, dash/flick, square. Example of circle/lasso gestures from Handwriter for Windows by CIC Communication Intelligence Corporation, Pen Windows / Pen Extensions, Windows CE, Fujitsu 2300 pen computer

[DulbergM98] (*) Dulberg, Martin S. and St. Amant, Robert "A Flying Click Gesture for Unary Selection and Activation", Technical Report TR-98-05, Department of Computer Science, North Carolina State University

Flick / Flying Click mouse gesture faster than mouse click on a button

[DulbergM99a] (*) Dulberg, Martin S.; St. Amant, Robert; and Zettlemoyer, Luke S. "An Imprecise Mouse Gesture for the Fast Activation of Controls", Proc. INTERACT '99, eight pages

Mouse click and drag-and-drop gestures with mouse flick gestures: minimum number of pixels movement to distinguish mouse clicks from flicks, velocity threshold for flick and drag: mentions that with stylus selection should be on touch-down, contrasted to mouse on mouse-up event.

[Dymetman98] . Dymetman, M. and Copperman, M. "Intelligent Paper", Proceedings of EP '98, March/April 1998. Available in "Electronic Publishing, Artistic Imaging, and Digital Typography", Springer Verlag LNCS 1375, pp. 392..406

Cited along with Sekendur, Bennett, and Anoto in some bibliographies

[Dynapro97a] (*) Dynapro Systems Inc. "Dynapro Ergotouch Computer Model 3010 With Near Field Imaging Touch Screen User's Reference", Dynapro Systems Inc, Copyright 1997. www.dynapro.com

Electrostatic/capacitive touchscreen digitizer, controller supports multiple simultaneous touches for safe operation (e.g. two simultaneous touches required to start a motor) or for mouse emulation (second touch to simulat mouse right-button activation for Windows context menus).

[Dynapro99a] (*) Dynapro Systems Inc. "Dynapro SC4 Touch Screen Controller User's Guide", Dynapro Systems Inc, Copyright 199. www.dynapro.com

Electrostatic/capacitive touchscreen digitizer with eigh-wire resistive touch screen, silver ink as conductor at sides, to overcome resistance changes and drift due to aging and wear, ratio-metric conversion ofr A/D converter output.

[Dynapro00a] (*) Dynapro Systems Inc. "Dynapro NFI Near Field Imaging Touch Screen System", Dynapro Systems Inc, Copyright 2000. www.dynapro.com

Electrostatic/capacitive touchscreen digitizer with patterned conductive sensor (grid matrix?)

[Elbaum99] (*) Elbaum, Sebasian and Munson, John C. "Intrusion Detection through Dynamic Software Measurement", USENIX Workshop on Intrusion Detection and Network Monitoring, April 1999, pp 41-50

Disallowed Operational Anomaly system: dynamic modeling of program behavior using execution path patterns, deny operation when program behavior diverges from learned patterns.

Technical reference for Cylant.com, intrusion detection contrasted to signatures for files or SNORT network patterns

[EllerM98] (*) Eller, Marlin and Edstrom, Jennifer "Barbarians Led by Bill Gates: Microsoft from the Inside", Owl Books, 1998

Marlin Eller's history of Microsoft tactics with GO Corporation, Pen/Windows, etc.: Contrast with "Startup" by Jerry Kaplan (of GO Corporation). Chapter "Pen Ultimate Warfare": quote describing Microsoft OS/APIs as a tax on a large market. Mentions initial contacts between GO Corporation and Microsoft prior to Pen Windows / Windows for Pen Computing.

[Em00a] (*) Em, Davic "Fujitsu Stylistic 3400", byte.com, August 18, 2000

Pen tablet computer: not Tablet PC, uses CIC PenX handwriting-recognition software (trainable), with on-screen soft keyboard. Runs modified Windows 9X / Windows98 OS

[Em00b] (*) Em, Davic "Invasions of the Pen Computers, Part I", byte.com, August 18, 2000

Pen tablet computers: not Tablet PC, mostly Windows 95 / Windows98. Aqcess Technologies QBE tablet computer.

[FingerWorks00a] (*) Fingerworks Inc. "FingerWorks - Inventor and Developer of MultiTouch Technology", Fingerworks.com, fetched Aug 17, 2000

Image of multitouch input of hand from FingerWorks input tablet

Additional information in paper file

[Fishkin00] (*) Fishkin, Kenneth P.; Goldberg, David; Gujar, Anuj Uday; Harrison, Beverly L.; Mynatt, Elizabeth D; Stone, Maureen C; and Want, Roy "Zoomorphic Computer User Interface", United States Patent 6,160,540, December 12, 2000

Electronic teddy bear with various computer interactive technologies: specifically mentions tablet computer and gestures (e.g. shake)

European patent also on file: same Goldberg of Unistroke

[FitzmauriceG97a] (*) Fitzmaurice, George; Baudel, Thomas; Kurtenbach, Gordon; and Buxton, Bill "A GUI Paradigm Using Tablets, Two-hands and Transparency", Proc. CHI '97, 22-27 March, 1997, Videos, pp 212-213

Puck, pen, and flipbrick on same multi-touch tablet (Wacom). Non-dominant (e.g. left) hand controls palette/tools such as rulers and french curves, dominant (e.g. right) hand holds stylus to draw.

[FitzmauriceG99] (*) Fitzmaurice, G. and Buxton, W. "Temporal data control system", United States Patent 5,973,669, Oct. 26, 1999

"Scrubwheel": mouse with a rotational control, so that it can both be positioned (to select something, such as which video clip) and rotated (as a knob to control speed of rendering)

See also http://www.billbuxton.com

[FitzpatrickGP96a] (*) Fitzpatrick, Greg P. and Haynes, Thom R. "Overriding Action Defaults in Direct Manipulation of Objets on a User Interface by Hovering a Source Object", United States Patent 5,546,527, August 13, 1996

Similar to hold/dwell gesture with stylus, only user hovers (while dwelling) over object in proximity sensing of digitizer: dwell indicates different operations from the default operations.

[FleckDC96a] (*) Fleck, David C. and Tsuchida, Yoichi "Control method of a plurality of Locators and Control Device of Same", United States Patent 5,587,559, December 24, 1996

Electromagnetic or other grid tablet modified to work with more than one stylus or puck

[FleckDC98a] (*) Fleck, David C.; Stumpf, Richard M.; and Picard, Tom "Digitizer Eraser System and Method", United States Patent 5,793,360, August 11, 1998

touchscreen stylus has an eraser input on the back end. To erase, must first have selected text, then used eraser (with approximate gesture): then the actual "erase" operation generated (simulated keystroke input) depends on what kind of window you are on. Compare to recognition macros on Pencept.

[FleckDC00a] (*) Fleck, David C. "Digitizer system with cursor shape changing as a function of pointer", United States Patent 6,160,539, December 12, 2000

Change cursor on display depending on which area of a menu strip on separate tablet a stylus is hovering over in proximity.

[FlorenceJ96a] (*) Florence, John; Hornsby, Kathleen; Egenhofer, Max "The GIS WallBoard: Interactiosn with Spatial Information on Large-Scale Displays", 7th Inter. Symposium on Spacial Data Handling (SDH '96), Delft, Netherlans, pp. 8A.1-15, August 1966

User interface for large white-board display using pop-up pie menus, data lenses. UI operations vary on user distance from wall display: arm's length (physical contact), spitting distance (gestures), within sight (external pointers and devices.) Prototype hardware is LiveBoard from Xerox

[Fonix99] (*) Fonix Corporation "Fonix and Lucent Technologies Inferno Software Solutions To Offer Fonix Handwriting Recongition Software to Information Appliance Market", Lucent Technologies

Shows graffitt-like unistroke character recognition, including unistroke "X" and German "Sharp-S". Mentions Inferno Operatin System

[Forcier96] (*) Forcier, Mitchell D. "Script Character Processing Method and System with Bit-Mapped Document Editing", United States Patent 5,590,257, December 31, 1996

Editing of handwriting/electronic ink without recognition of characters

Editing of electronic ink: word-wrap, inserting spaces, editing of handwritten lines of text

van Raamsdonk possible related art? ... not cited.

Press reports from 1999 of Forcier accusing Microsoft of infringement

[Forcier99] (*) Forcier, Mitchell D. "Script Character Processing Method and System with Bit-Mapped Document Editing", United States Patent 5,953,735, September 14, 1999

Editing of handwriting/electronic ink without recognition of characters

Editing of electronic ink: word-wrap, inserting spaces, editing of handwritten lines of text

van Raamsdonk possible related art? ... not cited.

Press reports from 1999 of Forcier accusing Microsoft of infringement

[ForresterJE00a] (*) Forrester, Justin E. and Miller, Barton P. "An Empirical Study of the Robustness of Windows NT Applications Using Random Testing", Proc. 4th USENIX Windows System Symposium, August 2000, Seattle Washington

Fuzz-testing (random keyboard and mouse inputs) crashes or causes to fail most Windows NT application. Continuation of similar work done on Unix in the 1990s, that few programmers write software that check input for plausibility, so unanticipated inputs cause failure.

[ForsbergA98a] (*) Forsberg, Andrew; Dieterich, Mark; and Zeleznik, Robert "The Music Notepad", Proc UIST 98, San Franciso, CA; pp. 203-210

handwriting recognition editor for musical notation. Uses stylus with two additional barrel buttons to select modes -- uses eraser end button of stylus for playback. Gestures similar to those of Buxton for music. Uses lasso and pigtail gestures for editing. Later ported to Microsoft Tablet PC for Microsoft. Uses length of time (press-and-hold) for shorter and longer periods to change duration of a note or to bring up editing menu.

On-line videos, also for Lineogrammer (Lineogrammar?) project

[FreemanW97] (*) Freeman, William T. and Weissman, Craig D. "Hand Gesture Machine Control System", United States Patent 5,594,469, January 14, 1997

Camera facing out from large display recognizes hand gestures. Appears similar to "Put-That-There" prototype at M.I.T. Compare with iPoint device from Fraunhofer Institut.

[FreeSoftwareFoundation97a] (*) Free Software Founcation "Drag Start Distance", www.davidpilling.info/cd/DavidPilling/Maillist/1997_11.txt

Technical support discussion on Drag Start Distance in open-source software. press-and-hold-and-drag distance.

File contains additional discussion references to Drag Start Distance in KDE and other open-source software related to Linux O.S.

[FreeSoftwareFoundation98a] (*) Free Software Founcation "Drag Start Distance", http://140.116.2.3/Linux/CLE/CLE/devel/andrew/redhat/BUILD/kde-i18n/eo/messages/kdebase/kcminput.po

Documentation of Drag Start Distance in open-source software. press-and-hold-and-drag distance.

File contains additional discussion references to Drag Start Distance in KDE and other open-source software related to Linux O.S.

[FreeSoftwareFoundation00a] (*) Free Software Founcation "Drag Start Distance", http://140.116.2.3/Linux/CLE/CLE/devel/andrew/redhat/BUILD/kde-i18n/eo/messages/kdebase/kcminput.po

Documentation of Drag Start Distance in open-source software. press-and-hold-and-drag distance.

File contains additional discussion references to Drag Start Distance in KDE and other open-source software related to Linux O.S.

[Freund99] (*) Freund, Gregor "System and Methodology for Managing Internet Access on a Per Application Basis for Client Computers Connected to the Internet", United States Patent 5,987,611, November 16 1999

Zone Labs: per-application firewall. Mentions intercepting process loading (via kernel hooks?) and checking application details, such as components, version, checksum. Not adaptvie, rule-based.

[FukudaR98a] (*) Fukuda, Ryoji and Harada, Takashi "Data Processing Method and Apparatus", United States Patent 5,748,926, May 5, 1998

Recognize gestures in a handwriting recognition area on a tablet/touchscreen over an LCD display: compare with PenWindows? Gestures are mostly combinations of tap/press/drag.

[FukuzakiY97a] (*) Fukuzaki, Yauhiro "Computer Sytem having Multi-Device Input System", United States Patent 5,691,748, November 25, 1997

two digitizers (position pointing devices) on same tablet: mostly about user interface methods in a CAD system. (Wacom digitizer with two styli). Input device may be made integral / integrated with a flat display.

[FuruhataT99a] (*) Furuhata, Tomotake; Hirano, Toshiki; and Sawada, Chihiro "Touch panel double-touch input method and detection apparatus", United States Patent 5,943,043, August 24, 1999

Detect multi-touch (double-touch gesture by two fingers) on resistive or other digitizer by noting shift in position from tap by second finger, then position of first finger returning after 2nd finger's tap.

[Gasch96] (*) Gasch, Scott "Alan Kay (biographical sketch)", http://ei.s.vt.edu/~history/GASCH.KAY.HTML

Biographical sketch on Alan Kay: mentions Byte 91 article, Kay had seen handwriting recognition system at RAND in 1968

[GastonKR99a] (*) Gaston, Kerry R. "Electronic Book System", United States patent 6,956,048, September 21, 1999

Electronic book, with docking/charging station for downloading books. Touch input screen for making notes on displayed text or in margin, copy/digital-rights-management protection.

[GeigerFJ00a] (*) Geiger, Fred J.; Wood, William K.; and Tandon, Sonjaya T. "Automated Post Office Based Rule Analysis of E-Mail Messages and Other Data Objects for Controlled Distribution in Network Environments", United States patent 6,073,142, June 6, 2000

Spam filtering using distributed post offices / mail servers/gateways, which may apply different business/filtering rules.

[GeisslerJ98a] (*) Geissler, Joerg "Shuffle, throw or take it! Working Efficiently with an Interactive Wall", Proc. CHI '98, pp. 265-266

"Throw" object on a large whiteboard using pick-and-throw or pick-and-drop: dwell/press-and-hold gesture to pick up an object, then short connected stroke away from target, then rapid flick stroke in direction of target: object is thrown distance corresponding to velocity of throw stroke

[GeneralMagic97a] (*) General Magic "DataRover 840 Getting Started Guide", General Magic, 1997

Basic user guide for DataRover 840 stylus-input PDA, using resistive touchscreen and stylus.

[GeneralMagic00a] (*) Icras, Inc. "Using Magic Cap: Magic Cap 3.1. The User's Guide for the DataRover 840", General Magic, 2000

Full user guide for DataRover 840 stylus-input PDA, using resistive touchscreen digitizer and stylus. Pop-up virtual keyboard. Electronic ink data annotations and drawing, no handwriting recognition. Numerous screen shots of user interface shows simulated office rooms and objects: compare with Windows "Bob"?

[GerpheideGE97a] (*) Gerpheide, George E. "Apparatus and Method for Tactile Feedback from Input Devices", PCT Patent Application WO9718546, May 22, 1997

Touch tablet with texture feedback via haptic transducer. Regions may also be hard-labeled (indicia) on tablet surface.

[Gladstone99] (*) Gladstone, Kat, and Haber, Andrew S. "Licensing opportunity for technology which may be of interest", SCRIB-L@NIC.SURFNET.IL Discussion List, Sep 29, 1999

posting of information on US Patent 5,018,208, "Input Device for Dynamic Signature Verification". Mentions use as a biometric automobile lock, with the benefit that neuromotor effects on handwriting variability would prevent drunk drivers from using their car. Contact information is Kate Gladstone - Handwriting Repair, Albany, NY

[GloorPA96] (*) Gloor, P.A. "Elements of Hpermedia Design: Techniques for Navigation and Visualization in Cyberspace", Coopers and Lybrand, Switzerland, 1996

Partial copy

[Giangrasso96] (*) Giangrasso, Dominic "Casio Planeo", Pen Computing Magagzine, # 10 1 May/June 1996, www.pencomputing.com

Review of Casio Planeo color PDA: pen taps on small displayed keyboard on touchscreen, sketch function for freeform electronic ink: no reference to character recognition?

[Gillespie96] (*) Gillespie, David; Allen, Timothy P.; and Wolf, Ralph "Object Position Detector with Edge Motion Feature and Gesture Recognition", United States Patent 5,543,591, August 6, 1996. Assigned to Synaptics Incorporated

Conductive digitizer responds to finger touch, plus recognition of tap, hop, zig-zag, push and dragging gestures (Unistroke?). Refers to compensating for unintended motion during gestures. Mentions multiple-finger gestures, such as tap+drag (two strokes), uses in-proximity timing, hop gesture: double-tap with distance between the two taps.

Cites surface-acoustic-wave SAW digitizers as related art to conductive digitizer.

Cites Alps/Cirque GlidePoint with gesture recognition

[GillespieD99a] (*) Gillespie, David; Allen, Timothy P.; and Ferrucci, Aaron T. "Pressure Sensitive Scrollbar Feature", United States Patent 5,889,236, March 30, 1999

Capacitive touchscreen using X/Y grid, compute centroid (interpolation) of object in proximity or touching the touchscreen. Has particular algorithm for detecting tap and drag gestures. Refers briefly to multi-finger gestures because entire grid is measured, (and multiple centroids could be detected?) Scrolling speed faster if more pressure (force).

[GillickWG96a] (*) Gillick, William G and Lam, Clement C. "Roller Mouse for Implementing Scrolling in Windows Applications", United States Patent 5,530,455, June 25, 1996

Hardware user interface, roller mouse with scroll wheel, in which scrolling continues dynamically after motion has stopped. Refers to dynamic scrolling, momentum scrolling, additional scrolling input changes momemtum or speed (decrease or increase)

[Goff99] (*) Goff, Leslie "The S/360 Learning Process", ComputerWorld, Lineline News, 4/19/99, http://careers.computerworld.com/home/news.nsf/all/9904191964

Lists members of the GRAIL project at the RAND Corporation: Bill Sibley, Tom Ellis, Gabe Groner (Groener?), Mal Davis

Describes deficiencies of IBM S/360 interrupt processing, and TCBs / Task Control Blocks, to capture electronic ink in real time

[GonzalesGR98a] (*) Gonzales, Gilbert Rene "Tactile communication device and method", United States Patent 5,719,561, February 17, 1998

6x4 array of tactile dots as tactile output device: compare with optacon for the blind. Doets are actuated in sequens to trace out shape of letters and numbers. Single character, example is wrist mounted.

[Goldberg97] (*) Goldberg, David "Unistrokes for Computerized Interpretation of Handwriting", United States Patent 5,596,656 assigned to Xerox Corporation, Stamford, Connecticut, January 21, 1997

Patent on "eyes-free" writing by contraining every character to a single stroke: many characters have no similarity to the customary handwriting style

Subject of a patent dispute between Xerox and U.S. Robotics over the Palm Pilot character recognition "Graffiti", which used mostly single strokes

Unistroke patent by Goldberg was re-examined: see file notes, numerous references to shorthand and other writing stylues for unistroke characters

[Griepentrog96a] (*) Griepentrog, Scott "Pen Services 2.0 - What is Microsoft doing?", Wiki posting at: twiki.stg.net

Technical note on change in gesture and handwriting interface between Windows for Pen Computing Pen Services 1.0 (for windows 3.11) and 2.0 (for Windows95)

Lists gestures under Windows 3.x: directional tab for space, newline, cirlicue for cut and undo, sidewas cirlycue for copy, chevron for paste, diagonal up-down for delete and backspace, checkmark for edit text, etc. Replaced in Windows 95 Pen Windows with edit box and incomplete pop-up keyboard without arrow keys, others: some character recognition errors thus cannot be corrected.

[Griepentrog96b] (*) Griepentrog, Scott "Pen Windows Machine support page", Wiki posting at: twiki.stg.net

Downloads for Windows for Pen Computing, Pen Services 1.0 drivers, also for Pen Services 2.0, WINTAB driver for NT/95, PEN DOS drivers.

[Griepentrog96c] (*) Griepentrog, Scott "We have a friend in Bill ...", Wiki posting at: twiki.stg.net

1993(?) Interview with Bill Gates of Microsoft, he mentions using (or not using) handwriting recognition on his laptop -- mentions that it (Pen Windows) does not work very well

[Griepentrog96d] (*) Griepentrog, Scott "Word for Windows 95 Pen Support", Wiki posting at: twiki.stg.net

Pen Annotation feature of Word 6.0 for Pen Windows not functional in Word 7.0 for Windows 95

[Griepentrog96e] (*) Griepentrog, Scott "Pen Services for Windows 95", www.pencomputing.com

Describes changes from Pen Services 1.0 to Pen Services 2.0 for Windows for Pen Computing: squiggle gestures of 1.0 replaced by under-arrow gesture, with circle around a letter, e.g. circle-S for insert a space. Macro definition of keysequence to circle-letter gesture dropped from 1.0. Alternative recognition: clicking on letter brings up display of alternative recognition results. (Note: check patent files). GRECO and MARS handwriting recognizers

[GrossM96] (*) Gross, Mark D. and Do, Ellen Yi-Luen "Ambiguous intentions: A paper-like interface for creative design", Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, page 183-192, Seattle, Washington, 1996

Sketch/diagram recognition and editing: refers to "intelligent paper". Gesture recognition of glyphs by a positional chain code / zone recognizer algorithm using 3x3 path grids, plus detection of sharp corners. Straight lines and dots (anything small) by special-case algorithm.

[GrossM96a] (*) Gross, Mark D. and Do, Ellen Yi-Luen "Demonstrating the Electronic Cocktail Napkin: a paper-like interface for early design", Proceedings of CHI 96, available at http://depts.washington.edu/dmachine/PAPER/CHI96/demo.html

Trainable gesture recognition of multi-stroke glyphs, use of graphical context, collaborative drawing

Cites earlier work on gestures and sketch recognition back to 1991: Rubine gesture recognizer

Calligraphic drawing

http://wallstreet.colorado.edu/Napkin

[GrossR97] (*) Gross, Ralph "Run-On Recognition in an On-line Handwriting Recognition System", Technical Report, June 1997, Carnegie-Mellon University and University of Karlsruhe

NPen++ neural net character recognizer, use of heirarchical word dictionary for HMM word matching

[HannRL97] (*) Hann, R.L. "A Conversation with Stuart Card", Cseriac Gateway, Volume VIII No 1, 1997, pp 11..12

Invention of the mouse, and introduction circa 1983: long-lived and successful, because the limitations were in eye-hand coordination, not in the mouse hardware or electronics. Compare with performance characteristics of digitizer tablets.

[HarrisonBL98a] (*) Harrison, Beverly L.; Fishkin, Kenneth P.; Gujar, Anuj; Mocon, Carlos; Want, Roy "Squeeze Me, Hold Me, Tilt Me! An Exploration of Manipulative User Interfaces", Proc. CHI 98, April 13-23, 1998, pp. 17-24

Direct manipulation interface / tactile/haptic user interface: used Casio Cassiopeia hand-held computer and Palm Pilot PDA. Page-turning gesture, grasp/squeezing gesture, compare with flick gesture.

[HendersonA97a] (*) Henderson, Austin "Tailoring Mechanisms in Three Research Technologies", Proc. of Group '97, 1997

Trillium user interface for copier interfaces (1983), Buttons as first class objects 1991, User-tailorable/definable buttons 1991.

[HertzfeldAJ97] (*) Hertzfeld, Andrew J.; Atkinson, William D.; and Kare, Susan D. "Graphic User interface for Modifying Object Characteristics using Coupon Objects", United States Patent 5,611,031, March 11, 1997

Drag and Drop of attributes (tags) from one object to another object

[Hertzmann98] (*) Hertzmann, Aaron "Painterly Rendering with Curved Brush Strokes of Multiple Sizes", Proceedings of SIGGRAPH 98

Student of Perlin: simulation (no actual stylus input) of stroke direction to simulate oil paintings

[HightowerRR98a] (*) Hightower, Ron R; Ring, Laura T.; Helfman, Jonathan I.; Bederson, Benjamin B; and Holland, James D. "Graphical Multiscale Web Histories: A Study of PadPrints", Proc. HyperText 98, Pittsburgh PA, pp. 58-65

Pad++: zoomable/zooming graphical U/I for web browser to show small tree view hierarchy of browsing history. Different sizes of thumbnails depending on depth in tree.

[HinckleyK97a] (*) Hinckley, Ken; Pausch, Randy; and Proffitt, Dennis "Attention and Visual Feedback: The Bimanual Frame of Reference", Proc. 1997 ACM ymposium on Interactive 3D Graphics, Providence, RI

Experiment to show that Two-handed/bimanual input not just natural, but more productive, in part because depends less on visual feedback (prioreceptive sense?)

[HinckleyK98a] (*) Hinckley, Ken; Czerwinski, Mary; and Sinclair, Mike "Interaction and Modeling Techniques for Desktop Two-handed Input", Proc. UIST'98, pp. 45-ff.

Two-handed (puck + stylus) multi-touch streatch (pinch) gesture

[HinckleyK98b] (*) Hinckley, Ken; Pausch, Randy; Proffitt, Dennis; and Kassell, Neal F. "Two-handed Virtual Manipulation", ACM Trans. on Computer-Human Interaction, Vol 5 No 3, September, 1998, pp. 260-302

Two-handed user interface for neurosurgeons. User interface uses virtual user interface props, e.g. an instrumented dolls head in one hand to maninuplate a 3-D image of a brain, and a pointing/slicing pointer in other hand to maniuplate virtual slices, plus a touch screen for command and other interactions. References to two-handed input and direct manipulation.

[HinckleyK99a] (*) Hinckley, Ken and Sinclair, Mike "Touch-Sensing Input Devices", Proc. CHI '99

Touch Trackball, Scrolling Touchmouse: used to change UI depending on what user is doing with devices

[HinckleyK00a] (*) Hinckley, Ken; Pierce, Jeff; Sinclair, Mike, and Horvitz, Eric "Sensing Techniques for Mobile Interaction", Proc. UIST '00, San Diego, CA, pp. 91-100

Add capacitive touchscreen sensor to Cassiopeia E105 Palm-sized PC, and second touch sensor for bezel. User can touch bezel for full-screen display.

[Hong00] (*) Hong, Jason I. and Landay, James A. "SATIN: A Toolkit for Informal Ink-based Applications", Proc. ACM UIST 2000, San Diego California

Also mentions DENIM, sketch-based web site design tool using pen input. Makes comparisons with NewtonOS, Windows for Pen Computing, PenPoint. Describes sketch editing, and stroke simplification, examples are all the straightening of free-hand line segments in sketches and in characters

[Hu97] (*) Hu, Jianying, Rosenthal, Amy S., and Brown, Michael K. "Combining High-Level Features with Sequential Local Features for On-Line Handwriting Recognition", ICIAP (2) 1997: 647-654

[Hu98] (*) Hu, Jianying, Lim, Sok Gek, and Brown, Michael K. "HMM Based Writer Independent On-line Handwritten Character and Word Recognition", Proceeding of 6th International Workshop For Handwriting Recognition, Taejon City, Korea, August 1998

[Hu00??] (*) Hu, Jianying, Brown, Michael K., and Turin, William "Use of Segmental Features in HMM Based Handwriting Recognition", (reference not known: conference proceedings?)

Stochastic patten recognizer, Hidden Markov Model (HMM)

URL as of 5/9/2002: http://www.research.avayalabs.com/user/jianhu/index.html

States that using a sliding window in a recognizer reduces error rate by 50%, but does not give the point of comparison, or the description of how the error was computed (false positive, false negative, etc.)

[HuerstW98] (*) Huerst, Wolfgang; Yang, Jie; and Waibel, Alex "Error Repair in Human Handwriting - An Intelligent User Interface for Automatic On-Line Handwriting Recognition", IEEE International Joint Symposia on Intelligence and Systems, May 21..23, 1998, pp. 389-395

Addition of a UI for correcting handwriting recognition errors to the NPen++ handwriting recognition system: user can write over or cross out erroneous script recognition. User can write an additional character in the middle of a script-writing handwritten word. Delayed strokes (dots over lower-case i or j; cross-marks on a t) are thus also considered to be "repair" user interface.

[HughesRG96a] (*) Hughes, R.G. and Forrest, A.R. "Perceptualisation using a Tactile Mouse", IEEE Visualization 96, pp. 181-187

Mouse designs with haptic tactile feedback, equivalence of sonification (audio feedback) and touch. Use of touch feedback to convey information not associated with touch: e.g. map vegetation and map elevation. Definitions of haptic/kinesthetic/tactile feedbacks.

[HUSAT00] (*) HUSAT "HUSAT: Background to the Institute", Presentation at Human Factors 2000 Symposium: Human Sciences and Advanced Technology at Loughborough University, U.K.

HUSAT presentation human factors in user-interface technologies: history to Dimond Styalator and RAND Tablet: speech and handwriting seem natural to humans, but may not be most natural for humans interacting with machines

States that using a sliding window in a recognizer reduces error rate by 50%, but does not give the point of comparison, or the description of how the error was computed (false positive, false negative, etc.)

URL as of 2002: www.lboro.ac.uk/research/husat/news/proj/jn_presentation.html

[Husky97] (*) Husky Computers Limited "FC-PX5 User's Guide", Husky Computers Limited, Coventry England

Ruggedized pen computer using Pen Windows. Text emphasizes keyboard over gestures. "Microsoft Windows Guide to Pen Computing"

[Igarashi96] . Igarashi, Takeo; Kawachiya, Sachiki; Matsuoka, Satoshi; and Tanaka, Hidehiko "A Pen-Based Constraint Drawing System Combining Dexterity and Precision", Proc. GCAD 96 (In Japanese, English-language abstract)

pen-based stylus-based sketch program with pie menus and sliders, beautification/sketch recognition(?) implemented on "IBM pen PC" and Xerox Liveboard

[Igarashi99a] . Igarashi, Takeo; Matsuoka, Satoshi; and Tanaka, Hidehiko "Teddy: A sketching interface for 3d freeform design", Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, pages 409-416, August 1999

Cited in Arvo00

[Igarashi99b] (*) Igarashi, Takeo "Freeform User Interfaces for Graphical Computing", Doctoral dissertation, Graduate School of Information Engineering, University of Tokyo, December 1999

Sketch-based editing of freehand drawing: dragging and pulling operations on lines and line segments: stroke-based architecture for electronic whiteboards. Refers to "predictive drawing" for sketch editing/editor.

Cites Unistroke character recognition, Cirrin and Quickwriting zone-based menu picking, mentions learning problem for gestures (see Greanias?)

[Immersion00a] (*) Immersion Inc. "MicroScribe 3D Desktop Digitizing Systems: User's Guide and Set-up Instructions", Immersion Corporation, San Jose, CA, 2000

Pantographic/mechanical 3D digitizer system. Primarily used for digitizing solid objects, medical modeling: no force feedback/haptic output

[Interlink98] (*) Interlink Electronics, Inc. "New Versapad Touchpad Sensor", Interlink Electronics, Camarillo, California

Thin touchpad digitizer: quotes Jeff Dao of CIC / Communications Intelligence Corporation. PenOP E-sign company. CyberSign (www.cadix.com) signature verification, Sony as a customer for the PCG 505

Touchpad digitizer claims 1000 lines per axis / 200 counts per inch: implies resistive sheet digitizer

[Intermec00] (*) Intermec Technologies Corporation "6642 Pen Computer Technical Reference", Intermec Technologies Corporation, Cedar Rapids Indiana, 2000

Pen computer using Windows 95 for Pen Computing / PenWindows 2.0: Pen Services 2.0, running on Windows 98 (later than Windows 95). "Lens" field for enabling text buttons in input fields. Adjustable area/distance for double-tap distance. Pen Recognition services include also CIC PenX Recognition. Shows gesture macro editor for assigning macros to PenWindows (1.0?) circle gestures consisting of circled letters: compare to Recognition macros of Pencept PenPad series. Toolbar option for right mouse click: compare to Wang "Guide". PenX include Recognition Tuner to allow user to select which supported shapes appear in user's writing style, but not to train recognizer. Compare to recognizer in PalmOS for selection of shape prototypes. ActiveX Pen Controls, PenWindows 2.0 pop-up virtual keyboard from Start/Programs/Pen Services.

Document is in two portions.

[ItoM97a] (*) Ito, Masanobu; Motohashi, Shunji; and Higuchi, Yoshinari " Video apparatus with image forming means responsive to touch sensitive display ", United States Patent 5,671,014, September 23, 1997

Resistive touchscreen (with stylus) user interface for video camera.

[JacobRJK96a] (*) Jacob, Robert J.K. "Human-Computer Interaction: Input Devices", ACM Computing Surveys, Vol 28 No 1, March 1996

Taxonomy of user input as discrete (keyboard), continuous (some kind of relative or absolute pointing device: mouse, tablet, rotary dial, sliders, etc.), Voice, etc.

[JaegerS99] (*) Jaeger, Stefan "Recovering Dynamic Information from Static, Handwritten Word Images", Abstract only: PhD Thesis, http://isl.ira.uka.de/ISL.publications.html#phd

Describes attempt to re-construct dynamic information of on-line handwriting recognition from off-line static images: mentions Traveling Salesman Problem as part of algorithm.

Abstract says this would allow merging of recognition methods between off-line and on-line algorithms, but does not mention any results

Full text of thesis (at end) says they do not deal with pen-lifts or segmentation, assume one character at a time

[JaegerS00a] (*) Jaeger, S., Manke, S, and Waibel, A. "NPEN++: An On-Line Handwriting Recognition System", 7th International Workshop on Frontiers in Handwriting Recongition, Amsterdam 2000, page 249-260

handwriting recognition: Mentions normalizing size, inclination, and rotation; computing baselines; also refers to general problem of resampling to make points equidistant in space, and Bezier interpolation of "missing" points; Note: removes delayed strokes (e.g. crossing of a "T"). Compare with elastic matching by Tappert?

[JaegerS00b] (*) Jaeger, S., Manke, S, Reichert, J., and Waibel, A. "On-Line Handwriting Recognition: The NPen++ Recognizer", International Journal on Document Analysis and Recognition, IJDAR'00, volume 3 No 3, p. 169-180, 2000

Handwriting recognition using very large word dictionary: claims 91.2% recognition rate using 50000 word dictionary: tree-pruning to avoid exhaustive search

[Jain97] (*) Jain, Anil K. and Zongker, Douglas "Representation and Recognition of Handwritten Digits Using Deformable Templates", IEEE PAMI, Vol 19 No 12, December 1997, pp 1386..1391

Deform outlines of bit-map templates (?) prior to computing degree of matching: compare with elastic matching by Tappert

Optical recognition of handwritten digits from a 2,000 sample subset of NIST Special Database 1 of handwritten characters from ZIP codes: also mentions an IBM data collection.

See also Zongker publication "Chicken Chicken"

[JosephEF86a] (*) Joseph, Eugene R. and Tractman, Michael "Computer Modelling System and Method for specifying the Behavior of Graphical Operator Interfaces", United States Patent 5,405,600, January 16, 1996

Animation of user interface by example

[KaiT97a] (*) Kai, Tsutomu and Matsunami, Masahito "Coordinate Input Device", United States Patent 5,606,346, February 25, 1997

capacitive/electrostatic touchscreen digitizer with X and Y electrodes integrated between pixels of an LCD panel. Shows "wavy line" distortion of grid, even after double measurement to reduce. Mentions multiple measurements to get better resolution

[KamelHM00a] (*) Kamel, Hesham M. and Landay, James A. "A Study of Blind Drawing Practice: Creating Graphical Information Without the Visual Channel", Proc. ASSETS 2000, Arlington VA pp. 34-41

Visual impaired / low vision / blind can draw, but need tactile feedback to do it in a computer user interface. Grid-based model to provide audio (speech) feedback on position and features.

[KangBHA00] (*) Kang, Beng Hong Alex; and Chung, Sun-Woo "Method for providing a cue in a computer system", United States Patent 6,160,555, December 12, 2000

Handwriting recognition user interface: show different cursors (alpha/num/upper-case/etc.) in text entry before user writes, so that user only need to look at one place to see both mode and text cursor position. Note: separate writing and text area, not direct text input / direct manipulation.

[KavehC99a] (*) Kaveh, Chris "Fujitsu Pen Developer's Guide for Windows", Fujitsu Personal Systems Inc., May 1999

Programming guide for Pen computing on Windows platforms: post-Pen-Windows. PenRight! controlls, Visual Basic 4.0 and 5.0, PowerSoft Powerbuilder, VBX Pen Edit controls, (16-bit and 32-bit), 32-Bit Pen API, Pen-aware and pen-unaware applications, CIC InkTools for handwriting recognition for Windows. Microsoft Pen Extensions 1.0 for Windows 3.1, Microsoft Pen Services 2.0 for Windows95, CIC PenX for Windows NT.

[KawakamiM99a] (*) Kawakami, Masahiko; Mamiya, Masaru; Nishiki, Tomonori; Tsuii, Yoshitaka; Okamoto, Akito; Fuita, Toshihiro "A New Concept Touch-Sensitive Display Enabling Vibro-Tactile Feedback", Proc. HCI '98 on People and Computers XIII, pp. 303-312

Vibration Touch: tactile haptic feedback, both click and vibration. Different vibration patterns for different operations (vibrate, one-shot click, pull-down slow click) via solenoid mount in touchscreen.

[KayA98] (*) Kay, Alan "History of the Character Recognizer; Was: Interaction between Keyboard and Mouse", Posting to SQUEAK Mailing List November 7 1998, archived at http://minnow.cc.gatech.edu/squeak/605

Refers to early character recognition / pen-input on Dynabook, and why it was dropped from the prototype: Refers to GRAIL recognizer as "near perfect". Describes early GRAIL system as using Unistrokes, because of fluidity of user interaction, user would learn the recognizer. Describes one step beyond unistrokes, recognition before pen is lifted (compare to Jourjine unpublished demonstration at Wang 1991), said incremental recognition on the fly also done in GRAIL (see refs?)

[KayA00] (*) Kay, Alan "Character recognition", Posting to SQUEAK Mailing List November 5 2005, archived at http://lists.squeakfoundation.org

Commentary on Goldberg Unistroke patent case: asserts that much of handwriting recognition technology prior art was done in 1960's, not known to U.S. Patent Office. Cites GRAIL system by Groner as Unistroke recognition: mentions QuikWriting and Ledeen recognizer

[KeysonDV96a] (*) Keyson, Davic Victor "Virtual Workspace with User-programmable Tactile Feedback", International Patent Application WO 96/07965, march 14, 1996

Software to provide tactile feedback to match regions of a workspace or GUI, based on pre-defined characteristics, so that the tactile haptic effects match the workspace

[KimH99a] (*) Kim, H.; Gilmore, C.M.; Pique, A.; Horwitz, J.S.; Mattoussi, H.; Murata, H.; Kafafi, Z.H.; and Chrisey, D.B. "Electrical, optical, and structural properties of indium-tin-oxide (ITO) thin films for organic light-emitting devices", Journal of Applied Physics, Vol 86, No 11, 1 Dec. 1999, pp. 6451-6461

ITO deposited on glass by vapor deposition, controlling for electrical and optical properties: optical transmission, reflectance, refractive index, band gap (color/tint).

[Kinrot00] (*) Kinrot, Opher; Kinrot, Uri "Interferometry: Encoder measures motion through interferometry", Laser Focus World, March 2000

Optical Translation Measurement, motion detection, basis for OTM Technologies optical digitizer pen, development by GOU Lite Ltd for coherent encodeds for one-two- or three-dimensional motion (stepper motor? servomotor? See Teledyne/TAC file)

[KnowltonKC99a] (*) Knowlton, Kenneth Charles and Miliefsky, Gary Steven "System for the Capture and Indexing of Graphical Representations of Files, Information Sources and the Like", United States Patent 5,973,692, October 26, 1999

User-interface linking of graphical areas on one display to graphical areas in another display

[KoikeH00a] (*) Koike, Hideki; Sato, Yoichi; Kobayashi, Yshinori; Tobia, Hiroaki; Kobayashi, Motoki "Interactive Textbook and Interactive Venn Diagram: Natural and Intuitive Interfaces on Augmented Desk System", Proc. CHI '2000, Den Haag, Amsterdam, pp. 121-128

Optical tablet sensing for digital desk: describes template matching for detecting multiple fingertips and hand for multitouch.

[KrivopalB99a_] (*) Krivopal, Boris "Pressure Sensitive Ink Means and Methods of User", United States Patent 5,989,700, November 23, 199

Pressure-sensitive conductive rubber: semiconductor particles in elastic, organic polymer binder: assigned to Tekscan

[KrugerJ99] (*) Kruger, Justin "Unskilled and Unaware of It: How Difficulties in Recognizing One's Own Incompetence Lead to Inflated Self-Assessments", Journal of Personality and Social Psychology, December 1999 Vol. 77 No 6, pp 1121-1134

Self-evaluation of success/skill: subjects who know more or are more skilled, recognize their own performance more conservatively than low-skilled subjects. To paraphrase: a real expert will be more cautious in claiming to know exactly what is going on, because the real expert knows about the additional factors that may come into play, and what complex interactions can happen. Whereas a person who knows less will be more likely think they have it all figured out, because that person does not know about the other things they should include in their thinking, or that there might be additional ways they could interact.

[Kurtenbach97] (*) Kurtenbach, Gordon; Fitzmaurice, George; Baudel, Thomas; and Buxton, Bill "The Design and Evaluation of a GUI Paradigm based on Tablets, Two-hands, and Transparency", ACM CHI '97, March 22-27, Atlanta Georgia, 1997

Two-handed simultaneous use of stylus and puck with a Wacom tablet: compare with multi-touch. Digitizer puck also reported rotation on surface. Prototype system called "T3" (Tablets, Two-hands, Transparency), using ToolGlass (menu moved by one hand) and drawing/touching/etc. by other hand.

[Kurtenbach97a] (*) Kurtenbach, Gordon "Methods and System of Controlling Menus with Radial and Linear Portions", United States Patent 5,689,667, November 18, 1997

Pop-up marking menus with stylus or other pointing device: linear menu displayed below hotspot, marking/pie menus displayed around rest of hotspot. Permits more menus items to be selected by a single gesture, permits multi-step marking menus.

[Kurtenbach99a] (*) Kurtenbach, Gordon P. "Display and Control of Menus with Radial and Linear Portions", United States Patent 5,926,179, July 20, 1999

Marking menus: pen-still (press-and-hold) gesture brings up menu. Flick gesture involves command without pop-up menu.

[Kurtenbach99b] (*) Kurtenbach, Gordon; Fitzmaurice, George W.; Owen, Russel N.; Baudel, Thomas "The Hotbox: Efficient Access to a large Number of Menu-items", Proc. CHI '97, Pittsburgh USA, pp 231-239

Large menus by combining menubar, accelerator keys, modal dialog, pop-up menus, radial/pie marking menus, and menubars

[Kwatinetz96] (*) Kwatinetz, Andrew "Scrolling Contents of a Window", United States Patent 5,495,566, February 27, 1996

Scroll/jump a window faster depending on how far to scroll, also depending on input: relation to flick gestures, dynamic scrolling

[Lallican00] (*) Lallican, P.M.; Viard-Gaudin, C.; and Knerr, S. "From Off-Line to On-Line HandWriting Recognition", International Workshop on Frontiers in Handwriting Recognition, IWFHR2000, September 2000, Amsterdam, Netherlands, pp 303-312

On-line works better than off-line, so simulate stroke order (and direction of strokes?) to recover time-order of the handwriting. See also VisionObjects commercial development.

[Landay96] (*) Landay, James A. "Interactive Sketching for the Early Stages of User Interface Design", Ph.D. Thesis, Carnegie Mellon University, CMU-HCII-96-106

SILK User interface these: Annotated references to sketch recognition, character recognition, gesture

Reference PerSketch (PenSketch?) system for editing sketches by user interface which allows multiple interpretations of input: four lines as four lines, and as a rectangle. Cited in MyersB96 for free-hand gestures and storyboards for sketching (and application generator / automatic generation) of user-interface designs.

[LandonP04a] (*) Landon, P.; Keates, S.; Clarkson, P.J.; and Robinson, P. "Using haptic feedback to enhance computer interaction for motion-impaired users", Proc. 3rd Intl Conf. Disability, Virtual Reality & Assoc. Tech., Alghero, Italy 2000, pp. 25-32

For motion-handicapped users (cerebral palsy), vibrotactile/vibrating haptic feedback not helpful, but force-feedback feedback is. Feedback prototypes use Immersion Technologies and SenseAble Technologies devices.

[Lang99] (*) Lang "GO Alumni Directory", www.apocalypse.org (no longer available)

List of Alumni from GO Corporation: partial copy, original list no longer available

[LaPedus96] (*) LaPedus, Mark "Apple and Motorola will launch new products with Chinese handwriting recognition", BYTE Magazine, September 1996: also available at http://byte.com/art/9609/sec17/art7.htm

Lexicus division of Motorola with Chinese handwriting recognition product: WisdomPen

Other Chinese pen-computing products: Taipei GoTop; Han Wang Science and Technology in Beijing; Pen Power Technology of Taiwan; Taiwan Palmax in partnerchip with Caso, InfoRay PD-96 organizer recognizes more than 13,000 Chinese characters

Quotes Derek Ling of Motorola/Lexicus that Chinese handwriting recognizers often have higher recognition rates than Roman alphabet recognizers, because Chinese is always written in the same stroke order and style by users (sic: this contradicts study done at Pencept by Salzer)

[Lazzouni97] (*) Lassouni, Mohamed; Yousaf, Mohamed; Qureshi, Rizwan A., and Nazir, Naveed A. "Pen and Paper Information Recording System using an Imaging Pen", United States Patent 5,661,506, August 26, 1997

Optical digitizer using printed pattern on paper, using squares and clusters of squares, compare with Anoto

[LCS/Telegraphics00] (*) LCS/Telegraphics "Wintab Advanced Pointing Device Management for Windowed Environments", LCS/Telegraphics, Cambridge Massachusetts, July 28, 2000

Background information on WinTab specification, originated at 1991 Autodesk conference to define vendor-neutral device driver specification for digitizing tablets

[LeganchukA99a] (*) Leganchuck, Andrea; Zhai, Shumin; and Buxton, William "Manual and Cognitive Benefits of Two-Handed Input: An Experimental Study", ACM Trans. on Computer-Human Interaction, Vol 5, No 4, December, 1998, pp. 326-359

Multiple-hand / multiple-touch user interface study: using two hands allows simultanous manipulation of scale and zoom and position, versus one hand with menu/tool selection. WACOM two-stylus (puck and stylus) tablet used in study prototype.

[LeopoldJL97] . Leopold, J.L. and Ambler, A.L. "Keyboardless visual programming using voice, handwriting, and gesture", Proceedings of IEEE Symposium on Visual Languages, Sep 23-26, 1977, Pages 28-35

(abstract only): Voice, handwriting and gesture pen-computing user interface, using a visual programming environment: states useful for accessibility for manually or visually impaired.

[LevineSR97a] (*) Levine, Stephen R; Harui, Alex J; Hsiao, Chia-Chuan; Donaghue, Karen; and Schirpke, Michael W. "Document Annotation and Manipulation in a Data Processing Ssystem", United States Patent 5,625,833, April 29, 1997

Wang Freestyle patent: annotation (electronic ink and voice/audio) of documents in Freestyle. Mentions state-machine implementation of system.

[LewisJR96a] (*) Lewis, James R. "Reaping the benefits of modern usability evaluation: The Simon story", In Salvendy, G. and Ozok, A., (eds), Advances in Applied Ergonomics: Proceedings of the 1st International Conference on Applied Ergonomics - ICAE '96, pp. 752-757

Review of usability studies for Simon hand-held smartphone/PDA with touchscreen, circa 1993. "CGA" resolution of touchscreen, includes appointment calendar, address book, to-doo list, sketch pad, sending and receiving electronic mail and fax (pre-Internet), system settings GUI, and security.

[LewisJR99a] (*) Lewis, James R.; Allard, David J.; and Hudson, Harold D. "Predictive Keyboard Design Study: Effects of Word Populations, Number of Displayed Letters, and Number of Transitional Probability Tables", Proc. of Human Factors and Ergonomics Society 43rd Anuual Meeting, 1999, pp 429-432

Study of virtual predicive keyboard of IBM Simon marketed by BellSouth: text used for vocabulary/probability tables should be adaptive, or at least should reflect vocabulaor of user application.

[LewisJR99b] (*) Lewis, James R. "Input Rates and User Preference for Three Small-screen Input Methods: Standard Keyboard, Predictive Keyboard, and Handwriting", Proc. of Human Factors and Ergonomics Society 43rd Anuual Meeting, 1999, pp 425-428

Study of virtual predicive keyboard of IBM Simon marketed by BellSouth: showed that standard keyboard, even small, was faster than either predictive keyboard or handwriting. Cites that fast handwriting is about 25 wpm words per minute. Did not study graffiti/unistrokes or other later methods, but disadvantages were attributed to congnitive load of unfamiliar/unpracticed data input skill compared to standard keyboard.

[LiY00a] (*) Li, Yang; Guan, Zhiwei; Chen, Youdi; Dai, Guozhong "Penbuilder: Platform for the Development of Pen-Based User Interface", Proc. ICMI 00 Third Int'. Conf. on Advances in Multimodal Interfaces, pp 534..541

Pen-Book-Page-Paper stylus UI system for mobile systems, with universal gestures: research prototype in China. Cites Wintab.

Partial copy

[LifchitzA00] (*) Lifchitz, Alain and Maire, Frederic "A Fast Lexically Constrained Viterbi Algorithm for On-line Handwriting Recognition", 7th International Workshop on Frontiers in Handwriting Recongition, Amsterdam 2000, page 313-322

Lexical constraint / dictionary for handwriting recognition context: uses directed acyclic word graph DAWG instead of trie tree-structure

[LinJ99a] (*) Lin, James; Newman, Mark; Hong, Jason I; Landay, James A. "DENIM: Finding a Tight Fit Between Tools and Practice for Web Site Design", UC Berkeley Technical Report UCB//CSD-99-1065, September 1999

Sketch editing with limited gestures, uses barrel button on stylus to change mode/function: compare to Recognition Macros of Pencept with AutoCad and other applications

[LongA98] (*) Long, A; Landay, J.; and Rowe, L. "PDA and Gesture Uses in Practice: Insights for Designers of Pen-based User interfaces", Report #CSD-97-976, CS Division, EECS Department, UC Berkeley, Berkeley, CA. January 1998

Study comparing pen-input gesture use on Apple Newton and early Palm Pilot: Gestures used more often on Newton than on Palm Pilot. Also studies used of Graffiti unistroke characters: noted that for Grafitti, users gave different performance ratings when asked about Graffiti than when asked about handwriting recognition although it was the same thing. Primary use of pen computers in study was note-taking during meetings.

[LongAC99a] (*) Long, Allan Christian Jr.; Landay, James A.; and Rowe, Lawrence A. "Implications For a Gesture Design Tool", Proc. CHI '99, Pittsburgh PA USA, pp. 40-47

Study of satisfaction of PDA users (Apple Newton, PalmPilot) on gestures: users preferred gestures as user interface on touch screen, want to define own gestures by example, not tolerant of recognition errors. Test recognizer uses Rubine algorithm.

[Lopresti98a] (*) Lopresti, Daniel P. and Tomkins, Andrew "Method for Locating a Penstroke Sequence in a Computer", United States Patent 5,809,498, September 15, 1998

Index retrieval of electronic ink images for a pen-based computer, by comparing a user input to each of the stored images, rather than comparing to pre-defined characters and doing handwriting recognition of text.

Refers to user viewing of images as the final step in indexing and matching: compare to other methods for doing picture image search for similarity of images

[Lopresti98b] (*) Lopresti, Daniel P. "Ink as Multimedia Data", Proceedings of the Fourth International Conference on Information, Systems, Analysis and Synthesis, July 1998, Orlando, FL, pp. 122-128

Find electronic ink in a database by comparing number of points, point sequences, feature vectors, stroke types, characters, words. References to pretty-fying of electronic ink images. Compare to Slate "deferred translation" and DayTimer indexing methods

[Louderback99a] (*) Louderback, Jim "Fujitsu PenCentra 130", ZDNet Publications: www.zdnet.com/zdtv/freshgear, May 21, 1999

Fujitsu rubberized/ruggedized pen computer running WindowsCE. Mentions pen tablets (portable handwriting computers) running Windows NT.

[Louderback99b] (*) Louderback, Jim "Qubit", ZDNet Publications: www.zdnet.com/zdtv/freshgear, March 26, 1999

Internet Access Device stand-alone touchscren/tablet computer for accessing the internet.

[Luckie98] (*) Luckie, Douglas "Newton Hall Of Fame", Biographical notes on early Apple Newton developers and personalities, http://www.msu.edu/~luckie/hallofame.htm

Stepan Pachikov, Father of Newton's "Cursive Recognizer", Calligrapher handwriting recognition system: originally developed the HWR technology at ParaGraph International

Larry Yaeger, Brandyn Webb and Michael Kaplan - Fathers of Newton's "Print Recognizer": neural network not enough for handwriting recognition, need character segementation, word segmentation, multiple geometric context models, language context moels, search engine, in addition to character classifier

[Machrone00] (*) Machrone, Bill "Wacom's LCD Pen Tablet: Nearly Perfect, Pricey", PC Magazine, November 1, 2000

Integrated tablet and display touchscreen from Wacom PL500, pressure sensitive (actually force-sensitive) stylus, mis-called pressure sensitive tablet, price about $3000

[MacIntyreB96a] (*) MacIntyre, Blair and Feiner, Steven "Future Multimedia User Interfaces", Multimedia Systems, Springer Verlag, 1996, Vol 4: pp. 250-269

multimedia and interactive user interfaces: one new requirement is the need for the use of multiple pens (multi-touch/multi-user) on a signle large display. In ubiquitous computing, touchscreens will be more common than mice, because of integration with real-world objects. Existing windowing systems not appropriate (location-dependent GUI needed)

[MackenzieSI99a] (*) Mackenzie, Scott I. and Chang, Larry "A performance comparision of two handwriting recognizers", Proc. Interacting with Computers 11, 1999

32-subject comparision of Microsoft (Pen Windows 2.0?) and CIC Handwriter 3.3 handwriting recognizers. Also mentions Unistroke, Graffiti (original, not CIC) and T-Cube unistroke handwriting recognition: T-Cube from Apple uses pie menus. Zhao incremental recognition. Interface characteristics (subsetting, context) have significant effect on performance.

[MackenzieSI99b] (*) Mackenzie, Scott I. and Zhang, Shawn X. "The Design and Evaluation of a High-Performance Soft Keyboard", Proc. CHI 99, Pittsburgh PA USA, 15-20 May 1999, pp. 25-31

Study of soft/virtual keyboard layout: QWERTY keyboard better than "optimal" keyboard layout at first (familiariy?), optimal keyboard only slightly better over time. Testing on Windows for Pen Computing / Pen Windows, WACOM integrated touchscreen and display. Also mentions Unistroke, Graffiti (original, not CIC) and T-Cube unistroke handwriting recognition: T-Cube from Apple uses pie menus. Zhao incremental recognition. Interface characteristics (subsetting, context) have significant effect on performance.

[MacLeanKE99a] (*) MakLean, Karon E. and Roderick, Jayne B. "Smart Tangible Displays in the Everyday World: A Haptic Door Knob", Proc. IEEE/ASME Intl. Conf. on Advanced Intelligent Mechatronics AIM'99, Atlanta, Sep. 1999, 6 pages

Haptic feedback in doorknob (everday object): force, motion, heat/temperature, sound. Speculative uses include gestore motion on doorknob as an input password, whether inside lights are on/off, whether someone is/has been in room.

[MacNeill96] (*) MacNeill, David "What's on your Newton?", Pen Computing Magazine, Issue #11 July/August 1996

Short article on actual user use of Newton pen PDA computer: mentions Zaurus and Pilot text-based PDAs compared with Apple Newton MessagePad: Pocket Quicken, Graffiti

[MalacariaCF98a] (*) Malacaria, Charles F. "A Thing, Flexible Matrix-Based Pressure Sensor", Sensors Magazine, September 1998

Matrix pressure senstivie material with grid of conductors, covered with pressure-sensitive resistive ink on the same conductors. Rows and columns can be read independently and sequentially: 250,000 sensels per second to 50,000,000 sensels per second. Flexiforce sensors from Tekscan.

[MamiyaM97a] (*) Mamiya, Masaru; Hasegawa, Hiromasa; Sekino, Yoshio; Kawakami, Masahiko; Nishiki, Tomonori; Tsuji, Yshitaka; Okamoto, Akito; and Fujita, Toshihiro "A New Way to Overcome the Uneasy Operation of Touch-Sensitive Displays by Incorporating "Click" Mechanism CC Switch", Proc. HCI Int'l. 97, 7th Int'l. Conf. on Human-Computer Interaction, Vol 1, pp. 619-622

Touchscreen (digitizer and display) by itself uncomfortable to use because of lack of haptic feedback: add a mechanial click to touchscreen operation. Best operation is if touch sensor responds to pressure (force), so that user can trace with finger before applying sufficient force/pressur to activate switch.

[Manke96] (*) Manke, Stefan; Finke, Michael; and Waibel, Alex "A Fast Search Technique for Large Vocabulary On-Line Handwriting Recognition", International Workshop on Frontiers in Handwriting Recognition, University of Essex, England, Sep. 2..5, 1996

Use of a dictionary of words to aid in handwriting recognition: tree search of dictionary is faster than flat (linear) search. Word dictionary taken from "ARPA Wall Street Journal" project (for speech recognition evaluation), but no citation to the source.

[Manke00??] (*) Manke, Stefan and Bodenhausen, Ulrich "A Connectionist Recognizer for On-line Cursive Handwriting Recognition", (reference not known: conference proceedings?)

Dynamic time warping / Time Delay Neural Network for single-character recognition, using a 3x3 or 20x30 bitmap local image

Claims 99.5% recogition writer-dependent, between 91.5% and 99.5% on writer-indepdenent: expansion to larger writer-independent database gives about 75%

[MankoffJ98a] (*) Mankoff, Jennifer and Abowd, Gregory D. "Cirrin: A word-level unistroke keyboard for pen input", Proc. of UIST 98, 1998, pp. 213-214

Large pie menu, user moves and dwells at certain characters in one compound stroke: can pop up at any location on screen

[MartinD00] (*) Martin, David A. "Projection Display System with Touch Sensing on Screen, Computer Assisted Alignment Correction and Network Conferecing", United States Patent 6,141,000

Whiteboard system using a projection display with a touch-screen digitizer. Multiple pens/stylus, eraser.

[MartinelliHK99a] (*) Martinelli, John K.; Martinelli, Robert M; Pickett, Mark C.; Ritchey, Wendell W.; and Yaniger, Stuart J. "Force Sensing Semiconductive Touchpad", United States Patent 5,943,044, August 24, 1999

Tap, Tap-Drag and other gestures for emulating mouse button gesture (click-and-drag, etc.). Touchpad using two sheets and a resistance-changing material between. Critiques indirect measure of force/pressure (capacitive area) vs. direct measuremens of force in a digitizer/touchpad for pressure/force input for scrolling and acceleration.

[Masson99] (*) Masson, Terrence "History of Computer Graphics (CG)", www.visualfx.com/milestones.htm

Ken Knowlton 1950s. Primarily generation of computer graphics, mentions SketchPad with light pen, but not Styalator or Rand Tablet. Computer animation and CGI.

[MasuiT99a] (*) Masui, Toshiyuki "Text input device and method", United States Patent 6,002,390, December 14, 1999

Predictive keyboard: predicted words for auto completion are taken frmo a dictionary and displays.

[MatsushitaN97a] (*) Matsushita, Nbuyuki and Rekimoto, Jun "HoloWall: Designing a Finger, Hand, Body and Object Sensitive Wall", Proc. UIST 97, Banff Canada, pp. 209-210

Capacitive-sensing wall/whiteboard with rear projection to create an interactive environment: compare with VideoPlace, Wellner

[McCloudSR98a] (*) McCloud, Seth R. "Apparatus and method of communicating using three digits of a hand", United States Patent 5,808,567, September 15, 1998

Multi-touch input for three fingers using 3x3 matrix of touch buttons for index finger and two larger side buttons for thumb and middle finger. Intended as very small keyboard/keypad on wrist and hand-held devices such as PDAs.

[McGeeMR99a] (*) McGee, Marilyn Rose "A haptically enhanced scrollbar: force feedback as a means of reducing the problems associated with scrolling", Proceedings for the First PHANToM Users Research Symposium (PURS'99), Heidelberg, Germany, pp. 17-20.

Study of force feedback in cursor control / scrollbar: hardware was PHANToM by SensAlbe Technologies, mechanical actuators to pen-like or thimble-lik user input device.

[McCrary98] (*) McCrary, Victor, and Smith, Alyssa "Electronic Book '98 Workshop, "Turning a New Page in Knowledge Management"", NIST Conference Proceedings, NIST-IR 6372, published 2001

Mostly about E-books and document publishing, Ralph Sklarew also present

[McCrickard99] (*) McCrickard, D. Scott and Catrambone, Richard "Beyond the Scrollbar: An Evolution and valuation of Alternative List Navigation Techniques", IEEE Symposium on Visual Language, 1999, pp. 270-ff

mural bar and pile bar: information about entries in lists are encoded with highlighting marks into trough of a scrollbar, compare with Russian patent by Gorvunov

[McGraw96] (*) McGraw, Gary and Hofstadter, Douglas R. "Emergent Letter Perception: Implementing the Role Hypothesis", Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society, pages 621-626, July 1996

Cites early work by Blesser, Shillman, Cox et al on perceptual/cognitive basis for human letter character recognition: describes "Letter Spirit grid", similar to line-segment display, as a model for human recognition. Refers to letter vs. spirit, apparently spirit refers to an experimental model for writing/shape (not handwriting) style variability

[Menendez96] (*) Mendendez, Norberto; Potrebic, Peter J.; and Sharpe, Benjamin W. "Method of Creating Packets for a pointer-based Computer System", United States Patent 5,555,369, September 10, 1996

UI Development by creating icons displayed in a rectilinear grid

[MertzC96] (*) Mertz, Christophe P. and Lecoanet, Patrick "GRIGRI: Gesture Recognition on Interactive Graphical Radar Image", Proc. of Gesture Workshop '96, March 19th, 1996York, U.K. Published in Progress in Gestural Interaction, Springer Verlag

GRIGRI: French vernacular for "scribble". Abstract only.

[Microsoft96a] (*) Microsoft Corporation "Problems Encountered by Some Windows 95 Applications on Windows NT", technet.microsoft.com, 749964, October 1996

Incompatibilities with Windows 95 on Windows NT, including right-click menus / popup context menus on Windows 95.

File contains additional references for right-click menus on Windows95.

[Microsoft96b] (*) Microsoft Corporation "Microsoft to Acquire aha! Software", Press Release, Microsoft Corporation, April 8, 2006

Microsoft acquires Aha! software, product is InkWriter electronic-ink note-taking and editing, appears similar to van Raamsdonk. Later became Windows Journal / NoteTaker application for Tablet PC.

[Microsoft96c] (*) Microsoft Corporation "Microsoft Announces Broad Availability of Handheld PCs With Windows CE", Microsoft Corporation press release, Nov. 18 1996

Microsoft Windows CD clamshell Pocket PC with stylus and touch screen (resistive?)

[Microsoft97a] (*) Microsoft Corporation "Microsoft Visual Studio 97, Enterprise Edition", Microsoft 0197 Part Number X03-08924

Visual Studio / C++ for Windows95 / WindowsNT. Does not include developer SDKs. Does not appear to include Pen SDK/PenWindows PenAPI.hlp

[Microsoft99a] (*) Microsoft Corporation "Description of Windows for Pen Computing Pens", Microsoft Knowledge Base, 10/13/1999, KB85663

Pen/tablet drivers use special interface for higher data rate than mouse driver, special display driver for displaying electronic ink

[Microsoft99b] (*) Microsoft Corporation "Microsoft Computer Dictionary, Fourth Edition", Microsoft Press, 1999

General Reference

[MicroTouch98a] (*) MicroTouch Systems Inc. "TouchWare for OS/2 User's Guide", MicroTouch System, Inc. Methuen Mass

First copyright is 1991: mentions double-click area setting required for using a touch-screen or touch-pad with a mouse driver, settings for the touch-screen affect the mouse behavior also, because it is the same driver.

Desktop mode / Drawing mode / Button mode: controller uses quick touch (tap) to position the cursor, long touch to simulate mouse button behavior. See also UnMouse.

[MicroTouch98b] (*) MicroTouch Systems Inc. "MT3000 Capacitive Controller", MicroTouch System, Inc. Methuen Mass

Controller (with firmware) for Microtouch touchscreens, UnMouse, touch-pads: Calibration is not four-point or orthogonal calibration, but two-point to get size of visible display

[MicroTouch98c] (*) MicroTouch Systems Inc. "TouchWare for Macintoch (USB controllers) User's Guide", MicroTouch System, Inc. Methuen Mass

First copyright is 1991: mentions double-click area (in TouchWare control panel) setting required for using a touch-screen or touch-pad: evidently no OS support for double-click area

[MillerRJ96a] (*) Miller, Robert J.; Bisset, Stephen; Allen, Timothy P.; and Steinbach, Guenter "Object Position and Proximity Sensor", United States Patent 5,495,077, February 27, 1996

Capacitive touchscreen digitizer: conductive object increases capacitive coupling between two wires of X/Y grid, simultaneous measurement. Conductive foam on top of digitizer allows it to detect any object, not just conductive. One application is musical instrument played by touchings of the hands.

[MillerJ99] (*) Miller, James R.; Bonura, Thomas; Nardi, Bonnie; and Wright, David "System and Method for Performing an Action on a Structure in Computer-Generated Data", United States Patent 5,946,647, August 31, 1999

Scan displayed text with pattern matching to find phone numbers, addresses, etc., to highlight them and turn them into active links or buttons, clickable with a stylus

[MillerP97] (*) Miller, Peter "Recursive Make Considered Harmful", Available from the author: millerp-at-canb.aaug.org.au

Implementation problems of recursive make.

[MillerRJ97a] (*) Miller, Robert J. and Bisset, Stephen J. "Object Position Detector", United States Patent 5,648,642, July 15, 1997

Matrix capacitive touchscreen sensor, proximity sensing: analog circuitry to find peak. Can detect multiple fingers for gestures, infer pressure from height of peak

[MillerT98a] (*) Miller, Timoth and Zeleznik, Robert "An insidious Haptic invasion: Adding force feedback to the X desktop ", Proc. UIST 98, San Francico, pp. 59-64

Add mechanical force-feedback (haptic) to X-Windows

[Minatuchi98] (*) Minatuchi, Yu; Okuyama, Satoshi; Fakue, Akiko; and Kamata, Hajime "Apparatus for Manipulating an Object Displayed on a Display Device by Using a Touch Screen", United States Patent 5,844,547, December 1, 1998

Manipulating an image in response to touch input on a touchscreen. Mentions flick, pick, push, flip, distortion of image in response to pressure touch gesture, scrolling.

[MondenA00a] (*) Monden, Akito; Iida, Hajimu; Matsumoto, Ken-ichi; Inoue, Katsuro; and Torri, Koji "A Practical Method for Watermarking Java Programs", 24th Comp. Softw and App. Conf. (compsac2000), Taipai Taiwan, Oct 2000

Watermarking / hidden signature in Java code by addind a dummy method, and recoding opcodes for arithmetic operations to represent the signature data. Cites to code obfuscators, method is robust when obfuscated.

[MoranTP97a] (*) Moran, Thomas P.; Chiu, Patrick; van Melle, William "Pen-Based Interaction Techniques For Organizing Material on an Electronic Whiteboard", Proc. UIST 97 Symposium on User Interface Software adn Techology

Recognize long lines, especially vertical and horizontal, as border gestures, editing gestures to separate or aligg objects, text sketches on a whiteboard system. tap, balloon/lasso, pig-tail/pigtail, left-wedge, right-wedge, bump gestures for editing.

[MobilePoint98b] (*) Wanderbookman (YouTube user) "iPad precursor: Penpoint's last chance: Face-to-Face SFA", http://www.youtube.com/watch?v=yINfscbeXRsa, fetched 2011

1998 video of MobilePoint electronic briefcase AKA PenPoint: appears to be porting of original (?) PenPoint code to be a pen-centric application running on Windows.

[MobilePoint99a] (*) Weimar, Clayton "The Electronic Briefcase Interactive Sales System: architecture Overview", MobilePoint 03/07/1998

Fleet sales application using Windows 95 ostensibly without Pen Windows / Pen Services -- dedicated "e-case" application, user interface metaphor looks like that of PenPoint. Refers to pen computer hardware as a Tablet PC (not same as later Microsoft use of the name), Fujitsu Stylistic 1000 with electromagnetic digitizer, small display 640x480 (portrait mode). PAGE (Paper and Gesture) metaphor: Notebook Organization Model and Gesture Command model: visual appearrance much like that of PenPoint with outlines, tabs on the right. Basic gestures are caret (insert), circle (edit), tap (turn to / go to), scratch-out (delete), checkmark (options/attributes), flick (scroll) and question mark (help). Also tap Pres, Drag to select copy move, press to select (hold), press drag (hold and drag) gestures. Swoop gesture -- single letter to move through index. Double tap gesture on electronic ink to select then circle (edit) to translate (recognize).

Electronic copy only. As of 2008, MobilePoint.com platforms are Microsoft Tablet PC, as of 2011 mentions iPad.

[MoranTP99a] (*) Moran, Thomas P.; Pedersen, Elin R.; McCall, Michael K; and Halasz, Frank G. "Time-Space Object Containment for Grpahical User Interface", United States Patent 5,404,439, April 4, 1995

When selecting objects with a drag rectangle, take into account temporal/time when objects were created by user -- user mostly likely wants to select objects created together in time. Uses threshold time to determine direction of reversing motion in a "wipe" (swipe?) gesture.

[MyersB96] (*) Myers, Brad A. "User Interface Software Technology", ACM Computing Surveys, Vol 28 No 1, March 1996, pp. 189-191

Short review of user-interface systems, User interface management systems UIMS (application generators): HP/Apollo Open-Dialog, VAPS by Virtual Prototypes; Automatic generation tools for user interface such as ITS from Baecker et al IMB Research. Refers to direct-manipulation interfaces as synonymous to GUI graphical user interface. Cites SILK, free-hand gestures and storyboards for sketching initial user-interface desings.

[MyersB98a] (*) Myers, Brad A.; Stiel, Herb; and Gargiulo, Robert "Collaboration using multiple PDAs connected to a PC", Proc. CSCW 98 ACM Conference on Computer Supported Cooperative Work

Remote control of a PC (mouse/keyboard) from a resistive touchscreen PDA (Palm Pilot): problems of emulating mouse buttons on touchscreen. Experimental system to have multiple users access a single collaborative/group application.

[MyersB98b] (*) Myers, Brad A. "A Brief History of Human-Computer Interaction Technology", Interactions, March+April 1998, pp. 44-54.

History of windows, gesture, mouse, direct text manipulation back to approximately 1960.

Traces history of WIMP/GUI interface from Windows 95 back to Macintosh, back to Xerox Park, back to SRI / Stanford Research Laboratory and M.I.T. Direct manipulation user-interface from Sketchpad. No citations before 1960. Gesture recognition in AMBIT/G at MIT Linconln Labs in 1968. Cites light pen to 1954, tousch screen. Digitizing tablet used to create movie "Hunger" in 1971. Mistakenly states that Rand tablet was the first pen-based input device. Teitelman 1964 first trainable gesture recognition, gesture input on GRAIL system in 1964. UIMS systems in 1996, interface builders (application generator) in 1979.

File contains further revisions

[MyersB00] (*) Myers, Brad; Hudson, Scott E.; and Pausch, Randy "Past, Present and Future of User Interface Software Tools", ACM Trans. on Computer-Human Interaction, Vol 7 No 1, March 2000, pp 3-28

Future UIs will employ recognition-based UIs (gestures?); dissimilary of mouse-based vs. stylus vs. gesture UIs not equivalent

[Narayanaswamy96] (*) Narayanaswamy, Shankar "Pen and Speech Recognition in the User Interface for Mobile Multimedia Terminals", Ph.D. Thesis in EE/CS, University of California, Berkeley, 1996

"InfoPad" project at Berkeley. Citation to Go/PenPoint handwriting recognition with dictionary. Describes use of context areas to disambiguate gestures from handwriting. Cites problem of double-tapping (versus double-click) with stylus, because position is not the same. Cites problem of tip-switch sticking on digitizer at ends of strokes, added tails to character prototypes rather than correct them. Suggests combining digitizer/tablet for pointing/navigation with voice recognition for disabled accessibility.

Mentions Pen PDAs as of 1996: Casio Z-7000, Sharp Zaurus, Amstrad PIC 700, Sony PIC-1000.

PDA mentions Scriptel digitizer, term "raised strokes" for proximity detection (shake gesture of Tablet PC?)

[NationalInstruments98a] (*) National Instruments "LabVIEW User Manual", National Instruments, January 1998, Part Number 320999B-01

Visual programming language for laboratory instruments: earlier product versions exist, touchscreen and mouse input.

[Netscape99] (*) University of North Texas "Netscape Navigator 4.x and the UNT Home Page", University of North Texas, fetched from www.unt.edu/training/UNTHomePage/UNTHomePage.PDF

Description of Netscape 4.x user interface, including back icon with press gesture

[Ng98] (*) Ng, Elizabeth; Bell, Tim; and Cockburn, Andy "Improvements to a Pen-Based Musical Input System", OzCHI '98: The Australian Conference on Computer-Human Interaction, 29 November to 4 December, 1998, pp. 230..252, IEEE Press

Presto: Handwriting input for musical scores. (See earlier reference.) Additional gestures: right angles, appear simlar to those of ritePen / EverNote. Pop-up menus via gestures, one motion for selection. Cites "Schoolchildren" pen gesture application, Air-traffic control, others. Includes use of velocity in recognizing "flick" gestures, distinct from normal writing speed. Examples of delete/rubout gestures from various systems: dot, squiggle, air traffic control, Penpoint, Graffiti, Windows fro Pe Computing.

[Norrie98] (*) Norrie, Moira C. and Signer, Beat "Switching over to Paper: A New Web Channel", Proceedings of 7th Internal Conference on Electronic Paper, Saint Malo, April 1998. Reprint available at www.globis.ethz.ch

Digitally encoded paper with (bar code? dataglyph? electronic paper?) information for web links. Compare to Hyperlink

[NovakJL98a] (*) Novak, James L. and Petterson, Ben "Object Locating System", United States Patent 5,764,066, June 9, 1998

Electrostatic/Mutual capacitance proximity sensor for objects: single pair of electrodes to sense distance, multiple pairs of electrodes to determine shape and location of object.

[OsawaN00a] (*) Osawa, Noritaka; Asai, Kikuo; and Sigimoto, Yuji Y. "Immersive graph navigation using direct manipulation and gestures", Proc. Virtual Reality Software and Technology VRST 2000, Seoul Koera pp. 147-152

Virtual reality 3-D gestures including zoom (with two fingers of one hand), spotlight (using zoom), lock and unlock gestures

[OsrOnline98] (*) OSROnline "Purpose of the Pen Driver", www.osronline.com/ddkx/w98ddk/pen_0bc1.htm

Several pages on Windows 95 DDK Pen-Windows drivers, reference to Programmer's Guide to Pen Services for Microsoft Windows95. "Required Pen Driver Messages", "Other Pen Driver Messages" (load/unload, configuration, etc.)

[Palm96a] (*) Palm Pilot / 3Com Corporation "Graffiti reference card", 1996 Palm Pilot personal organizer product information

Unistroke character set, except for cap lock gesture

[Palm96b] (*) Kairer, Ryan "Palm Pilot 1000 Retrospective", Palminfocenter.com, fetched 2011

PalmOS 1.0, two weeks on two batteries, Graffiti alphabet on back of unit.

[Palm97a] (*) Palm Pilot / 3Com Corporation "PalmPilot Handbook", 3com Corporation, 1997, Part Number 423-0210-01B

Resistive-film PDA: gesture full-screen pen stroke activates on-screen virtual keyboard. Graffiti handwriting recognition (unistroke) with separate areas for alphabetic and for numeric handwriting. Shortcut / pigtail gesture, other shortcuts pre-defined are two-letter combinations. Command gestures of single diagonal stroke (command stroke) following by mnemonic character e.g. "C" for cut. Other gesture strokes for cut, copy, next field, etc.

[PanditMS97a] (*) Pandit, Milind S. and Kalbag, Sameer "The Selection Recognition Agent: Instant Acces to Relevant Information and Operations", Proc. IUI 97, Orlando Florida, pp 47-52

Recognition (by patterns) of phone numbers, dates, proper names in text, which are then turned into clickable links. Cites similar features in Netscape Navigator (email text recognized), others. Highlighting of text by patterns, then clickable?

[PanditMS99a] (*) Pandit, Milind S. "Recognition Of and Operation On Text Data", United States Patent 5,849,636, January 12, 1999

Recognize text (phone numbers, dates) in text, then perform operations on those pattern instances detected: e.g. pop-up menu for Send Mail / Add to Address Book. Highlighting of text by patterns, then clickable?

[ParkinsonK97a] (*) Parkinson, Kelly "Dwell Selection Mouse Button Emulation", Senior Thesis, Ryerson College, Canada, 1997

Mouse button emulation: abstract only

Summary only

[Papyrus96] (*) Papyrus Associates: Bill Kania "Recognition by Papyrus: single-stroke character recognition", Papyrus Asscociates, papassoc@tiac.net, www.papassoc.com

Unistroke character recognition

[PenComputing96a] (*) Pen Computing Magazine "Handwriting Recognition", 1996(?), http://whiterabbit.com/amug/...PenReport/Handwriting.html

Review of Unistroke recognition, PDA products and technology (HWX), mentions UNIPEN / JOT electronic-ink format, styalator

Mentions graphics handwriting versus gestures, context example of circle as a drawing, as digit zero, character O, or Edit gesture (in PenPoint).

[PenComputing96b] (*) Pen Computing Magazine "Pen Services for Windows 95 Product Review", Pen Computing Magazine, August 1996, Issue No. 11

PenWindows/Windows for Pen Computing essentially off the market, available only in 2.0 version for OEMs . Mentions Circle-S/S-circle gesture (for "space"), changes in other gestures

[PenComputing96c] (*) Pen Computing Magazine "Graffiti 2.0 Product Review", Pen Computing Magazine, January/February 1996, Issue No. 8

On Newton: Double-tap gesture in any text entry field to bring up Graffiti input. Mentions split of two areas for alphabetic and for numeric/digit input. Mentions that OmniGo allows input anywhere on the screen.

[PenComputing96d] (*) Pen Computing Magazine "Freestyle 1.0 Product Review", Pen Computing Magazine, January/February 1996, Issue No. 8

Not the Wang Freestyle product: CalliGrapher handwriting recognition from ParaGraph: later used by Microsoft. Comment on difficulties of using editing gestures.

[PenComputing96e] (*) Pen Computing Magazine "CIC Handwriter for Windows 95 Product Review", Pen Computing Magazine, January/February 1996, Issue No. 8

"Scribe" character recognizer for Windows for Pen Computing 2.0: YPad electronic note-taking application. Signature Sentinal uses biometric dynamic signature verification as password.

[PenComputing96f] (*) Pen Computing Magazine "Digitizer Whiteboards", Pen Computing Magazine, May/June 1996, Issue No. 10

Whiteboard digitizing tablets: Microfield Graphics SoftBoard with map-projection and medical applications; Numonics IPM Interactive Presentation Manager with cordless stylus/pen; Smart Technology SMARTboard (using resistive technology) with rear-projection

[PenWindows96a] (*) PenWindows: Microsoft Corporation "Programmer's Guide to Pen Services for Microsoft Windows 95 - PENAPI.HLP", Microsoft system documentation

HLP file with documentation on Pen Windows 2.0 -- longer version of material in PenWindows95b. Also provided as part of Windows programming documentation in third-party development tools such as Delphi7.

Electronic copy only

[PerkinsR97a] (*) Perkins, Rod; Ludolph, Frank; and Keller, Dan Smith "Inventing the Lisa User Interface", Interactsion, Vol 1. No 1, 1997, pp. 40-53

Desktop manager UI for Lisa Computer (predecessor of MacIntosh), mentions explicit inspiration from SmallTalk.

(ACM reprint)

[Perlin98] (*) Perlin, Ken "Quikwriting: continuous Stylus-based Text Entry", Proceedings of ACM UIST '98 conference

Compared with Graffitti: single-stroke / unistroke character input, recognizing motions around a circular menu without lifting the pen between strokes (rather than recognizing normal characters): cites T-cube by Venolia

[Perlin00] (*) Perlin, Kenneth "Method and Apparatus for Writing", United States Patent 6,031,525, Febuary 29, 2000

QuikWriting: refers specifically to it as using zones, ergo zone-based recognition, but the "writing" is not normal characters, it is a circular menu, no stylus-lift.

See also press announcement "Look Ma, One Hand!" from Microsoft

[PerryTS00a] (*) Perry, Theresa Sue and Dillard, Pamela Ann "Wireless communication device adapted to generate a plurality of distinctive tactile alert patterns", United States Patent 6,160,498, December 12, 2000

Assign vibrating alert patterns (haptic vibration) to particular calls or numbers in a cell phone

[PetzoldC96a] (*) Petzold, Charles "Programming Windows 95", Microsoft Press, 1996

Windows 95 UI and programming guide, 1996.

[PetzoldC99a] (*) Petzold, Charles "Programming Windows: Fifth Edition", Microsoft Press, 1999

Reference manual on Windows "C" Win32 API circa 1999. Described two and three-button mouse, WM_LBUTTON, WM_MBUTTON, WM_RBUTTON messages (p 275), Synchronous nature of messages in event que (p 329), system message queue

[PharesR98a] (*) Phares, Robert "Resistive Touchscreen having Multiple Selectable Regiouns for Pressure Discrimination", United States Patent 5,815,141, September 29, 1998

Resistive touchscreen digitizer with separate regions that can be turned off, e.g. for palm rejection

[Philips97a] (*) Philips Electronics "VELO1 User's Guide -- Windows CE PDA -- 1997 Edition", Philips Electronics / Microsofot, 1997

Windows CE PDA with touchscreen, adjustable properties. User gestures are tap and drag: refernece to text editing using the stylus as one would a mouse. No reference to handwriting recognition.

[Philips98a] (*) Philips Electronics "VELO1 User's Guide -- Windows CE PDA -- 1998 Edition", Philips Electronics / Microsofot, 1997

Windows CE PDA with touchscreen, adjustable properties. Windows CE applications installed from desktop PC with Windows CE Services 2.0.

[Plamondon00] (*) Plamondon, Rejean and Srihari, Sargur N. "On-line and Off-line Handwriting Recognition: A Comprehensive Survey", IEEE Trans. on Pattern Analysis and Machine Intelligence PAMI, January 2000, pp 63-84

Compare with Tappert/Suen survey articles on state-of-the-art in handwriting recognition for 1980 and 1990. Mentions Writer Identification (signature verification and identification), language models for incorporating grammar and dictionary models.

[PluchinoA09a] (*) Pluchino, A; Rapisarda, A.; Garofalo, C; "The Peter Principle revisited: a computational study", Presentation: Econophysics Colloquirum 2009, Centro Ettore Maiorana Erice, Italy, Oct. 25-31, 2009

Game-theory Mathematical model of overcoming Peter Principle (individuals are promoted until they reach a position they are not competent at, and then stay there: thus organizations tend to have managers who are not competent at their job) by promoting people at random.

Cites also to 2010 paper with same title, Physica A 389 (2010) 467

[Poyner96] (*) Poyner, Rick "Wintab Interface Specification 1.1: 16- and 32-bit API Reference", LCS/Telegraphics, Cambridge Massachusetts, revised May 9, 1996

Industry-standard driver from www.pointing.com/LCS-Telegraphics to allow all (DOS) applications to use pointing devices (mouse/tablet/touchscreen/joystick/etc.) interchangeably. Wintab/Windows/Pen Windows: mentions tablet sharing, multiple application accessing tablet at once with different services: different tablet context objects for different (concurrent) applications, tablet packets with data for a high report rate. Driver supports command-input area, WT_PACKET window messages.

[PrinceKR96] (*) Prince, Kevin R. "Finger Mounted Computer Input Device", United States Patent 5,581,484, December 3, 1996

Finger-mounted digitizer accelleration "glove" using accellerometers and pressure-sensitive sensors in the fingertips, to detect simulated keyboard and mouse input. Describes simulating a computer text keyboard, and a musical instrument keyboard. Compare to Kaplow.

[RAND98] (*) RAND Corporation "50 Years of Looking Forward", RAND Review, Fall 1998. Available at http://www.rand.org/publications/randreview/issues/rr.fall.98/50.html

In 1961, researchers create the RAND Tablet, the first two-dimensional writing surface that allows humans to commuicate instantly with computer through characters printed on a tablet.

[Redhat98a] (*) RedHat-list "Re: four button mice?", redhat-list@redhat.com/msg01799.html, 28 Jun 1998

Posting concerning mapping of UI events for mouse buttons to other UI events, such as keyboard input: four-button multibutton mouse.

[REX98a] (*) www.starfish.com "What is REX?", www.mcmullon.com/rexreviews/whatisrex.htm, www.starfish.com, 1998

Handheld PDA product by Phillipe Kahn, Franklin Electronic Publishers, Starfish Software, and Citizen's Watch. No touchscreen interface, on-screen alphabetic keyboard accessed by physical scrolling buttons. Electronic file contains additional materials.

[RheingoldH00] (*) Rheingold, Howard "Tools for Thought, Chapter Eleven: The Birth of the Fantasy Amplifier", M.I.T. Press, 2000

History and interview with Alan Kay on Dynabook. Refers to Sketchpad electronic ink (?) graphics editing. Lengthy discussion of Dynabook, but all references are to mouse (not stylus/tablet) and keyboard, no mention of handwriting recognition.

[RichardsonFB96] (*) Richardson, Frederic B. III "System for Software Registration", United States Patent 5,490,216, Feburary 6, 1996

Copy-protection system generating a license code from information of the system on which the software will execute

See also Uniloc and Bluecava for additional materials

[Rocha00] (*) Rocha, Manuel Antonio "Handwriting Template System", United States Patent 6,142,783, November 7, 2000

Physical/mechanical guide template, like those used for drfting lettering, as a guide to the correct writing of cursive script.

Compare to restricted templates for doing Unistroke characters within a small mechanical box

[RojasR00a] (*) Rojas, Raul; Knipping, Lars; Raffel, Ulrich; and Friedland, Gerald; "Elektronische Kreide: Eine Java-Multimedia-Tafel für den Präsenz- und Fernunterricht", Technical Report B-17/2000, Freie Universit&aumo;t Berlin, Institut für Informatik, October 2000. Available at www.match.tu-berlin.de

Research group investigating various whiteboard systems for university instruction and remote education, using commercial products. Real-time participation in class using web browser, including interactive audio and video streams.

[RosenbergLB97a] (*) Rosenberg, Louis B. and Brave, Scott B. "Method and Apparauts for providing Force Feedback for a Graphical User Interface", International Published Patent Application WO 97/21160, June 12, 1997

Add force feedback to a mouse or other input device to indicate sliders, buttons, scrollbars, windows, and other components of a GUI

[RosenbergLB00a] (*) Rosenberg, Louis B.; Schena, Bruce M.; Brave, Scott B. "Method and apparatus for tracking the position and orientation of a stylus and for digitizing a 3-D object", United States Patent 6,078,876, June 20, 2000

Pantographic 3-D stylus digitizer, including menu input by pantographic stylus, menu in work area.

[Rosenthal97] (*) Rosenthal, Amy S., Hu, Jianying, and Brown, Michale K. "Size and Orientation Normalization of On-Line Handwriting Using Hough Transform", IEEE International Conference on Acoustics, Speech, and Signal Processing, April 21-24, 1997, Munich, GermanyMulti-Dimensional Signal Processing Poster Session MDSP6P.13 Vol. 4, pp. 3077

Correct for rotation, base-line drift in on-line recognition: claims 25% improvement in recognition accuracy, but does not describe recognizer or how the improvement was measured

Boundary-line extraction, backtrack strokes: appears to be segmenting cursive/connected text at local Y extrema

[RuedisueliLW98] (*) Ruedisueli, Laurence, W. and Wilfong, Gordon Thomas "System and Method for Processing and Managing Electronic Copies of Handwritten Notes", United States Patent 5,838,819, November 17, 1998

Filing and archiving system for electronic-ink handwritten notes. Identifiers for each page/sheet of writing, so that pages can be recalled. Identifiers left open to be numeric, graphical icons of the page, sequential, etc.

[SalcudeanSE98a] (*) Salcudean, Septimiu Edmund, and Kelly, Allen J. "Controller", United States Patent 5,790,108, August 4, 1998

Force-feedback haptic mouse.

Also see 1993 "MagicMouse: Tactile and Kinesthetic Feedback in the Human-Computer Interface using and Electromagneticlaly Actuated Input Device with Two or Three Degrees-of-Freedom" and "Electromagnetic Force-Feedback Mouse for the SUN SPARCstation: Prototype Design Document" (1992)

[Sarkar98] (*) Sarkar, Sudeep "Case of Vermont Microsystems Inc. vs. Autodesk", Available at http://courses.cs.vt.edu/~cs3604

Case study in course on ethics: Prepared during NSF Workshop on Teaching Ethics and Computing. Otto Berkes, later director of Origami / UMPC project at Microsoft, trade-secret lawsuit between VMI and Autodesk on misappropriation of proprietary information

[SchifferS98f] (*) Schiffer, Stefan "Visuelle Programmierung: Grundlagen und Einsatzmoeglichkeiten", Addison-Wesley, Munich, 1998

Publication of Ph.D. dissertation on visual programming: Shows virtual slide switch from LabView from 1994

[SchilitBN98a] (*) Schilit, Bill N.; Golovchinsky, Gene; and Price, Morgan N. "Beyond Paper: Supporting Active Reading with Free Form Digital Ink Annotations", Proc. CHI 98, Los Angeles, CA, pp. 249-256

XLibris: Electronic ink mark-up of documents shown in commerical pen-tablet display as a "Reader's Notebook", permitting search on annotation text -- compare with later developments on Microsoft Tablet PC, earlier work by Slate on DayTimer. Distinguishes between annotations related to book text, and notes which are not related. Gestures more convenient than barrel button. Uses Muto pen/tablet display tethered to Windows 95 PC -- no mention of W4PC/PenWindows? Press-and-hold: Dwell gesture instead of barrel button, barrel button is mouse 2nd button?

[SchoedlA97] (*) Schoedl, Arno "The NewtonScript Programming Language", www.cc.gatech.edu, source notes for CS 6751, Fall 1997

Description of NewtonScript programming language, includes discussion of slots and dual inheritance through both prototypes and parent class heirarchy

[SchoeningJ09a] (*) Schoening, Johannes; Krueger, Antonio; and Olivier, Patrick "Multi-touch is dead; Long live multi-touch", Proc. CHI 2009, April 2009, Boston

Opinion piece on multi-touch having a 25 years history before Jeff Han and the iPhone from Apple, many designs not taking into account 25 years of HCI lessons learned (esp. Buxton)

[Schomaker96] (*) Schomaker, L. "The NICI stroke-based recognizer of on-line handwriting", Available at http://hwr.nici.kun.nl/recog/nici-stroke-based-recognizer.html

Velocity-based stroke: uses changes in stroke velocity to recognize the segmentation of characters: does not work with children's handwriting or handwriting with tremor. Makes use of UNIPEN software, refers to "Papyrus" project from 1990. Refers to other paper on handwriting recognition system based on human motor system. Points out some of the factors making it hard to judge recognition accuracy: count accuracy by letters or words, selection of test data, diversity in background of writer subjects, confusion of training and test sets, etc.

[Schumer98] (*) Schumer, Alfred L. "Digitizer Interface", United States Patent 5,768,492, June 16, 1998

Subdivide digitizer tablet into virtual tablet areas in different parts of the tablet surface: patent is to software, but disclosure is to hardware implementation only. See files on Schumer and LCS/Telegraphics.

[Scribens99] (*) Scribens Research Laboratory of Ecole Polytechnique Montreal "Bibliography of publications", Available at http://www.scribens.polymtl.ca/publications.html

Lists publications and patents by Plamondon, Privitera, Guerfali, Djezire, Nouboud, Barriere, Parizeau, Clergeau-de-Tournemire, Leclerc, Sabourin, Beaumier, Brault, Yergeau, Suen, Chouinard, Lorette, Clement, Stelmach, Schomaker, Baron, Beauregard, Gagne, Robillard, Poussart, etc.

Signature verification, electronic ink data compression formats, Human recognition accuracy, Fuzzy syntax for script recognition, normalization of handwritten characters, more

[Scriptel97a] (*) Scriptel Holding "Scriptel Holding annual report (10-K)", Scriptel Holding, available at sec.edgar-online.com, Marcy 27 1997

Scriptel electrostatic/capacitive digitizer can sense touch and proximity and is durable, unlike directo contact touch screen technology; is less subject to noise than electromagnetic digitizer in a lyare, and more robust and higher resolution than membrane pressure-sensitive digitizer touchscreen.

[Sekendur98] (*) Sekendur, Oral F. "Absolute Optical Position Determination", United States Patent 5,852,434

Digitizer tablet "smart paper" that puts a printed code on paper, position is read by optical sensor in the stylus tip. Compare with technology by Anoto et al.

[Selker99] (*) Selker, Ted "Style and Function of Graphic Tools", Graphics Interface GI'99 Online Papers: www.graphicsinterface.org

Essay reviewing graphical user interfaces, including position input, no mention of gestures or handwriting recognition

[SensorySoftware99a] (*) Sensory Software Inc. "HandsOff: on-screen keyboard", Sensor Software, 1999

On-screen keyboard, rectangular grid display, intended for severely handicapped users. Any pointing device may be used -- e.g. head-mounted pointer, does select on "dwell" gestures as substitute for touch or mouse click.

[ServanSchreiberF99a] (*) Servan-Schreiber, Franklin "Display of multiple images based on a temporal relationship among them with various operations available to a user as a function of each displayed image size", United States Patent 5,973,691, October 26, 1999

User interface for photographs, more recent images are larger and in front. User can tap/select images. Larger images have more options available for labeling and editing. Mouse input.

[ShneidermanB00a] (*) Shneiderman, Ben; Kang, Hunmo "Direct Annotation: A Drag-and-Drop Strategy for Labeling Photos", Proc. IV '00, Intl. Conf. on Information Visualisation, Wash. DC 2000 IEEE Computer Society

Annotate/label personal photo collections by drag/drop of names onto correct part of image, and into list boxes on sides, etc. Mouse or touch screen (direct manipulation), text values only ever entered first time of use via keyboard.

[Sklarew99a] (*) Sklarew, Ralph "Handwritten Keyboardless Entry Computer System", United States Patent 6,002,799 assigned to AST Research, Inc., Irvine, California, December 14, 1999

Abstract refers to transparent sensing surface over display, electronik ink, character recognition, and learning mode

Abstract reads almost identically to Sklarew patent 4,972,496: this one refers to "terminal disclaimer"

Very long list of prior art

[Sklarew99b] (*) Sklarew, Ralph "Handwritten Keyboardless Entry Computer System", United States Patent 5,933,526, assigned to AST Research, Inc., Irvine, California, August 3, 1999

Abstract refers to transparent sensing surface over display, electronik ink, character recognition, and learning mode

Abstract reads almost identically to Sklarew patent 4,972,496: this one refers to "terminal disclaimer"

Specific to learning mode where adaptive recognition must be taught from initial state

[Sklarew00] (*) Sklarew, Ralph "Handwritten Keyboardless Entry Computer System", United States Patent 6,064,766, May 16, 2000

Abstract refers to transparent sensing surface over display, electronik ink, character recognition, and learning mode

Abstract reads almost identically to Sklarew patent 4,972,496: this one refers to "terminal disclaimer"

actions are confirmed specifically by reverse-video of the field operated upon

[SmithDC98a] (*) Smith, David Canfield and Irby, Charles H. "Xerox Star Live Demonstration", CHI 98, p. 17, 18-23 April 1998 (Demonstrations)

Xerox Star (1970s) had very few discrete named command or menus items: presentation on consistency and context. gestures?

File contains poster paper, not the video

[SmithiesCPK98] (*) Smithies, ChristopherPaul Kenneth; and Newman, Jeremy Mark "Document And Signature Verification System and Method", United States Patent 5,818,955, October 6, 1998

signature verification system, primarily about the use of a data envelope that includes identity information, and a record of the "gravity prompt" message displayed to user to inform user about the seriousness of signing. Also claims use of signed checksum on document.

[SmithiesS99] (*) Smithies, Steve, Novins, Kevin, and Arvo, James "A handwriting-based equation editor", Proceedings of Graphics Interface '99, pages 84-91, Kingston, Ontario, June 1999

Two-dimensional input with handwriting recognition for mathematics: features include showing parsing in real-time, with an eight stroke delay, showing bounding boxes on all characters/groupings as an aid to user understanding parsing. User can edit strokes, select alternate recognition results, and edit grouping/parsing of strokes.

[StewartJ99a] (*) Steward, Jason; Bederson, Benajamin B.; and Drui, Allison "Single Display Groupware: A Model for Co-present Collaboration", Proc. ACM CHI'99 Conf., May 15-20, 1999, pp. 286-293

Multiple users sharing single display (whiteboard), but from separate workstations/PDAs with touchscreen. Asks question about accessibility using audio output for the blind/visually impaired for groupware/whiteboard.

[StrickonJ98a] (*) Strickon, Joshua and Paradiso, Joseph "Tracking Hands Above Large Interactive Surfaces with a Low-Cost Scanning Laser Rangefinder", Proc. ACM CHI'98 Conf., Paris 21-23 1998, Los Angeles

Multipoint touchscreen interface using video shadow projection: shadowing of one hand by another resolved by adding inertia / extrapolating motion of hidden hand.

[Subrahmonia00] (*) Subrahmonia, Jayashree and Zimmerman, Thomas "Pen Computing: Challenges and Applications", Proceedings of ICPR 2000 (pre-print)

Short overview of pen-computing: refers to ultrasonic/acoustic digitizer, also barcodes like that of Anoto but different

Gives limiting factors for acoustic/sonic digitizer, at 50 dpi due to air currents, etc.

Optical pattern digitizer building up mosaic of images from normal paper: not clear that they ever actually evaluated such a device

[SymbolTechnologies96] (*) Symbol Technologiess "PPT 4600 Software Development Kit and Getting Started for DOS and Windows", Symbol Technologies Inc., One Symbol Plaza, Holtsville, New York

Cross-development tools for low-end embedded pen computers: Support for DOS and Windows. Appearts to be a third-party package (Windows for Pen computing / Pen-Windows, and MSDOS). Hardware is a ruggedized single-hand (large, but with strap) unit with built in scanner for barcodes (two-dimensional bar codes PDF417).

[Synaptics97a] (*) Synaptics Inc. "Synaptics TouchPad C++ API, Revision 1.5", Synaptics.com, 1997

API for Synaptics capacitive touchpad/digitizer, sensing both position and contact area (force/pressure). Includes virtual scroll bar in separate area of TouchPad surface, scrolling by edge pressure at edge of surface. Includes press gesture (press-and-hold?): drag, draglock, tap gestures (started in separate area of tablet?) Includes proximity sensing. Supports connecting multiple tablets.

[TacTex00a] (*) TacTex Controls Inc. "MTC Express Guide multitouch touchpad: Owner's and Developer's Guide, Version 1.1", TacTex Controls Inc., April 20, 2000

optical-fiber multi-touch controller, shows map of fingertip images for five fingers as part of installation verification. Normalization process to calibrate touch response (taxel == touch pixel) with interpolation for higher resolution. "C" API reference.

[TarrC00a] (*) Tarr, Christopher; Salisbury, J. Kenneth Jr.; Massie, Thomas Harold; and Avilies, Walter A. "Method and apparatus for generating and interfacing with a haptic virtual reality environment", United States Patent 6,084,578, July 4, 2000

Interfacing a haptic device/display with a virtual reality environment, using a model of the compound objects of the virtual reality environment. Many references.

[TaylorAG97a] (*) Taylor, Ashley George "WIMP Interfaces: CS6751 Tpicv Report: Winter '97", www.cc.gatech.edu

Review of WIMP user interfaces: cites to Smalltalk visual lanaguage in early 1970s. and Sketchpad from 1963. Mentions metaphors of buttons and controls resembling those on a video editing deck,

[TaylorS96] (*) Taylor, Scott "Pen for OS/2 Update", Pen Computing Magazine, Issue #8 January/February 1996

Review of WARP, Pen extensions to OS/2. Mentions desktop Pen PC using external tablet. Cursor change to indicate in user interface when over a handwriting free-form input field.

[TisueS98a] (*) Tisue, Seth "Indie Version History: New Stuff, 26 Jun 1998", Internet posting June 26, 1998, available at www.cs.northwestern.edu/~riesbeck/indie/versions.html

Minimum movement threshold of five pixels to initiate a drag to prevent problem of inadvertently moving/dragging an object (widget) when user's intent is to select or edit the object.

[Tou96] (*) Tou, Frederich N. and Capps, Stephen P. "Method and apparatus for inserting text on a pen-based computer system", United States Patent 5,528,743, assigned to Apple Computer, Inc., June 18, 1996

Automatic recognition of handwritten text in the context of paragraphs: text is either placed into the appropriate place in an existing paragraph, or starts a new paragraph

Shows use of writing baseline

[Tou96a] (*) Tou, Frederich N. and Capps, Stephen "Method and apparatus for inserting text on a pen-based computer system", United States Patent 5,528,743, assigned to Apple Computer, Inc., June 18, 1996

Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton.

Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

Text-editing, determining whether input is text, and location/targetting in relation to an existing paragraph. (Compare with Slate?)

[Trinder99] (*) Trinder, Michael "The computer's role in sketch design: a transpartent sketching medium", in Computers in Building: Proceedings of the CAAD Futures 99 Conference, Kluwer Academic Publishers, Boston 1999

Includes overview/survey of sketch input systems: electronic cocktail napkin, Bill Buxton. Compares mouse to drawing with a brick, pressure-sensitive tablet and use of tilt in user interface.

[TurkM99] (*) Turk, Mathew "Chapter 10: Gesture Recognition", Draft manuscript for "Handbook" project: Available at vehand.engr.ucf.edu/handbook

Gesture recognition, but primarily about hand and body gestures, not tablet/stylus gesture recognition for a computer GUI. One review section on Pen-based Gesture Recognition. PenPoint/GO is notable by not being mentioned: author 's address is at Microsoft Research. Only citation before 1991 is to Sketchpad.

[UKA99] (*) Interactive Systems Labs, CMU and Uni Karsruhe "Publications on Neural Nets, Speech, Multimodal and Natural Language Processing", http://isl.ira.uka.de/ISL.publications.html

Source of Jaeger abstracts on handwriting recognition: lip-reading, speech recognition and UIs mostly.

[UllmerB97a] (*) Ullber, Brygg and Ishii, Hiroshi "The metaDESK: Models and Prototypes for Tangible User Interfaces", Proc. UIST 97, Banff, Alberta, Canada, pp. 223-232

Combine physical objects ("phicons" -- physical icdons) and graphical objects ("icons") in one user interface. Two-hand (multi-touch) zoom/rootate using physical bar with two sensor pucks. Most objects tracked optically.

[UlrichRR96a] (*) Ulrich, Robert R. "Method and Apparatus for a Recognition Editor and Routine Interface for a Computer System", United States Patent 5,566,248, October 15, 1996

Pen input area with text recognition (on Newton?)

[Unigraphics00] (*) Unigraphics User Museum "Miscellaneous Junk", http://www.uguser.org/home/museum/hall/Misc_junk.htm

Collection of early Unigraphics tablet/pointing devices: Textronix Data Tablet, Spaceball three-dimensional joystick/pointing device, UGDD Unigraphics Detail Drafting tablet overlay, showing menus for keystroke macros (CAD UI menus on tablet digitizer) or GRIP programs, McDonnel Douglas

[UreMJ99a] (*) Ure, Michael J. "Touch-sensitive keyboard mouse", United States Patent 6,982,302, November 9, 1999

multiple simultaneous touches used for touch-sensitive keyboard with chording: one-handed keyboard using multiple key depressions -- touch-tone keyboard layout, or for one-hand PDA-type device. Any kind of multi-touch sensor may be used. Automatic registration of fingers by having space (most frequent character) be all four fingers.

[UreMJ00a] (*) Ure, Michael J. "Touch-sensitive keyboard mouse and computing device using the same", United States Patent 6,107,997, August 22, 2000

multiple simultaneous touches used for touch-sensitive keyboard with chording: one-handed keyboard using multiple key depressions -- touch-tone keyboard layout, or for one-hand PDA-type device. Touch sensor shows images of fingertips. Any kind of multi-touch sensor may be used.

[vanCruyningenI98a] (*) van Cruyningen, Izak "Popup Menus with Directional Gestures", United States Patent 5,805,167, September 8, 1998

Mentions marking menus / pop up context menus. When a menu pops up in response to a gesture, user can move stylus to selected item from the menu without lifting the pen beforehand. Popup menus include Japanese katakana, icons, numeric keypad/keyboard.

[Videotile99] (*) Videotile: AT&T Laboratories "The Videotile", AT&T Laboratories, Cambridge Massachusetts

Tablet digitizer and display, refers to sending raw analog video to the device rather than processing the video stream in the terminal: mentions Papyrus Associates and Allegro handwriting recognition. Recognition algorithms execute on separate server processor, not in local firmware

[VincentN00] (*) Vicent, N. and Dorizzi, B. "A Fractal Justivication of the Normalization Step for Online Handwriting Recognition", Proc. 7th International Workshop on Frontiers in handwriting Recognition, pp. 535-540

Cites to REMUS recognition software: handwriting recognition, application of fractal models to determine charactertistics which do not vary based on tablet resolution, writing speed, or writing size. Automatic scaling of sizes?

[VirtualInk97] (*) Virtual Ink corporation "Virtual Ink Corporation: The Company & The Product", entrepeneurship.mit.edu/15975/VirtualInk_CompanyProduct.pdf

Business Plan and profile for the epen / e*pen product, an electromagnetic digitizer to retrofit to a large existing whiteboard, bundled with remote whiteboarding application software

[Wacom97a] (*) WACOM Company Ltd. "WACOM PenPartner User's Manual for Windows", Wacom Company, May 21, 1997

PenPartner digitizing tablet with UltraPen for Window 3.1, Windows95 and Windows NT 4.0. Force-sensing (pressure-sensitive) stylus with side button, and eraser tip on back end of stylus (similar to Wang Freestyle). Tablet/Mouse driver. Shows using stylus to erase text (with eraser cursor/icon) in WordPad. Both absolute positioning and relative (mouse) positioning motion, user selectable. Side button programmable to simulate keyboard modifier keys for size, drag, etc.

[WagnerK99] (*) Wagner, Kirsten "Informations- und Wissensorganisation anhand raeumlicher Ordnungsmodelle: Das "Spatial Data-Management System" der "Achitecture Machine Group" als Fallbeispiel", Position Statement, Internationale Zeitschrift fuer Theorie und Wissenschaft der Architektur, ISSN 1439-8363, Wolkenkuckucksheim, 1999

Review of data-access models using graphical representations: shows Memex system of Vannevar Bush, showing stylus input (with digitizer tablet? Telautograph?) for hand-written electronic ink, possibly handwriting recognition to insert "code symbols" as annotation and linking information on a document. Photograph of Sketchpad by Sutherland, 1963.

[WalrathK99a] (*) Walrath, Kathy and Campione, Mary "The JFC Swing Tutorial: A Guide to Constructing GUIs", Sun Microsystems, 1999

Java Swing: Layout Managers for positioning GUI elements at runtime (not an IDE), Limited support fo Accesibility API com.sun.java.accesibility.util and AccessibleJComponent base class, documentation for accessibility on included CD-ROM.

[WalshN99a] (*) Walsh, Nancy "Learning Perl/Tk", O'Reily & Associates, 1999

Mapping between UI events and mouse buttons in Perl

[Wanderley00] (*) Wanderley, M.M. and Battier, M, eds. "General Bibliography on Gestural Control in Music", Reprint from "Trends in Gestural Control of Music", 2000, Ircam - Centre Pompidou

Very long bibliography: mostly about gestures of music conductors, but contains some references to written gesture recognition with stylus and digitizer. Also contains references to recognition of American Sign Language gestures.

[WardJR96] (*) Ward, Jean Renard, Barret, David M., Martin, Patricia A., and Mokoski, Christopher D. "User Interface having Simulated Devices", United States Patent 5,491,495, assigned to Wang Laboratories, Lowell, Massachusetss, February 13, 1996

Simulated virtual soft keyboard, handwriting recognition, simulated mouse input, in a GUI implemented in a separate processor from the main processor.

[WeimerC98a] (*) Weimer, Clay "The Story of MobilePoint", www.allaboutcocoa.com/golucent/storyofmo.doc, fetched July 6, 2011

History of MobilePoint through approximately 1998. MobilePoint spin-off/spin-out from GO/PenPoint, field sales force application, user interface and features reminiscent of PenPoint's notebook metaphor. MobilePoint acquired other GO/PenPoint third-party application provides in pen computing. Mentions history of PenPoint/Windows for Pen Computing/Microsoft PenWindows. State Farm used 5000 pen computers (PenPoint) with field representatives. IBM took over maintenance of PenPoint code for ThinkPad 730T pen computer. Claims first use of Smart PHone as product name, PenPoint documentation went to unknown third party. Source code for Numero and MagicScript acquired from PenMagic/Pivotal, Gnosis from Deskin.

[WellsND99a] (*) Wells, Nichola D. "Teach Yourself KDE 1.2 in 24 hours", SAMS Publishing, 1999

Guide for KDE window manager for Linux/Unix: Describes configuration UI for mouse, thresholds for acceleration on movement, and threshold for minimum distance in a short period of time for mouse drag-gesture movement to go into accellerated speed: compare with flick gesture? KDE 2.0 also has minimum drag distance, minimum number of pixels movement before a drag is started.

[WestermanW99a] (*) Westerman, Wayne "Hand Tracking, Finger Identification, and Chordic Manipulation on a multi-touch surface", Ph.D. dissertation, U. Delaware, Spring 1999

Refers to hotscroll continuous scrolling on OS/2 by Samual Audet, and Autoscroll (scrolling momentum) by a four-finger gesture without decelerating. Multi-touch gestures

Partial printed copy, full electronic copy.

[Wikipedia97a] (*) Wikipedia.org "PalmPilot", wikipedia.org, fetched 2011

History of Palm Pilot touchscreen PDA with Graffiti/unistroke handwriting character recognition, Memo Pad, To Do List, two scroll buttons.

[WilcoxLD97a] (*) Wilcox, Lynn D.; Schilit, Bill N.; and Sawhney, Nitin "Nick" "Dynomite: A Dynamically Oranganized Ink and Audio Notebook", Proc CHI 97, March 1997, pp. 186-193

Ink and Audio annotation system similar to Freestyle, but with a number of gestures: drag-rectangle to select, tap to select, horizontal line for new page, etc.

[Willey97] (*) Willey, Mark "Design and Implementation of a Stroke Interface Library", Technical report, Department of Electrical and Computer Engineering, Purdue University, March 24, 1997

Simple zone-based (here called "bins") single/uni-stroke recognition for command input: compare specifically to PenCept "Recognition Macros" of 1985

[WilsonAD00] (*) Wilson, Andrew David "Adaptive Models for the Recognition of Human Gesture", Ph.D. Thesis, M.I.T, Feburary 2000

Gesture recognition (hand and body gesture) for interactive demonstration "Swamped!". Gesture of hand inside a puppet.

[WindowsSystemJournal98a] (*) Windows System Journal "Microsoft Windows CE 2.0: It's Not Just for Handheld PCs Any More", Windows System Journal, May 1998: available at http://www.microsoft.com/msj/0598/wince.aspx

Windows CE on Handheld PC (with physical keyboard), Palm-size PC (with handwriting recognition or pop-up virtual keyboard), Auto PC (for automobile touchscreen), Pocket Explorer. Palm-size PC (P/PC) include Casio Cassiopeia E-10, www.casiohpc.com with MIPS processor (not Intel)

[WinogradT99a] (*) Winograd, Terry and Guimbretiere, Francois "Visual Instruments for an interactive Mural", Proc. CHI 99, 15-20 May, 1999, pp. 234-235

Optically-tracked laser pointer digitizer: both a stationary click (turn on laser while close) and marking menu by sweeping laster pointer across an action bar (side of octagon for pie menu). Five gestures like Xerox STAR menu items (cut, copy, paste, undo gestures: sweep gesture across action bar. Universal menu gesture can be used anyplace for large-size display: press-and-hold? it refers to pie menus and Kurtenbach

[WolfeA00] . Wolfe, Andrew Lawrence and Barrett, Gary Lloyd "Multi-modal touch sensitive peripheral device", United States Patent 6,037,930, March 14,2000

Resistive film digitizer used to implement various virtual devices: joystick mode, mouse mode, absolute mode, keypad mode

Compare to Kaplow?

[Yaeger98] (*) Yaeger, Larry S., Webb, Brandyn, J. and Lyon, Richard F. "Combining Neural Networks and Context-Driven Search for On-Line, Printed Handwriting Recognition in the Newton", Preprint from AAAI "AI" Magazine, Spring 1998. Available at www.beanblossom.in.us/larryy/ANHR.html

Newton "hand-printing" (versus the "cursive") recognition: character classifiers, integrated multiple representations, normalized output error, negative traigning, stroke warping (elastic matching?), frequency balancing, error emphasis, quantized weights

Mentions extension to cursive as a "challenge" -- which implies that it didn't work?

[Yaeger98a] (*) Yaeger, Larry S. "Neural networks provide robust character recognition for Newton PDAs", IEEE Expert, 1998(?)

Copy on file does not give date: also available at http://www.beanblossom.in.us/larryy/ANHR.IEEEExpert.html

Mentions use of dictionaries, special contructs for dates, time, phone numbers, and ability to write words that are outside the dictionaries: general use of context information

Separate references look like patents were pending on several of these features

Frequency balancing/weighting in ANN / Adaptive Neural Networks: under-represented writing styles are a problem, such as a three-stroke "5" variant

[YuW00a] (*) Yu, Wai; Ramloll, Ramesh; and Brewster, Stephen "Haptic Graphs for Blind Computer Users", Proc. 1st Intl. Workshop on Haptic Human-Computer Interaction, pp. 41-51

Three-dimensional 3D force-feedback electromechanical digitizer for visualizing simple graphs and 3D surfaces for the blind and visually impaired. Adding auditory feedback and texturing aids in the perception of the surface: compare with SciAm article on multi-sensate integration.

[Zeleznik96] . Zeleznik, Robert C., Herndon, Kenneth P., and Hughes, John F. "SKETCH: An interface for sketching 3D scenes", In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, page 163-170, August 1996

Cited in Arvo00

[ZeleznikRC97a] (*) Zeleznik, Robert C., Forsberg, Andrew S; Strauss, Paul S. "Two Pointer Input for 3D Interaction", 1997 Symposium on Interactive 3D Graphics, Providence RI, pp. 115-120

Two-handed user interface using two independent cursors: prototype using Wacom tablet with simultaneous touch and stylus

[ZettsJM99a] (*) Zetts, John Mark and Desrosiers, Maurice Roger "Distinguishing gestures from handwriting in a pen based computer by size discrimination ", United States Patent 5,862,256, January 19, 1999

Size/dimension threshold for tap gesture is smaller if character recognition is also enabled, to allow user to use both tap and small characters like periods

[ZettsJM99b] (*) Zetts, John Mark and Desrosiers, Maurice Roger "Distinguishing gestures from handwriting in a pen based computer by stroke analysis", United States Patent 5,864,635, January 26, 1999

Bounding rectangles to segment strokes into likely words: use this information plus size to distinguish writing from gestures.

[ZettsJM00a] (*) Zetts, John Mark and Desrosiers, Maurice Roger "Method of and System for Facilitating User Input into a Small GUI Window Using a Stylus", United States Patent 6,049,329, April 11, 2000

When user starts writing on text field, bring up larger rectangle to write in. If just tap in text field, select it.

Main Reference Page