(2008..2010) History of Pen and Gesture Computing

History of Pen and Gesture Computing:
Annotated Bibliography in On-line Character Recognition, Pen Computing, Gesture User Interfaces and Tablet and Touch Computers

References from the approximate years 2008 to 2010.

This compilation and all annotations are copyright © Jean Renard Ward, 1993, 2004, 2011.
Permission is granted to use this information in publication, including confidential reports, provided that accompanying text clearly makes reference to the URL for this page, along with the statement:

Source: Annotated Bibliography in On-line Character Recognition, Pen Computing, Gesture User Interfaces and Tablet and Touch Computers Copyright Jean Renard Ward
These are items in my personal collection, either as physical items or (sometimes) as PDF files. I can be contacted at jrward@alum.mit.edu.
Copyright © Wed Feb 27 19:47:35 EST 2013 .

Mirrors of this page can be found at:

http://users.erols.com/rwservices/pens/biblio10.html
http://216.15.114.196:81/pens/biblio10.html
http://rwservices.no-ip.info:81/pens/biblio10.html (Generally most up-to-date)

Main Reference Page

[3MTouch08a]
(*) 3M Touch "Dispersive Signal Touch Technology: Technology Profile", 3M Touch, 2008
- Acoustic touch digitizer, using bending waves within substrate/glass instead of surface waves SAW, determins center location of smearing/dispersed/reflected acoustic waves. Compare with TouchDynamics / Acoustic Pulse Recognition?

[Acer10a]
(*) Acer "Acer Iconia: Dual-Display-Notebook", www.computerbild.de, 24 November 2010
- Dual-touchscreen laptop with virtual keyboard or other elements in one side, regular display in other. Compare with Refalo, Microsoft Courier. Dual-touchscreen. Additional references in file.

[Adapx08a]
(*) Adapx.com "Adapx Digital Paper", www.adapx.com, fetched 2008
- Paper forms for Anoto-type opctical digitizer pen: mentions 1200 dpi resolution of color printers certified by Anoto. Capturx capture software to upload electronic ink data directly into Microsoft OneNote, ArcGIS 9.2 Desktop geographical mapping software, and AutoCAD. "Rite in the Rain" all-weather waterproof writing paper.

[AFB10a]
(*) American Foundation for the Blind "Assistive Technology Timeline", www.afb.org, 2010
- History of talking computers, DOS and Windows Screen readers, and other assistive technologies: Enhanced PC Talking Program by Ronald Hutchinson worked with word processors ands spreadsheets 1984, outSPOKEN for Macintosh 1989, ASAP Automatic Screen Access Program "with artificial intelligence" 1990.

[AnanthaswamyA09]
(*) Ananthaswamy, Anil "Vibrating touch screen puts Braile at the Fingertips", New Sciencist Magazine, 31 March 2009
- Accessibility technology: Haptic display device for Nokia haptic touch-screen with vibration (similar to iPod/iPhone) devices: six pulse/no-pulse signals via vibration corresponding to the six dots of a Braille character.

[Apple08a]
(*) Apple.com "iPhone: Using the Multi-touch Display / Entering Text on the Multi-touch Display Keyboard", support.apple.com, July 10, 2008
- iPhone/iPad gestures: flicking and dragging gestures does not select (press-and-hold or press gesture). Tapping halts dynamic zoom. Pinch and zoom gestures. Press to get magnified view of text while editing. Note: does not cover accessibility gestures, such as triple-flick.

[Apple10a]
(*) Apple.com "It's easy to be good with Numbers", www.apple.com, April 2010
- iWorks spreadsheet for iPad: refers to swip and tap gestures

[Apple10b]
(*) Apple.com "VoiceOver: Fuer blinde und sehbehinderte Menschen hat Apple eine Loesung in jeden Mac integriert", www.apple.com, October 2010
- (in German) Review of VoiceOver screen reader software for Maic with multi-touch trackpad: mentions "rotor" circle/rotational gesture to bring up navigation tools and command input. Supports up to 32-line braille (braillezeilter) output, 1 on Bluetooth, 31 on USB.

[Apple10c]
(*) Apple.com "Apple - Accessibility - iPhone - Vision", www.apple.com, fetched 2010
- VoiceOver accesibility screen-reader software. Mentions voice prompting on what gesture is appropriate: Rotor gesture with two fingers to change scope of other features: flick to move by pages or lines, etc. Double-tap with two or three fingers.

[Apple10d]
(*) Apple.com "Apple - Accessibility - VoiceOver - In Depth", www.apple.com, fetched 2010
- VoiceOver accesibility screen-reader software. Drag of finger (or two) over item speaks the item. Gestures may be assigned new semantics: preferences may be stored removed on a server.

[Arrington08a]
(*) Arrington, Michael "Microsoft TouchWell can inexpensively turn any flat surface into a multi-touch display", www.crunchgear.com, May 14th, 2008
- See also CrunchPad about Arrington

[Atmel08a]
(*) Atmel Inc. "Amtel's New Family of Touch Screen Solutions Enable Two Touch Gestures for Intuitive user Interfaces", www.atmel.com, press release, October 22, 2008
- Additional material in paper files: Quantum acquired by Amtel: see Quantum file.

[Atmel08b]
(*) Atmel Inc. "Touch Sensors Design Guide / Amtel Touch Library User Guide", www.atmel.com
- QTouch touchscreen. Extensive discussion of functioning of capacitive touch sensors.

[Atmel09a]
(*) Atmel Inc. "Atmel QMatrix Touch Technology", www.atmel.com
- QMatrix touch sensor IC devices: scan touchscreen keys consisting of passive matrix of copper or transparent ITO indium in oxide, differential detection to reject capacitive pickup on adjacent keys. States spread spectrum signals to reduce interference.

[AutioMT09a]
(*) Autio, Markku Autlo and Jaervioe, Jami Jarkko Juhani "Graphical Functions by Gestures", United States Patent 7,623,119, November 24, 2009
- Gesture on an inactive area (not an icon, link, scrollbar, etc.) is processed as a command if the handwritten character matches character. Compare with PenPoint.

[BaileyRPS09a]
(*) Bailey, Ralph-Peter Steven "Haptic Input Devices", United States Patent 7,499.021, March 3, 2009
- Multi-pod (hexapod/pentapod) linkage mechanism for force feedback using magneto-restrictive fluid brakes. Has squeezable (pressure, but not tip-force) stylus for input.

[BeavenDF10a]
(*) Beaven, Douglas F.; Ahlgren, Janet; Kelley, Kevin; Palmer, Gorham; and Rudolph, Stuart E. "System for Performing Collaborative Tasks", United States Patent 7,698,160
- Graphical user interface allowing users to combine information from multiple internet and other sources into single web page and share information with others. Data from multiple sources can be combined based on keywords, field names, or other attributes present in the data. Patent assigned to Virtual Agility.

[Billinghurst09a]
(*) Billinghurst, Mark and Buxton, William "Gesture based Interaction: Chapter 14 of "Haptic Input" Draft Documents", www.billbuxton.com
- Gesture defined as hand gesture ("a motion of the body that contain contains information", not as handwriting/shape gesture for pen-computing (cites to Kurtenbach90 for definition). Mentions Theremin as gesture-input device (non-computer). Mentions "put that there" (Bolt 84). Draft of May 27, 2009: File also contains 2002 Draft

[BishopT10a]
(*) Bishop, Todd "Dead 'Courier' walking: Microsoft gets dual-screen design patent", techflash.com, June 29, 2010
- Dual-screen digitizer tablet by Microsoft: 3 Megapixel camera, compared with One Laptop Per Child XO-2 and MoleSkine. additional references on Courier in file.

[BlackS09a]
(*) Black, Sue; Boca, Paul P., Bowen, Jonathan P.; Gorman, Jason; Hinchey, Mike "Formal versus Agile: survival of the Fittest?", ICCC Computer, September 2009, pp. 37-ff
- Review of Agile versus Formal development: refers to writing tests before implementation in Agile development. Numerous references, argues that formal proof of correctness and automatic test generation more valuable

[BostonGlobe08a]
(*) Boston Globe "Tech Development: Taking creepy out of proximity sensing", The Boston Globe, Monday, June 9, 2008, page B6
- Electrostatic digitizer proximity sensing in a picture frame: Synaptics.com

[BostonGlobe08b]
(*) Boston Globe "Tech Development: HP joins the campaign against keyboards", The Boston Globe, Monday, June 16, 2008, page B6
- HP TouchSmart display, with integrated touchscreen. Comparison made to One Laptop Per Child PC design with no keyboard, instead second screen which can display a keyboard: compare with Refalo, Microsoft Courier.

[Brown09a]
(*) Brown University "Brown University - Microsoft Center for Research on Pen-Centric Computing: What is Pen Computing?", graphics.cs.brown.edu, 2009: fetched 2011
- Final web page for Microsoft Center for Research on Pen-Centric Computing at Brown University: three-year funding for research on applications for Microsoft Tablet PC operating system and tablet hardware: ChemPad, MathPad (mathematical notation) Music Notepad, Math Paper, Lineogrammer. Some work listed (SKETCH) pre-dates Tablet PC, dates to 1999.

[BrownSF08a]
(*) Brown, Stuart F. "Hand-on computing: Multi-touch screens could improve collaboration without a mouse or keyboard", Scientific American, July 2008, Vol 229 No 1, pp. 64-67
- Jeff Han, Perceptive Pixel. Frustrated total internal reflection FTIR. Optical panel is both sensing surface and diffusion screen for rear projection. Also mentions Microsoft Surface, Mitsubishi Diamond Touch, and iPhone.

[BuckleyE09a]
(*) Buckley, Edward; Lacoste, Lilian; and Stindt, Dominik "Rear-View Virtual Image Displays", 2009 SID Vehicles and Photons Conference, 16th Annual Symposium on Vehicle Displays
- Holographic 3-D three dimensional projection on windshield of automobile. see Light Blue Optics file.

[BuckleyE09b] (*) Buckley, Edward; Stindt, Dominik; and Isele, Robert "Novel Human-Machine Interface (HMI) Design Enabled by Holographic Laser Projection", 2009 SID Symposium: pre-distorted projected image shown on curved surface to appear undistorted
Holographic 3-D three dimensional projection on windshield of automobile

[BuckleyE10a] (*) Buckley, Edward "A Projector of a Different Color", IEEE Spectrum, May 2010, p. 45

Holographic (portable) projector projects display and simulated/virtual keyboard onto table-top, senses touchscreen surface by fan of low-power infrared laster light superimposed on projected image and infrared sensors that detect scattering.

[BuxtonW09a] (*) Buxton, William "Chapter 14: Gesture Based Interaction / Haptic Input", www.billbuxton.com, dated 18 May, 2009

Book chapter in progress. Gesture recognition used broadly for natual gestures, gestures with the hands in free space.

[BuxtonW10a] (*) Buxton, William "A chat with Microsoft Principal Researcher Bill Buxton", The Globe and Mail, Toronto, Canada, August 23, 2010 (theglobeandmail.com)

Historical interview with Bill Buxton concerning user interfaces, multi-touch, portable computing. Oscar winner (2003). multi-touch user intefface inveted in 1984. Casio wrist-watch with touch-screen in 1984: unistroke single-digits and arithmetic symbols for caclulator funcs. IBM Simon in 1993, precursor to iPhone. Non-contact (touch sensors) interfaces in 1982.

[BuxtonB10b] (*) Buxton, William "Invited Paper: A Touching Story: A Personal Perspective on the History of Touch Interfaces Past and Future", Society for Information Display (SID) Symposium Digest of Technical Papers, May 2010, Vol. 41(1) Session 31, pp. 444-448

Touchscreens, like all new technologies go far back: Plato in 1960s, soft-machines, Casio PF-8000 Data bank, IBM Simon, Multidimensional (X/Y/Z force, X/Y/Z torque) touchscreeend .

[CannyJ10a] (*) Canny, John and Hartmann, Bjoern " Seminar Notes, COMPSCI 298-50, Univ. Berkeley, California, September 2010

IBM Simon 1994, Osborne I luggable computer 1981, Grid Comppass laptop, PARCTAB hand-held ubiquitous computing unit 1989/1992, Palm PDA with Unistroke Graffiti

[CasioCalculatorWatch10a] (*) Casio Calculator Watch "Vintage Casio TC-600 Touch Screen Calculator Retro LCD wristwatch", casiocalculatorwatch.net, fetched 2010

Casio wristwatch with unistroke character input on touchscreen, circa 1984

[CechanowiczJ09a] (*) Cechanowicz, Jared and Gutwin, Carl "What is Pen-Centric Computing?", Proc. INTERACT 2009, pp. 878-891

Addition of pressure sensors, Contrast of WIMP user interfaces with other numerous non-shape-recognition-based gestures: shift-click, double-click, timed gestures hover-help and spring-loaded folders.

[CenterForPenCentric08] (*) Center for Research on Pen-Centric Computing, (Microsoft) "What is Pen-Centric Computing?", pen.cs.brown.edu

Microsoft funding of graphics research group under Andries van Dam at Brown University. Projects as of 2008 include MathPaper two-dimensional mathematics input and gesture/direct manipulation, Lineogrammer sketch recognition / diagram editing, *Pad SDK ink middleware experimental pen-computing UI kit, ChemPad for teaching chemistry and molecular models, MathPad, Music Notepad with twho-dimensional gesture input, Fluid Inking for gesture editing of electronic ink (compare with Van Raamsdonk?), ReMarkable Texts digital note-taking. Devices include pen computers (Tablet PCs), PDAs, electronic whiteboards.

[ChanK07a] (*) Chan, Kee-Yip Kitagawa, Kelly; and Manduchi, Roberto "Experiments in Planar Haptic Contour Exploration", Proc. WHC 07, 2nd Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems, pp. 604-606

2-D haptic Wingman Mouse from Logitech (out of production), using Immersion TouchSense API to simulate edges of polygon: notes that adding sound feedback helps. Difficult for users however to recognizie (form mental map) of the polygon's shape: should compare with teaching orientation to the newly blind at the Carroll Center?

[ChangD08a] (*) Change, Darius "Asus takes user interface to the next level", crave.cnet.net, June 5, 2008

Dual-display computer (compare with Refalo, OLPC One Laptop Per Child) with display on one half, display/touchscreen on other half. Also reads gestures by motion using video camera.

[ChaudhriI10] (*) Chaudhri, Imruan; Ording, Bas; Anzures, Freey Allen; Van Os, Marcel; Lemay, Stephoen O.; Forstall, Scott; and Christie, Greg "Unlocking a Device by Performing Gestures on an Unlock Image", United States Patent 7,657,849, Feb. 2, 2010

Sliding/swipe unlock gesture on Apple iPad and iPhone

[ChristianDopplerLaboratory10a] (*) Christian Doppler Laboratory, for Handheld Augmented Reality "History of Mobile Augmented Reality", wordpress.com, fetched November 23, 2010

Timeline of mobile augmented reality and non-mobile augmented reality systems, defined as overlaying computer data on real world. Sutherland head-mounted display with 6-D sensors 1968. Cites Grid Compass 1000 as first clamshell laptop: compare with Data General DG/1? IBM Simon Personal Communicator 1992. Loomis GPS system for visually impaired 1993.

[CITT08] (*) CITT Center for Instructional Technology and Training, University of Florida "Tablet PC Workshop", www.citt.ufl.edu/training/manuals/TabletPC.pdf, fetched 2008/03/03

Training manual for Tablet PCs, (physical) power button action can be changed

[CoE08] (*) Co, Elise and Pshenkov, Nikita "Emerging Display Technologies for Organic User Interfaces", Communications of the ACM, June 2008, Vol 51 No 6; pp 45-ff.

Organic user interfaces / tangible user interfaces: E-Ink / electronic ink electrophoretic display technology, electroluminescent displays on clothing fabric.

[CohenP08a] (*) Cohen, Phil; Swindells, Colin; Oviatt, Sharon; and Authur, Alex "A high-performance dual-wizard infrastructure for designing speech, pen, and multimodal interfaces", Proc. ICMI '08, 10th I'tal Conf. on Multimodal Interfaces

Wizard-of-oz (two people) simulation of system reacting to group whiteboard utilizing both voice and real-time electronic ink/pen input streams. Compare with Freestyle at Wang.

[CooestGadgets08a] (*) Coolest Gadgets - Apple News "Apple files for 'swipe-gesture' patent application", www.coolest-gadgets.com, Dec. 26, 2008

Patent application publication of Apple filing for 'swipe-gesture': article refers to left, right, up, down gestures across the (simulated) keys of a keypad -- compare with 1980's Japenese calculator with handwriting input on physical keypad?

[Crunchpad09] (*) CrunchPad "CrunchPad photos leaked: Arrington builds dream tablet", Jennifer Bergin, blogs.zdnet.com, April 10, 2009

Web-only pen-computing web-tablet with no disk storage. Announced as an "open-source" hardware design, running Ubuntu Linux. File contains additional materials.

[CSAIL08a] (*) CSAIL "MIT CSAIL: Design Rational", rationale.csail.mit.edu, 2008

List of research reports and publications, mostly relating to sketch recognition

[Cypress08] (*) Cypress Inc. "TrueTouch touchscreen technology", www.cypress.co, Aug 25. 2008

Multi-touch touchscreen using projected capacitive technology (electrostatic?). Includes comparison chart for touchscreen technologies: Infrared, Surface-Acoustic-Wave (SAW), Surface Capacitance, Resistive

[DeckerS09] (*) Decker, Susan "Microsoft Wins Reversal of $358 Million Alcatel Award (Update4)", Boomberg News: www.bloomberg.com Sept. 11, 2009

Partial reversal (basis for damages) in Lucent-Microsoft case: only mentions Date-Picker UI, not GO Corporation damages

[DeNardiA08a] (*) De Nardi, Alessandro "GRAFITI: Gesture Recognition mAnagement Framework for Interactive Tablettop interfaces", Master Degree Thesis, Niversita di Pisa, December 2008

Experimental multi-touch system (Rear Diffusion optical detection: rear DI) incorporating Z-order gestures by tunneling and bubbling (for overlapping objects). Refers to larger target area as "iceberg tips" of object. Gestures are simple, single-stroke, and few (touch, drag, etc. except for double-tap) to avoid recognition ambiguity. Discusses dynamic gestures (e.g. pinch/zoom) which are detected and interpreted progressively, and statis gestures (e.g. tap) which have no interpretation phase

File contains additional material on open-source code.

Not to be confused with Graffiti unistroke handwriting

[DenningRA08] (*) Denning, Roger A. "Roger A. Denning, Attorney", www.fr.com

Trial lawyer in Lucent/Microsoft involving pen-computing gestures

[DerStandard10a] (*) Der Standard "Toshiba bringt Dual-Screen-Tablet Libretto W100", Der Standard, derstandard.at, June 21, 2010

Dual-screen multitouch portablet computer with virtual keyboard, compare with Microsoft Courier and with Refalo, and with proposed design by Negroponte's project

[DiamondTouch08a] (*) DiamondTouch, Inc. "DiamondTouch", (various)

File on Diamond Touch, spin-off company for DiamondTouch multi-touch digitizer table developed at Mitsubishi, comparable to Microsoft Surface

[DignanL10a] (*) Dignan, Larry "Apple's HTC patent suit: Can it derail Google's Android devices?", zdnet.com, March 2, 2010

Apple iPhone patents asserted against HTC/Android and Nokia

[DignanL10b] (*) Dignan, Larry "Apple's HTC patent suit: Can it derail Google's Android devices?", zdnet.com, May 7, 2010

Apple iPhone patents asserted against HTC/Android and Nokia: antenna design, geographical positioning

[DignanL10c] (*) Dignan, Larry "Nokia and Microsoft's Windows Phone 7: It could work, but why stop there?", zdnet.com, December 20, 2010

Nokia sell Windows Hpone 7 instead of Symbian.

[EchtlerF10a] (*) Echtler, Florian; Klinker, Gudrun; and Butz, Andreas "Fieatures, Regions, Gestures: Components of a Generic Gesture Recognition Engine", SIGCHI Workshop: Engineering Patterns for Multi-touch Interfaces, June 20, 2010, Berlin, Germany

Recognize multi-touch gestures based on shared features: move/tap/rotate/spin gestures recognized on features motion/blobcount/rotation/scale. Focuses more on direct manipulation gestures. Describes event bubbling through parent windows for gestures.

[Economist08a] (*) Economist Magazine "Touching the Future: Computing: Touch screens are becoming an increasingly popular way to control mobile phone and other devices", The Economist Magazine, September 4, 2008

Article on touch screens, and multi-touch gestures. Cites Elo TouchSystems and Sam Hurst as first touchscreen (resistive tablet) in 1971 (missed earlier references). Quotes Bill Buxton on haptic design. Jeff Han of Perceptive Pixel on pressure-sensitive gestures, push harder to move something "under" another window instead of double-click operation.

[E-Ink08a] (*) E-Ink Corporation "Wacom and E-Ink Partnership Delivers Pen Input to Electronic Paper Displays", Press Release, Wacom Technology, May 19, 2008

Touchscreen / integrated display and digitizer tablet from Wacom and E-Ink.

[eInstruction09] (*) eInstruction.com "eInstruction Interwrite DualBoard", eInstruction.com product literature

Large whiteboard digitizer using projector, multiple small untethered electromagnetic tablets for other participants in a group: see KayeS. Interwrite DualBoard for Windows and Mac, Interwrite Mobi small wireless digitizer. See also Qomo HitVision RF wireless tablets.

[ElanMicroelectronics10] (*) Elan Microelectronic Corporation "Elan Microelectronics Corporation", Elan Microelectronics, product information

Electrostatic digitizer / capacitive touchpad vendor

[ElektronikIndustrie10a] (*) Elektronik Industrie "Der etwas andere touch", Elektronik Industrie, 10/22/2006, pp. 22-23

in German: overview article on capacitive touchscreens using ITO Indium Tin Oxide, based on Quantum Research Group (commercial company)

[emsps.com10a] (*) emsps.com "Old, Used and Out-of-Print SideKick(R) Software", www.emsps.com/olktools/borsk.htm

Borland SideKick with phone dialer, PIM: Versionn 1.0 through 20.0, 97 through 99, for DOS, Windows and MAC

[EMSSoftware08] (*) EMS Software "Lotus 1-2-3 Version Information", www.oldsoftwareinfo.com

Version information for Lotus 123 versions: www.oldsoftwareinfo.com sells and collects old versions of software in original form. Lotus 123 for DOS only through 2.2X 1991, first Windows version 1.0 for Windows 9991, first MacIntosh version 1.0 1991, OS/2 version 2.0X, 1993.

[EoffBD09a] (*) Eoff, Brian David and Hammond, Tracy "Who Dotted That `i'? : Context Free User Differentiation through Pressure and Tilt Pen Data", Proc. Graphics Interface Conf, May 2009, Kelowna B.C. Canada

In multi-touch / multi-pen / multi-user desktop with tablet or touch input, identify user inputs by physical characteristics of writing, rather than constraining users to keep track of which pen to use: pen tilt, pressure (force), and writing speed

[EsslG09a] (*) Essle, Georg; rohs, Michael; Kratz, Sven "Squeezing the Sandwich: A Mobile Pressure-Sensitive Two-sided Multi-touch Prototype", Proc. UIST '09, October 2009, Victoria BC, Canada

Two-sided (front/back) touchscreen/touchpad interfaces. Prototype built by taping two iPhones together. Citations to Chen, Hybridtouch, Lucid Touch, and Shape touch.

[FlemingN10a] (*) Fleming, Nic "Magnet magic puts phone control in the air", New Scientis, 23 February 2010

Hand-gesture input using hand-held magnet and magnetic compass sensor in an iPhone or portable device

[FingerSystem10a] (*) Finger System USA "i-Pen Mouse product information", www.fingersystemusa.com, fetched 2010

Optical mouse in a pen-shapped barrel. Newer model includes audio recording: compare with LiveScribe and Plawa.

[FoleyMJ10a] (*) Foley, Mary Jo "Microsoft's RearType: Physical keys to the iPad, Kindle and Tablet kingdoms?", www.zdnet.com, August 9, 2010

UI alternative to soft/simulated keyboard on touch-screen/pen computer: physical keys for separate hands on back of tablet-type computer.

[FrankeK09a] (*) Franke, Katrin "Capturing Reliable Data for Computer-based Forensic Handwriting Analysis II: Pen-position Activations", 2009 10th International Conference on Document Analysis and Recognition

Pointing out unreliability of data from (electromagnetic) digitizer tablets, even though really only talks about stylus tilt error. One of few papers from handwriting motion analysis that shows insights into some of the problems with digitizer reliability and bad behaviors. Describes morphing of on-line and off-line traces/markings -- compare with Tappert elastic matching?

[FranczekEJ99a] (*) Franczek, Edward J; Bretscher, John Thomas; and Bennett, Ramond Walden III "Computer Virus Screening Methods and Systems", United States Patent 5,987,610, November 16, 1999

Scan data sent between two parties on telephone lines for a virus and block part of the data from being transmitted. Executing program that would be transmitted in a model of the receiving computer to detect virus before transmitting data.

[Fraunhofer08] (*) Fraunhofer Institut "Computer steuern per Fingerzeig / Gesture-driven computers", Fraunhofer Institute Press Release for CeBIT 2008 exhibition, February 2008

(in German) GestureID hand gestures, demonstrated at CeBIT exhibition for iPoint Presenter. Mentioned as replacement for touch-screen digitizers at infoterminals (kiosks). Uses optical pattern recognition (machine vision)

[FriedI08a] (*) Fried, Ina "Microsoft to add multitouch interface to Windows 7", news.cnet.com, May 27, 2008

Windows 7 Vista will include multitouch, compares with Apple iPod user interface. Shown by Steve Ballmer and Bill Gates at trade show. Gestures include pinching (zoom) and two-finger rotating.

[FriedI08b] (*) Fried, Ina "Microsoft hopes 'Milan' table PC has magic touch", news.cnet.com, May 29, 2008

Milan code name for "surface computer", Microsoft Surface tabletop PC, using multi-touch input.

[FriedI09a] (*) Fried, Ina "Touch in Windows 7: Just for show?", news.cnet.com, July 1, 2009

Touch/multi-touch interface in Windows 7 just for show, because touchscreen digitizer hardware adds $100 to price of PC. N-Trig dual-mode digitizer (electrostatic+electromagnetic?) has funding from Microsoft

[Fujitsu10a] (*) Fujitsu America, Inc. "Lifebook Tablet PC. Stay in Touch", Fujitsu America, Inc.

Product information on Lifebook T900 Tablet PC, convertible with multi-touch separate display

[Ganapati10] (*) Ganapati, Priya "3-D Tabletop Display Gets Rid of the Glasses", Wired.com, March 25, 2010

Simulated 3-D display: each side of a cube has an LCD display showing a side/top view of something simulated to be inside

[GestureTek08a] (*) GestureTek "GestPoint Gesture Recognition for Presentation Systems", www.gesturetek.com

Hand-gesture recognition using video input and motion tracking: commercial product. Described as touch-free gesture input utilizing computer vision and body tracking software to convert simple hand movements into direct mouse control.

[Gizmodo09a] (*) Gizmodo.com "Que: Plastic Logic's Capacitive-Touch Ebook Reader", Gizmodo.com, November 2009: reporter Wilson Rothman

Wacom technology (?) capacitive/electrostatic digitizer in an e-book reader, but says being marketed as a "document reader", not a "book reader". See also file on "Plastic Logic".

[Gizmodo10a] (*) Gizmodo.com "First Hands On: Touch Book is Part-Netbook, Part-Tablet", Gizmodo.com, Arpil 13, 2010

Touch Book web tablet / tablet computer: Linux, circular-icon gesture UI (pie gestures?)

[GoldsteinN10a] (*) Goldstein, Neal and Bove, Tony "iPad Application Development for Dummies", Wiley Publishing, 2010

Programming tutorial for the iPad/iPhone/iPod.

[Google08a] (*) Google Code "iphone-haptics", code.google.com/p0/iphone-haptics, 2008

VibeTonz and vibrotactile haptic feedback project for Apple iPhone, Stephen Brewster Tacton project at U. Glasgow

[Google08b] (*) Unknown "google chrome", drewp.quickwitretort.com/2008/09/22

Search hits highlighted in Google Chrome scrollbar UI/user-interface: references to work by David McClosy, and Raizlabs ABC and Heatmap

[GonsalvesA09] (*) Gonsalves, Antone "Barnes and Nobel Sued over E-Reader", Information Week, November 3, 2009

E-Reader maker Spring Design (kindle-like product) sues Barnes and Nobel over using features of Alex e-reader from confidential product technical discussions

[Greene08a] (*) Greene, Kate "What's Next for Computer Interfaces? Touch tricks for small and large displays could be the next big thing", Technology Review, December 11, 2008

Microsoft research Patrick Baudisch adding touch digitizer interaction to back of devices so that display is not obscured by finger or stylus

[Greene09a] (*) Greene, Kate "A Better, Cheaper Multitouch Interface: A new pressure-sensistive pad could improve large and small touch schreens", Technology Review, March 30, 2009

Three-dimensional pressure sensitive touch digitizer: IMPAD Inexpensive Multi-touch Pressure Acquisition Device, using force sensitive resistor (IFSR) ink, Ilya Rosenberg, www.touchco.com

[Greene09b] (*) Greene, Kate "Touching the Future: Next steps for touch screens", Technology Review, February, 2009 p. 13

Patrick Baudisch of Microsoft: touch pad on back of display, so that small screen remains unobstructed. Also mentions Perceptive Pixel

[Greene09c] (*) Greene, Kate "Muscle-Bound Computer Interface: Forearm electrodes could enable new forms of hands-free computer interaction", Technology Review, October 28, 2009

electromyography sensors in arm used to recognize hand/arm gestures, such as Air Guitar, etc. Recognition by neural network.

[HamppA08] (*) Hampp, Andrew "Airports, Malls Get More 'Gesture' Ads: Interactive Video-Out-of-Home Ads let Consumers Play", Advertising Age, May 8, 2008

Press article on Reactrix, Monster Media, and GestureTek on gesture input on interactive advertizing: foot-pressture touch pad with foot input

[Hanselman08] (*) Hanselman, ?? "Introducing RockScroll", Microsoft employee blog posting: www.hanselman.com/blog, October 2008

Scroll bar displays highlighted/small images of text/document to be scrolled: add-on to Microsoft Visual Studio by Rocky Down's

[HarrisonC08a] (*) Harrison, Chris and Hudson, Scott E. "Pseudo-3D video Conferencing wiht a Generic Webcam", Proc. 10th IEEE Int'l Symposium on Multimedia, Berkeley, CA, Dec 15-17, 2008. pp. 236-241

Simulated 3-D video using flat display: perform trapezoidal scaling of image as viewer moves left and right (and up and down?) as detected by Webcam camera.

[HarrisonC08b] (*) Harrison, Chris and Hudson, Scott E. "Scratch Input: Creating Large, Inexpensive, Unpowered and Mobile Finger Input Surfaces", Proc. UIST 08, October 19-22, 2008, Monterey, CA, pp 205-208

Gesture recognition not using a digitizer, but the acoustic sound of scratching when a finger/fingernail moves on a surface. Cannot detect sptial location, but recognizes multi-part (multi-stroke) gestures such as X, O-with-slash, lowercase-I-with-dot, Y, double tap, single tap. Cites to earlier work on passive acoustic sensing (knocks) and frustrated-internal-reflection digitizer tablets

[HarrisonC09a] (*) Harrison, Chris and Hudson, Scott E. "Abracadabra: Wireless, High-Precision, and Unpowered Finger Input for Very Small Mobile Devices", UIST '09, October 4-7, 20009, Victoria BC, Canada

Proximity-sensing electromagnetic digitizer for finger input on small display, using small magnet mounted on fingertip. Compare with ferrite-rod digitizer technologies? Can detect clicking "below" a virtual surface by reversal of magnetic field, can detect distance/proximity by strength of magnetic field sensed. Describes polar gestures (circular motion around a very small display)

[HarrisonC10a] (*) Harrison, Chris; Tan, Desney; and Morris, Dan "Skinput: Appropriating the Body as an Input Surface", CHI 2010, April 10-15, 2010, Atlanta, Georgia

Surface (?) acoustic wave design of touch input device comprising an arm band and propagating acoustic signals through human skin: a wearable SAW touch input digitizer. Also refers to distinctive sounds made when tapping on parts of body: arm, palm fingers and thumb.

File contains additional materials

[HarrisonC10b] (*) Harrison, Chris; Tan, Desney; and Morris, Dan "Search by Sketch", www.chrisharrison.net

Project description: Compare with earlier work on sketch recognition: use uses paint interface (not draw/sketch) to draw color patterns, system matches by dominant color and rough orientiation, providing results in real time while user is "sketching".

[HarrisonC10c] (*) Harrison, Chris and Hudson, Scott E. "Minput: Enabling Interaction on Small Mobile Devices with High-Precision, Low-Cost, Multipoint Optical Tracking", CHI 2010, April 10-15, 2010, Atlanta GA

Optical-mouse type input built into portable device (basically on back of display). Thus display is not occuluded by finger or touching, no digitizer on display. Gesture recognition for flick, twist, curly-cue gesture. Can also scan a larger surface, thus can do scroll-bar gestures.

[HarrisonP08a] (*) Harrison, Phil "Hand-held Device with Touchscreen and Digital Tactile Pixels", United States Patent Application 2008/0150911, June 26, 2008

Haptic/tactile vibration pixels around edges of touchscreen PDA computer

[HartmannC08a] (*) Hartmann, Christoph "Microsoft Visual Programming Language: End-User Perspektive", Mongraph, www.acidum.de, Aug 11, 2008 (in German)

Microsoft Robotics Studio 2006, Microsoft Visual Programming Language: Review of visual programming languages and environments: cites to Sketchpad 1963, GRAIL 1967, AMBIT/G 1968, ThingLab and other earliy systems.

[HaywardP08a] (*) Hayward, Vincent; Alarcon, Ramon; Rosenberg, Louis B. "Haptic Pads for use with User-Interface Devices", United States Patent 7,336,266, February 26, 2008

Add a haptic output actuator to an existing input devices. Generic to type of input device, and to type of haptic actuator.

[Helet09] (*) Helet, Miguel "For the Blind, Technology Does What a Guide Dog Can't", The New York Times, January 4, 2009

T.V. Raman, visually impaired researcher at Google, accessibility technology for low-vision on touchscreen cell phones (e.g. Apple IPhone) using Gestures

[HembrowD10a] (*) Hembrow, David "EO Personal Communicators EO440 / EO880 running GO PenPoint", www.hembrow.eu, fetched 2010

Personal notes on EO/PenPoint in the UK, including examples of documentation and product.

[HewlettPackard08] (*) Hewlett-Packard "HP Pavilion tx2z series", www.shopping.hp.com/series/category/notebooks/tx2z_series

TouchSmart 2x2z ulgraportable Tablet PC: multi-touch input, implies support for multi-touch gestures on laptop running Windows Vista

[HinckleyK09a] (*) Hinckley, Ken; Dixon, Morgan; Sarin; Raman; Guimbretiere, Francois; and Balakrishnan, Ravin "Codex: A Dual Screen Tablet Computer", Proc CHI 2009, April 4-9, 2009, Boston, MA

Dual-screen dual-display/dual-touchscreen tablet, 4x6 inch. Compare with Courier and Refalo. Software based on InkSeine note-taking with "floating tool ring" (marking-menu?). Multiple references to other current dual screen computers. Taxonomy of dual-screen "postures": landscape/portrit, book/lecturn/laptop, corner-to-corner/face-to-face, battleship (opposite directions). Dual displays can be detached. Collaborative use. Dual-display use includes webpage next to notebook page.

[HinckleyK10a] (*) Hinckley, Ken; Pahud, Michel; and Buxton, Bill "Direct Display Interaction via Simultaneous Pen + Multi-Touch Input", Society for Information Display (SID) Symposium Digest of technical Papers, May 2010, Vol 41(1), Session 38, pp. 537-540

Using pen and touch gestures simultaneously, users perform different actions with the two hands -- dominant hand holds pen/stylus for writing. Cites to earlier work on two-handed/multi-touch user interfaces.

[HolmanD08] (*) Holman, David and Vertegaal, Roel "Organic User Interfaces: Designing Computers in Any Way, Shape, Or Form. Displays on real-world objects allow more realistic user interfaces", Communications of the ACM, June 2008, Vol 51 No 6; pp 48-ff.

Organic user interfaces / tangible user interfaces: deformable user-input devices, such as foldable paper which is also a display, and responds to folding. Shows multiple-touch, multiple-user actions on a globe model, cites to Wellner.

[HOPL08] (*) HOPL History of Programing Languages "Maths input language", hopl.murdoch.edu.au

History of two-dimensional mathemathics input languages as programming languages: essentially a short bibliography of papers by Mort. I Bernstein, quotes as saying that real-time / online handwriting recognition is easier than static / OCR character recognition.

[HorneckerE09a] (*) Hornecker, Eva "Tangible interaction", Interaction-Design.org: http://www.interaction-design.org/encyclopedia/tangible_interaction.html, 2009

Essay defining tangible interaction as distinct from direct manipulation in user interfaces: physical objects interact with users under computer control: numerous references to background of the art. See also augmented reality.

[HorowitzBT08a] (*) Horowitz, Brian T. "Synaptics touch pad tech gains momentum", blog.internetnews.com/bhorowitz, June 26, 2008

Scrolling momentum / dynamic scrolling by Synaptics in a touchpad digitizer, compared to trackball that keeps spining after initial push

[HP08a] (*) Hewlett-Packard "HP TouchSmart IQ506/IQ504 PC", (various)

File of product information on HP TouchSmart PC, Windows PC with integrated multitouch touchscreen. Used for kiosk applications.

[HuppiB09a] (*) Huppi, Brian; Fadell; Anthony M.; Barrentine, Derek; and Freeman, Daniel "Automated Response to and Sensing of User Activity in Portable Devices", United States Patent 7,633,076

Motion and/or position sensor in portable cell phone, PDA or hand-held unit to detect user activity: motion / orientation sensor on handheld tablet device? iPhone/iPad

[Immersion08] (*) Immersion Corporation "MicroScribe Systems: Solutions fo Inspection, Reverse-engineering, and 3D Digitizing", www.immersion.com

Mechanical digitizers using multiple-link mechanical arms, articulated-arm digitizers and portable CMMs. Intended for three-dimensionsal / 3D digitizing of engineering objects. Applications also include medical and surgical simulators : digitizers with haptic feedback under the product name CyberForce. Several citations to studies of touchscreens with and without tactile/haptic feedback, and VibeTonz auditory/haptic components for hand-held devices (cell phones, PDAs, etc.)

[Immersion10b] (*) Immersion Corporation "The Value of Haptics: A summary of published findings on the value of haptic feedback in human-computer interaction", Immersion Corporation, San Jose, California, 2010

Haptic: Tactile Feedback, Multi-modal feedback, non-visual interaction. General explanation of haptic terms.

[IOGEAR08a] (*) IOGEAR "IOGEAR Digital Scribe", iogear.com

Acoustic/sonic digitizer, single acoustic receiver that mounts on corner or top of paper (or other surface) and transmitter stylus/pen with optional ink cartridge. GPEN100C, Applications include note taking (Microsoft OneNote, IRISnotes, etc.) and handwriting recognition (MyScript). Revice may also be used as stylus or in mouse-input mode with side button on stylue barrel.

File contains additional references

[IOGEAR10a] (*) IOGEAR "IRISPen executve 6 User's guide", iogear.com

hand-held optical scanner, includes OCR software for text and for handwriting recogition (static/off-line character recogition), bar-code recognition. IRISPen translator 6 for translating text in other languages, including Chinese. Includes speech synthesis for recognized text -- useful as accessibility technology?

File contains additional references. See also IRIS file.

[IRIS10a] (*) I.R.I.S. "Readiris 12 Pro", Irislink.com, fetched 2010

OCR software for IRISpen and other scanner devices. IRISnotes software for IOGEAR acoustic stylus digitizer tablet: compared with products requiring special paper (Anoto) and optical digitizer. See also IOGEAR file.

[Independent09a] (*) The Independent, United Kingdom "Why touch screens push our buttons", The Independent, 9 September 2009

Mostly interview with Chris Harrison and Bill Buxton regarding multi-touch input and touchscreens: mentions Casio touch-screen AT-550 wristwatch in 1980, Lemur touch-surface music controller in 2003 (see reference) quotes Bill Buxton on touchscreens being unusable by blind/visually impaired (compare with iPhone VoiceOver?) Chris Harrison latex touch-surface covering.

[iPad00] (*) iPad "iPad file information", Misc

Miscellaneous iPad information

[IraniP10a] . Irani, Pourang; Shi, Kang; Cechanowicz, Jare; and Subramian, Sriram "Pressure Agumented Mouse", United States Published Patent Application 20100127983, May 27, 2010

Mouse with additional pressure sensors: references contrast with WIMP interfaces

[iRexTechnologies09] (*) iRex Technologies BV "iRex Technologies Turns the Page on eReaders with new 8.1-inch Consumer Device", iRex Technologies BV, Press Release Sep. 23, 2009

iRex Technologies e-book reader: marketed with additional applications (compare with PenPoint from GO): uses Wacom capacitive/electrostatic touch digitizer tablet component. Additional materials in file.

[IshiiH08a] (*) Ishii, Hiroshi "The Tangible User Interface and Its Evolution", CACM, June 2008, Vol 51 No 6, pp. 32-36

Special issue on organic/graspable/haptic/tangible user interfaces. Deformable/rollable input devices, such as recognizing shadows of physical stick figures or clay models.

[Janam08a] (*) Janam Technologgies LLC "Janam XP30 User Guide", Janam Technologies LLC, 2008

Janam XP30 touchscreen/digitizer smart phone: Uses Graffiti 2 gestures: backspace, shift, menu (diagonal) Shortcut (bottom curlique, cut (pig-tail), passted, copy (down-left), undo

[JazzMutant09a] (*) JazzMutant.com "Lemur: Schliessen Sie Ihren Lemur an", www.jazzmutant.com

MIDI controller/GUI software toolkit for touch gestures specific to controlling music and audio systems

[JazzMutant09b] (*) JazzMutant.com "Lemur V2.0 User Guide", www.jazzmutant.com

MIDI controller/GUI software toolkit for touch gestures specific to controlling music and audio systems

[JazzMutant09c] (*) JazzMutant.com "Behind the Lemur", www.jazzmutant.com

multi-touch digitizer capable of handling an unlimited number of fingers at once: genesis of the device was that the developers designed a user interface assuming such a device was available.

[JobsSP09a] (*) Jobs, Steve P. et al "Touch Screen Device, Method, and Graphical User Interface for Determining Commands by applying Heuristics", United States Patent 7,479,949 B2, Jan 20, 2009

Gesture (multi-touch gesture) recognition by heuristics, Numerous other iPad/iPhone gesture patents incorporated by reference. Specific to finger contacts / touchscreens, not other stylus digitizer input. Very large spec (362 pages), shows slide-to-unlock.

[JoguetP07a] (*) Joguet, Pascal and Largillier, Guillaume "Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen", United States Patent Application US 2007/0198926, August 23, 2007 (See also PCT /FR2005/00428)

Multi-touch tablet (of any type: multi-contact bidirectional sensor matrix), software to implement sliders, keyboards, potentiometers, and other controls with visual feedback (visual return) of direct manipulation of controls for musical instruments with real-time control and input. Refers to point clouds for multi-touch capactive touchpad.

[JonesR09a] (*) Jones, Randy; Driessen, Peter; Schloss, Andrew; and Tzanetakis, George "A Force-Sensitive Surface for Intimate Control", Proc. NIME09, June 3-6, 2009, Pittsburgh, USA

Madronalabs.com Madrona Soundplane: force/pressure sensing X/Y touchsurface, intended as controller for electronic musical instruments. Multi-touch sensing. Cites to earlier devices.

[KarlsonAK08a] (*) Karlson, Amy K. and Bederson, Benjamin B. "One-Handed Touchscreen Input for Legacy Applications", Proc. CHI 2008 April 5-10, 2008, Florence Italy, pp. 1399-1408

For one-handed PDA use, user defines a ThumbSpace -- the area reachable by the thumb while holding the PDA in one hand. Show thumbnail (sic) image of whole screen in ThumbSpace for user to pick from on whole touchscreen. Refers to whole screen touching as DirectTouch.

[KlimovsV09a] (*) Klimovs, Vjaceslavs and Pisarenko, Sergejs "Towards enhancing perceived performance through adoption of proposed benchmarking techniques", Report 2009-029, University of Gothenburg, Germany, 2009

Report on perceived versus actual performance in user interactions: mentions "kinetic scrolling" and "two-way scrolling"

[KrempM08a] (*) Kremp, Matthias "Microsoft bittet zu Tisch", Spiegel news magazine (in German), January 10, 2008. www.spiegel.de

Report from Consumer Electronics Show on Microsoft digital table / surface table touch digitizer, with direct manipulation of photographs. References to iPhone interface. Digitizer touch sensing limit is 52 touch points: four players, 10 fingers plus 3 playing figures each. Compare with Wang Freestyle for graphical manipulation?

[KrempM08b] (*) Kremp, Matthias "Windows 7 bekommt iPhone-Interface", Spiegel news magazine (in German), May 28,2008. www.spiegel.de

Report on Microsoft Windows 7 touch-UI interface. Also mentions digital table / surface table touch digitizer, with direct manipulation of photographs. Points out awkward positioning of touch screens at a desk, compares with keyboardless one-laptop-per-child touch system.

[KrempM10a] (*) Kremp, Matthias "Nokias letztes Aufgebot: Smartphone N8", Spiegel news magazine (in German), October 20, 2010 www.spiegel.de

Nokia N8 cellphone with touch-screen interface, runs videos (Linux OS?) and GPS Ovi Maps no charge.

[KroekerKL09] (*) Kroeker, Kirk L. "Electronic Paper's Next Chapter", Communications of the ACM, Vol 52. No 11, November 2009, pp. 15-17

Overview report on E-Ink, Plastic Logic, and other vendors of electronic paper and flexible displays. E-Ink acquired by Prime View International of Taiwan, which manufactures the Kindle. Mentions color displays: no information on tablets or digitizers. Electrophoresis, electrophoretics, electrofluidic technologies.

[KruegerMW09] (*) Krueger, Myron W. "Myron W. Krueger", en.wikipedia.org

Mentions computer input of two-arm gesture holding arms out to sides, recognized optically

[LeeJH10a] (*) Lee, Jae-hoon "Audio/video Device Having a volume Control Function for an External Audio Reproduction Unit by Using Volume Control Buttons of a Remote Controller and Volume Control Method Therefor", United States patent 7,672,470 B2, March 2, 2010

Volume control on (on touchscreen) when an external amplifier/speakers (headset) are plugged in.

[LeeJK10a] (*) Lee, Jong-Kwon; Kim, Sang-Soo; Park, Yong-In; Kim, Chang-Dong; and Hwang, Yong-Kee "In-cell adaptive touch technology for a flexible e-paper display", Solid-State Electronics, Vol 56 (2011), pp. 159-162, available online 18 November 2010

Light-sensitive touch panel with display, photo-sensor arrays integrated into cells of electronic ink paper display. Capacitive coupling to finger to avoid shadowing of light.

[LyY08a] (*) Li, Yang; Klemmer, Scott; and Landay, James A. "Tools for Rapidly Prototyping Mobile Interactions", Chapter XXI in Handbook of Research on User Interface Design and Evaluation for Mobile Technology, National Research Council of Canada, Joanna Lumsden Ed., 2008, pp. 330-345

Prototyping UI design using UIMS with storyboarding, either with paper or with software tools. Prototype with Toshiba Tablet PC (Microsoft) and HP iPAQ Pocket PC with interactive maps.

[LightBlueOptics10a] (*) Light Blue Optics "Light Speed, Light Touch, Light work", www.lightblueoptics.com, fetched 2010

Holographic projector and infrared sensor for creating a "touch screen" on any surface on which an image can be projected.

[LindemannP10a] (*) Lindemann, Patrick "A Short Report on Multi-touch User INterfaces", Dept. of Media Informatics, University of Munich, Germany: wiki.medien.ifi.lmu.de, Fetched 2010

Review of multi-touch gestures. Cites to 2003 for flick gestures (with hand or finger), but does not mention PenPoint/GO. Cites Buxton on multi-key/n-key rollover on a keyboard in 1970's being a form of multi-touch.

[LinuxForDevices10] (*) LinuxForDevices.com "Multi-touch displays support all ten fingers at once", www.LinuxForDevices.com, 2010-02-18

multi-touch digitizer capable of ten fingers concurrent/simultaneous input. PMatrix from Stantum. Resistive touchscreen display. Quotes Jim Meador at Stantum regarding non-proprietary nature of Apple iPad pinch gesture. Compare with JazzMutant.

[Livescribe08] (*) LiveScribe, Inc. "Livescribe: Never Miss A Word (Smartpen)", www.livescribe.com

Voice/handwriting recording using Anoto digital pen and digitizing (tablet) paper. Includes syncronized voice recording built into pen. Touch previous mark, pen plans recorded audio recorded at that time of writing: example is write "define" followed by word, get definition. Uses Anoto technology, see also EchoPen.

[Livescribe08a] (*) Science Daily "Smart Pens Help Blind See", www.sciencedaily.com, May 9, 2008

Voice/handwriting recording using Anoto digital pen and digitizing (tablet) paper. Includes syncronized voice recording. Article / press-release attempts to make accessibility connection to being annotation device for the visually impaired.

[Livescribe10a] (*) Fahlberg, Tim "Livescribe Smartpen: How (and why) to Enlarge audio Dots (+How to Make them Findable for those with Vision Loss] ", www.edlivescribe.com, December 8, 2010

Use Anoto Pen (Livescribe Pulse or Echopen) and printed labels to make audio notes that can be played back by visually impaired/blind user or motor impaired by touching sensor to printed dot. File contains additional references, such as LiveScribe/Anoto Post-it notes. UI for creating notes still requires use of printed paper with control functions. Compare synchronized voice and handwriting of Freestyle with LiveScribe Anoto pen.

[LucentMicrosoft08] (*) Lucent v. Microsoft "Lucent v. Microsoft", Press announcement file

Press articles on Lucent v. Microsoft patent case concerning United States Patent 5,544,295 on tablet PC and gesture-based user interface

[LucentMicrosoft08a] (*) Associated Press: Jessica Mintz "Microsoft to Appeal $367M Patent Ruling", Associated Press, April 4, 2008

Microsoft found to infringe GO patent on using gestures on Tablet PC. Other patents in case concern video compression, forms input, and color management.

[LucentMicrosoft08b] (*) LucentMiccrosoft "Exhibits", Lucent v. Microsoft

Exhibits (technical references)

in Lucent v. Microsoft in San Diego: long list.

[LuckieD10a] (*) Luckie, D. "Newton Hall of Fame", www.msu.edu/~luckie/hallofame.htm

Bios of major personalities in Apple Newton development team: Steve Capps (Finder), Walter Smith (NewtonScript, a.k.a. WallyScript), John Sculley, Michael Tchao ("Apple had been working for years on slate computers that read handwriting"), Stepan Pachkov, Larry Yaeger (Cursive Recognizer)

[LuckieD10b] (*) Luckie, D. "Newton Gallery", www.msu.edu/~luckie/newtgal.htm

Detailed specs on Apple Newton MessagePads, several models,: OS 2.0, 2.0 1.3, and 1.0 released 1993. Associated with Steve Capps.

[Makowski08a] (*) Makowski, Dirk "Windows fuer Pen Computing 1.0", www.winhistory.de, fetched September 6, 2008

Screen shots of Windows for Pen Computing 1.0 on Windows 3.11 from 1992, German-language version. All applications (but not OS) were pen-enabled by means of pen tool "Stiftpalette". Notebook / Notizbook application allowed free-hand electronic ink note-taking. Gestures/Gesting include check-mark to edit text, similar to PenPoint OS. Comparison with Windows for Pen Computing 2.0 on Windows 95, which is described as more of an add-on and less integrated. Shows multiple gestures accepted in text editor: check mark to edit text, space, new line, cut (pigtail), undo (loop), backspace.

[Makowski08b] (*) Makowski, Dirk "Windows XP Tablet PC Edition (Codename "Lonestar"); 2005 edition", www.winhistory.de, fetched September 6, 2008

Screen shots of Windows XP Tablet PC edition, German-language version. Lonestar released in 2002.

[Makowski08c] (*) Makowski, Dirk "Windows Vista", www.winhistory.de, fetched September 6, 2008

Screen shots of Windows Vista, German-language version, 2007. Includes Tablet PC functionality.

[MarriotG09] (*) Marriot, Greg; Bar-Nahum, Guy; and Bollinger, Steve "Touch Pad for Handheld Device", United States Patent 7,495,659, February 24, 2009

Detection of events (gestures?) on a touch-pad and filtering the native coordinates based on those events. Compare with Microtouch, and with Pencept and CIC recognition Macros?

[Microsoft08a] (*) Microsoft Corporation "Integrating Application Gestures", msdn.microsoft.com, ms704819

Windows Vista / Tablet PC: defines gesture as "a glyph that defines the shape traced by the gesture", plus a hotpoint

[Microsoft08b] (*) Microsoft Corporation "Designing for Direct Manipulation", msdn.microsoft.com, ms698539

Tutorial for Tablet PC developers on basic physical differences between stylus/pen interaction with a digitizer, and operation with a mouse. Does not refer to details of mouse/stylus message differece in programming. Tablet resolution in Tablet PC is normalized in software to 0.01 mm. Size of targets, involuntary hand movements, hand/stylus obscuring view of display, hover/proximity feedback with digitizer tablet.

[Microsoft08c] (*) Microsoft Corporation "SystemGesture Enumeration", www.microsoft.com

List of System Gestures for Microsft Tablet PC/Vista. Lists Tap and DoubleTap as gestures that work for both system and application. Description for Tap refers to chosing a command from the menu or toolbar, take action if command is chosen.

[Microsoft08d] (*) Microsoft Corporation "Microsoft Tablet PC - Glossary", msdn.microsoft.com, ms840456

Definitions of Application Gesture, Gesture, Application Gesture, Glyph (as ink data). Refers to "Microsoft gesture recognizer" as engine that specifically recognizes ink iput as either system or application commands. "Object regonizer" for recognizing non-gesture, non-handwriting shapes such as musical notation, math notation (i.e. sketch recognition would fall into this). Stroke based on pen down/up. ISF Ink serialized format (similar to JOT?)

[Microsoft08e] (*) Microsoft Corporation "Application Gestures and Semantic Behavior", msdn.microsoft.com, MSDN, fetched February 21 2008

Vista/Tablet PC SDK documentation from MSDN: defined gestures include scratch-out/erase, Triangle/insert, Check-off, Curlicue/fixed (compare with proofreader's marks), Double-Curlicue/copy, double-circle/paste, left-semicircle/undo, right-semicircle/redo, Caret gesture/paste, Inverted-caret/insert, flick left / backspace, flick right / space (compare with GO flick gestures), left/right/up/down corners with directional gestures. See also 2003 version of same reference.

[Microsoft10a] (*) Microsoft Corporation "Touch Gestures", Windows Mobile 6.5, Touch Gestures, dated 4/8/2010

Tap of finger represents left click of a mouse. Mouse events WM_MOUSEMOVE and WM_LBUTTONDOWN events not coordinated with GID_SELECT message for gesture. Double tap for left double click of mouse, using GID_DOUBLESELECT gesture message. Hold (press-and-hold/dwell) generates separate GID_HOLD message, used to represent right click of a mouse, GID_END messaged at end of hold time threshold. Flick gesture GID_SCROLL message to scroll, GID_PAN gesture to pan (can be after hold gesture)

[MicroTouch08a] (*) 3M Touch Systems (Microtouch) "MicroouchT Capacitive TouchSensor System", 3m Touch Systems, 2008

Capacitive touchscreen/digitior with actuator for haptic feedback, can be mounted to frame/carrier/display for ClearTek II touch sensor touchscreen

[MilekicS09a] (*) Milekic, Slavoljub "Using gaze interactions to interact with a display", United States Patent 7,561,143, July 14, 2009

Using a gaze tracker / visual input to simulate mouse events: no specific reference to gestures, but to graphical user interface

[MilekicS10a] (*) Milekic, Slavoljub "Curriculum Vitae: Slavko Melekic", www.uars.edu/faculty/smilekic/cv.html, Feb 27 2010

Educational uses of touch technology and human/computer design: Please Touch Museum (touch-screen user interface) at Phoenix Art Museum and Cleveland Museum of Art, Dallas Museum of Art: KiddyFace digital environment.

[MistryP08a] (*) Mistry, Pranav and Maes, Pattie "Quickies: Intelligent Sticky Notes", Proc. 4th Int'l Conf. on Intelligent Environments, IE08, Seattle, 2008

Electronic ink application using small outboard (sonic?) digitizer with a PC, and paper with embedded RFID tag. Lets writing/ink be tied to the piece of paper, similar capability to Anoto technology, however RFID can be used to locate the paper (which may be tucked into a book or folder) using RFID technology, retrieve specific notes. Demonstration includes used of deferred recognition to index/search notes.

[MistryP08b] (*) Mistry, Pranav and Maes, Pattie "Intelligent Sticky Notes that can be Searched, Located and can Send Reminders and Messages", IUT08, January 13-16, 2008, Maspolomas, Gran Canaria, Spain

Electronic ink application using small outboard (sonic?) digitizer with a PC, and paper with embedded RFID tag. Lets writing/ink be tied to the piece of paper, similar capability to Anoto technology, however RFID can be used to locate the paper (which may be tucked into a book or folder) using RFID technology, retrieve specific notes. Demonstration includes used of deferred recognition to index/search notes.

[MistryP10a] (*) Mistry, Pranav "SixthSense: Integrating Information with the Real World", www.pranavistry.com/projects/sixthsense, copyright 2010

Display image can be projected onto any surface, including a hand: tips of fingers (more than one) identified by colored bands on fingertips allow fingers to be detected optically with respect to image, forming an optical digitizer touch surface.

[MiyakiT09a] (*) Miyaki, Takashi and Rekimoto, Jun "GraspZoom: zooming and scrolling control model for single-handed mobile interaction", Proc. MobileHCI09, September 1-18, 2009, Bonn Germany

thumb-gesture input combining motion and pressure/force sensing: light touch is move, push-touch is zoom: refers to apple Pinch and Flick gestures for zooming and scrolling, comments that Flick may require multiple flick gestures for long list. Suggests using contact area of fingertip as substitute for pressure/force sensitive digitizer touchscreen.

[MoscovichT09a] (*) Moscovich, Tomer "Contact Area Interaction with Sliding Widgets", Proc. UIST '09, October 4-7, 2009, Victoria, B.C., Canada

Address accuracy on touchscreen by selecting all widgets/objects under area of touch (since finger touch contacts and area, not a single pixel), and user moving to activate a particular function: Sliding widget, multi-function widget. Gives example of moving down a scroll list for "History", then flicking a stroke left or right to move forward in history. Click sound on activiation (audible highlight) and also visual highlight.

[MotionComputing08a] (*) Motion Computing, Inc. "Use Shorthand to Create a Gesture", http://www.motioncomputing.com/resources/Shorthand_Gesture.pdf

Motioncomputing Tablet PC: Definition of single-letter "gestures" using side-button on stylus: appears functionally identical to "recognition macros" of Pencept PenPad 320 series product circa 1985, and similar feature from CIC HandWriter from about the same time. Press side barrel button on stylus, write one letter or symbol, release side button. Pre-defined keyboard input is invoked. LE 1700.

[MotionComputing08b] (*) Motion Computing, Inc. "Motion moves in on other markets, unveils new product", Austin Business Journal, March 7, 2008 and other press reports

Motion Computing F5 Tablet PC, XFR D630 : Ruggedized Tablet PC. Also competing ruggedized tougher-tablet market from Samsung, Sony, Dell Latitude XT convertible tablet. Mentions patent infringement lawsuit from Typhoon Touch.

[Moto.com10a] (*) labs.moto.com "Blog Archive: DIY Touchscreen Analysis: touchscreen stress test", http://labs.moto.com/diy-touchscreen-analysis

Blog posting of testing of touchscreens and multi-touch surfaces: mentions erratic behavior at light touch, edge problems. Features bad behaviors/errors for which Moto touchscreens tend to do well. compare with other papers on digitizer effects and user Interface by Phillips and Ward.

[Motorola10a] (*) Motrolorla "Droid 2 Global User Guide", Motorola, 2000

Electronic copy only

User guide for Droid 2 Android touchscreen cell phone / smart phone with stylus and finger gestures: touch (tap), touch & hold, hold followed by drag, scrolling. Slide out physical keyboard, no handwriting recognition.

[MotusGames08] (*) Motus Games "Motus Darwin product information", http://www.motusgames.com

WII-like game controller using accelerometers and magnetic north, rather than infra-red optical digitizer for sensing hand gestures and position. Compare to accelerometer pen from Hew Crane at SRI.

[Mozilla08 (*) mozilla.org "FireGestures 1.1.2 von Gomita", http://addons.mozilla.org/de/firefox/addon/6366

Mouse gestures for Mozilla / Firefox browser, Thunderbird Mail, and Chatzilla. Gesture recognition apparently based on changes in direction. Certain gestures involve right mouse button, mouse wheel.

[MultiTouchTechnology08] (*) multitouchtechnology.com "Multi-Touch Technology", www.multitouchtechnology.com

CNN using multi-touch screens from 2006 TED conference. Apple MacBook with Multi-Touch touchpad using two-finger gestures similar to Apple iPod.

[MultiTouchTechnology08b] (*) multitouchtechnology.com "Multi-Touch Technology: Firefox 3.1 Adds Multi-Touch Support", www.multitouchtechnology.com

Several announcements of multi-touch gestures in Apple computer products, touchpads, gestures supported in Firefox 3.1: pinch, two-finger scroll by page or window, swipe/flick, mentions fewer number of gestures in Safari web browser.

[MultiTouchVista08a] (*) codeplex.com "Multi-Touch Vista: TouchablePanel code example", multitouchvista.codeplex.com, fetched Feb 2011, dated 2008

Example WPF code for multi-touch demo on Windows Vista using Multitouch.Framework.WPF.Controls.Windows from schema.multitouch.com

[MurpyC10a] (*) Murphy, Chris "7 Tips for Using the iPad in Business", Information Week, November 1, 2010, page 26

Review of use of iPad touchscreen tablet at Mercedez-Benz Financial: customers sign agreements using iPad, states that development was less difficult than iPhone because display size allowed application to be built as more ordinary web/browser application.

[MurpyG10a] (*) Murphy, Glenn "The Chromium Projects: Tablet", dev.chromium.org, fetched 2010

Proposed tablet/gesture UI user interface for a Chrome OS tablet UI: mentions dwell/hover gester for contextual actions

[MurraySmithR08a] (*) xxx "Stane: Synthesized Surfaces for Tactile Input", Proc. CHI 2008 - Multitouch and Surface Computing, April 2009, Florence Italy pp 1299-1302

Haptic/Tactile input device: Hand-held object with various ribbed textures on the surface and piezo macrophone inside: rubbing or stroking a finger across the surface causes vibrations characteristic of the ribbed texture. Control of zoom, volumn, position by stroking different seconds.

Additional materials in file: "M" gesture, double-tap with finger gesture to turn UI on/off (for carrying pen computer so that cursor does not move)

[N-Trig09a] (*) N-Trig Corporation "DuoSense Technology", www.n-trig.com July 2009

N-trig digitizer tablet, senses stylus and touch/multi-touch, electrostatic (capacitive) stylus, mentions unintentional touch / hand-rejection

Additional materials in file: "M" gesture, double-tap with finger gesture to turn UI on/off (for carrying pen computer so that cursor does not move)

[NaoneE10a] (*) Naone, Erica "New Computer Interface goes beyond Just Touch", Technology Review, April 12, 2010

Multi-modal (haptic?) interface by Ken Hinckley at Microsoft, using both pen and hand. One example is using hand to hold a virtual object stationary on an active surface, and a pen/stylus to tear of a virtual page.

[NaoneE10b] (*) Naone, Erica "Redesigning the Web for Touch Screens", Technology Review, May 04, 2010

Re-designing of web pages for touch input, specifically for the iPad. Cites to Internation children's Digital Library re-design, multi-lingual (pictographic/iconic?) user interfaces was particularly amenable to touch input.

[NelsonF10a] (*) Nelson, Fritz "Review: Dan Bricklin's Note Taker HD puts the "Pad" in iPad", Information Week, July 6, 2010

Notetaker application for apple iPad. Appears similar to Daytimer product by Slate in the early 1990s for PenPoint and for Pen Windows: follows paradigm of ink-as-datatype, editing of electronic ink, as in van Raamsdonk

[NelsonF10b] (*) Nelson, Fritz "iPhone 4 Teardown Telegraphs Future iPad Gyro", Information Week, June 24, 2010

iPhone 4 cell phone / tablet contains gyroscope in addition to accelerometer, identifies as InvenSens ITG-3200 or STMicro L3G4200D three-axis MEMS gyro.

[NetworkSignatures10a] (*) NetworkSignatures.com "Intermediate Network Authentication", www.networksignatures.com

Materials relating to two-factor authentication products (exchange of PK signatures) for iPhones, Java-enabled phones and Blackberry mobile devices, based on patent 5,511,122, licensed from Naval Research Laboratory.

Folder contains additional materials.

[NetworkWorld09a] (*) NetworkWorld.com "Researchers develop 3-D squeezable input device", www.networkworld.com, Dec. 01, 2009

Suma, by Cambridge Consultants, squeezable mouse-like input device for three-dimensional input. Article states light-sensitive sensors for pressure/touch, ability to control two points of view simultaneously with one hand.

[NetworkWorld09b] (*) NetworkWorld.com "Nanotouch technology shrinks touchscreen displays", www.networkworld.com, April 7, 2009

Pseudeo-transparency: on small screen, touch screen is on rear of display so that finger does not occlude view of display -- show simulated finger on display when user touches back of display for input. Earlier technology was called Lucid Touch.

[NeuroScript09] (*) NeuroScript "Testing Digitizer / Tablet Linearity", http://www..neuroscript.net

software package for measuring performance of tablet digitizers: manual procedures for testing lineary by using diagonal lines, but does not mention velocity-induced errors (compare with Carau)

[NeuroScript10] (*) NeuroScript "MoveAlyzeR Tutorial", http://www..neuroscript.net

software package for measuring performance of tablet digitizers: missing coordinates, missing points, non-linearity. Part of offering to for measurements for neuromotor analysis of handwriting motion.

[NextWindow09] (*) NextWindow Inc. "NetWindow Optical Touch Screens", www.nextwindow.com, July 2009

Infrared optical digitizer multi-touch flat-panel displays: notes that no optical coating is required on display. Sensors mount at corners of front surface of rectangular glass assembly.

[NewScientist08] (*) NewScientist.com news service "Phones with feeling are more useful", www.newscientist.com, 24 March 2008

VibeTonz vibrotactile haptic/vibration feedback for touch interfaces and touchscreens: VibeTonz is a hardware actuator component for PDAs and devices similar to Apple IPhone

[NewScientist08b] (*) NewScientist.com news service "Fat fingers no problem with 'see-through' touchscreen", www.newscientist.com, 18 December 2008

Fat fingers / touchscreen accuracty: Place touch pad on back side of hand-held touch-screen device, so that finger tip does not obstruct/obscure view of display and where user is touching

[NewScientist09a] (*) NewScientist.com news service "'Fat fingers' can become dainty for touch screens", www.newscientist.com, 24 November 2009

Improve accuracy of touch-screen input by sensing orientation of finger: experimental system to demonstrate used fingerprint scanner to determine orientation of finger

[NewScientist10a] (*) NewScientist.com news service "Putting the touch into touchscreens", www.newscientist.com, 26 April 2010

Review of haptics technologies for touchscreens: vibration to give the illusion that a button protrudes from thes ervice, lateral vibration to simulate the haptic sensation of a sharp edge, high frequency vibrations to simulate a slippery surface, force-feedback systems

[NewScientist10b] (*) NewScientist.com news service "World's first ice touschscreen virtually burns", www.newscientist.com, November 18 2010

Nokia demonstration system of turning blocks of ice into translucent optical touch screen (based on reflected light where hands come into contact), displaying virtual flames where touched.

[Nokia08a] (*) Nokia "Nokia N810 Internet Tablet", www.nokia.com product information

Dedicated pen computer with MP3 and auto map software, open-source (Linux). Touchscreen digitizer.

[Nokia08b] (*) Nokia "First glimpse inside Nokia S60 Touch. Going beyond Multi-touch", www.unwiredview.com, January 8, 2008

Review of S60 No-touch / touchless electrostatic touch UI device from Nokia. Allows in-air three-dimensional 3D gestures. Compared to "Minority Report" film. Due to patent conflicts with Apple Multi-Touch (see Fingerworks), based on Active Matrix LCD with integrated optical touch screen. Gestures include clockwise and counter-clockwise circles, X mark for delete, check mark, lasso / enclosed curve, two finger pinch and expand for zoom.

[Nokia08c] (*) Nokia "Nokia creates a real Minority Report", phonenews.blogs.sapo.pt, January 9, 2008

Review of Nokia publication on in-air gestures, compared with film "Minority Report": clockwise and counter-clockwise circular rotations, pinch and zoom, stationary pointing, X, check mark, enclosed curve / lasso to select.

[Nokia10c] (*) Nokia "Nokia N8-00 User Guide", Nokia.com, fetched Dec 2010

Nokia N8 touchscreen cellphone with network applications.

[Nokia10d] (*) Nokia "Nokia, Microsoft", (various)

Folder with information on Nokia and Microsoft Windows 7 phone OS

[Nokia10e] (*) Nokia "Nokia N8-00 User Guide", Nokia, 2010

User guide for cellphone with touchscreen interface. Device includes haptic (vibration) feedback as confirmation on some touch inputs

[nortd.com09a] (*) nortd.com "TouchKit: open source multitouch development kit", labs.nortd.com, fetched 2009

Open source development system (hardware and software) for multi-touch technology, includes projection of images on reflective surface. Also mentions CUBIT multitouch system for rapid implementation of multitouch projects: ofxTouch API for C++ OpenFrameworks on various platforms.

File contains additional materials: Zaagtech multi-touch kit

[NovaMobility08] (*) Nova Mobility Systems "Nova Mobility Rugged Tablet PC and Handheld Computer Systems", www.novamobility.com

NMS-5000, NMS-SUNPAD, Tablet PC, Windows Mobile, Windows CD, Windows XP Embedded. touch-screen based pen computers and PDA's. Licensee of Typhoon Technologies. Market is industrial uses, data collection. Integrated bar code, camera, mag stripe reader. Touch screen with palm rejection -- digitizer technology not stated, says resistive touch. Keyboard usable while user wearing heavy gloves. Compare with products by Leo Shpiz for military market.

[Nuigroup09a] (*) NUI Group Authors "Multi-Touch Technologies: Community Book, 1st ed", available at nuigroup.com, May 2009

Textbook/tutorial from open-source hardware project for multi-touch (optical: rear diffusion) hardware. Discusses open-source Gesture widget and software libraries, such as X12, GDML Gesture Definition Markup Language, NUIFrame, Grafiti (not the Palm unistroke library), AME Arts, Media and Engineering Patterns Library, other gesture frameworks.

[OdomG08] (*) Odom, Gary "Tool Group Manipulations", United States Patent 7,363,592 B1, April 22, 2008

Tool bar re-configures automatically, changing/re-arranging toolbar menu items depending on what tool user has selected and is using most frequently: file contains press reports on patent assertion against Microsoft. See also www.patenthawk.com (filed under Odom): patenthawk.com

[Ording08] (*) Ording, Bas "List Scrolling and Document Trnaslation, Scaling, and Rotation on a touch-screen display", United States Patent 7,469,381, December 23, 2008

User-interface on touchscreen (or near-touch) for document dragging: when part of document is dragged, expose another part of the document: also describes "bounce" at end of scroll. Compare with Alternate Reality Kit.

[OuyangTY09a] (*) Ouyang, Tom Y. and Davis, Randall "A Visual Approach to Sketched Symbol Recognition", Proc 2009 IJCAI, pp 1463-1468, Pasadena CA

On-line/dynamic character recognition, but using visual features (OCR-like?) rather than dynamic or time-sequence recognition. Mentions problems of overlapping/touching sketch symbols and gestures. States that recognizer is rotationally invariant (so what about M and N, E and 3, S and Z, etc.?) Does not describe recognizing handwriting: electrical symbols, powerpoint symbols, etc.

File constains additional references for sketch recognition for mechanical-engineering, to 2003

[OuyangTY09b] (*) Ouyang, Tom Y. and Davis, Randall "Visual Recognition of Sketched Symbols", IUI 2009 Workshop on Sketch Recognition, Feb. 8 2009, Sanibel Island, FL

OCR-type recognition, mentions doun-sampling of images prior to classifier. See other Ouyang papers. States superior to Graffiti, which requires constrained writing. (Unistroke)

[OuyangTY09c] (*) Ouyang, Tom Y. and Davis, Randall "Learning from Neihboring Strokes: Combining Appearance and Context for Multi-Domain Sketch Recognition", Advances in Neural Information Processing, 2009, pp. 1401-1405

Recognition of clusters of squiggles and angles in a sketch as an indication that the strokes should be parsed together in one object

[OxfordEnglishDictionary10a] (*) Oxford English Dictionary "Oxford English Dictionary/TITLE> www.oed.com, fetched 2010

Definitions of select terms. gesture (with motion), pointer (computer address; screen symbol), stylus (pointer or finger)

[Palm08a] (*) Unknown "Die Palm Pilot History", Posted on scribd.com and handheld.vn, 2008

Compendium of over 100 handheld devices up to 2008 running Palm OS 5.0 on PalmPilot type models, with hardware specifications

[Palm09a] (*) Palm "Palm Pre Benutzerhandbuch", Palm Inc, 2009

User guide (in German) for Palm PRE hand-held touchscreen PDA

[ParkesA08] (*) Parkes, Amanda; Poupyrev, Ivan; and Isshi, Hiroshi "Designing Kinetic Interactions for Organic User Interfaces", Communications of the ACM, June 2008, Vol 51 No 6; pp 58-ff.

Organic user interfaces / tangible user interfaces: combination of physical input and haptic/physical feedback, not specific to gesture input. Reference to three-dimensional mechanical digitizers.

[PatelN08] (*) Patel, Nilay "MIT reinvents the Post-It note ... with Post-It notes", www.engadget.com, May 1, 2008

press reports on Quickie handwriting notes using what appears to be the Anoto pen, with an RFID tag (?) embedded in the paper. Also Girton Labs Ixp-Note, post-it note sized small digitizer, form factor like a postit note. Prototype of DPF711K, touch-screen small size with a post-it note sized display from Audiovox, along with Audiovox Digital Message Center. Sony E- Series display/touchscreen digitizer for taking notes.

[PatelPredd09] (*) Patel-Predd, Rachel "The Trouble With Touch Screens", IEEE Spectrum, January 2009, pp 11-12

touchscreens and digitizers using indium tin oxide ITO: indium is scarce resource, alternatives are antimony tin oxide, carbon nanotube, flexible polymer PEDOT

[GreenemeierL10a] (*) Greenemeier, Larry "Magic Fingers: Digging into Multi-touch Technology with Both Hands: Perceptive Pixel chief scientist Jefferson Han has big plans for changing how people use computers", Scientific American, March 5, 2010

Interview with Jeff Han on Multitouch technology by perceptive pixel: states that large screen manipulation is the interesting user-interface area, criticizes capacitive sensing multi-touch input as not scalable to large surfaces or use with gloves compared to frustrated internal reflection

[Peregrine10a] (*) ThePeregrine.com "The Peregrine gaming data glove", ThePeregrine.com, fetched 2010

Electronic gesture data glove, approximately 30 gestures, indented for gaming market. File contains additional materials

[Perttula08] (*) Pertulla, Drew and McClosky, David "skim text file reader", bigasterisk.com/projects/skim

Text file document read with scrollbar highlighting parts of text in the scrollbar

[Physorg08] (*) PhysOrg.com "Smart desks make sci-fi a reality in the classroom", www.physorg.com

Durham University in UK, Dr. Liz Burd, Director of Active Learning in Computing: experimental program using multi-touch desk surfaces in education: SynergyNet project of the Technology-enhanced Learning Research Group

[Piquepaille08] (*) Piquepaille, Roland "Multi-touch smart desks in the classroom", zdnet.com, Sept. 17, 2008

Durham University UK experimental SynergyNet project using multi-touch tablet desks for gradeschool education

[PlasticLogic09a] (*) PlasticLogic.com "Plastic Logic Reader", Plastic Logic.com, 2009 ff

File on Plastic Logic Reader, electronic ink display with touch-sensitive touchscreen interface: swipe gesture to turn pages.

[Plawa10a] (*) Plava Feinwerktechnik GmbH "Scrivo.1 product information", Plawa.com, fetched 2008, 2010

Optical mouse in a pen-shapped barrel. Newer model includes audio recording: compare with LiveScribe and FingerSystem.

[PocketCalculatorShow10a] (*) PocketCalculatorShow "Seiki Computer Watch Fun", PocketCalculatorShow.com, fetched 2010

Variety of Seiko computer/calculator watches. RC-20, circa 1985, buttonless touchscreen input with 42x32 pixel display, graphical icons

[PolssonK09] (*) Polsson, Ken "Chronology of Personal Computers", Posting at www.islandnet.com

Timelines of history of personal computers, back to 1947. Windows for Pen Computing and GO/PenPoint both accounced January 1991.

[PositiveSystems10a] (*) Positive Systems Inc. "POSey POS Point Of Sale product information", www.pos-ey.com fetched 2010

POS system for DOS/Windows95 and later using modified MicroTouch unMouse touch screen to replace mouse.

File contains additional information.

[ProbertML10a] (*) Probert, Matt and Probert, Leela "Research Results for 'SideKick'", www.probertencyclopaedia.com, fetched 2010

Borland SideKick phone dialer dials a phone number found anywhere on the DOS screen

[PryorTR06a] (*) Pryor, T. R. "Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics", United States Patent 7,084,859, August 1, 2006

Touchscreen (not surface) instrumentation control panel for automobile

[Qomo09] (*) Qomo HiteVision LLC "Qomo HiteVision QIT 30 product literature", Qomo HiteVision LLC, www.qomo.com

Untethered electromagnetic digitizer, multiple tablets may be used wirelessly to annotate on a common shared whiteboard display

[QuinnM08] (*) Quinn, Michelle "Women put a finger on an iPhone problems", Los Angeles Times, June 16, 2008

Apple iPhone touch-sensitive digitizer does not work for women with long fingernails, or with gloves. Described tongue-in-check as accessibility problem.

[Radivojevic08] (*) Radivojevic, Zoran; Zou, Yanming; Wang, Kong Qiao; Takala, Roope Tapio; Lantz, Vuokko Tuulikki; Lehtiniemi, Reijo; Rantala, Jukka Ilmari; and Vatanparast, Ramin "Apparatus, Methods and Computer Program Products Providing Finger-Based and Hand-Based Gesture Commands for Portable Electronic Device Applications", United States Patent Application US 2008/0005703 A1, Junary 3, 2008

Nokia: In-air finger and hand gestures in front of a PDA or cell phone: describes a sonic/sonar digitizer for detecting hand gestures close to the device, but also mentions electrostatic/capacitive and optical hardware, generally relates to use of in-air hand and finger gestures, not the hardware. Mentioned in other references as multi-touch.

[RantalaJ09] (*) Rantala, Jussi; Raisamo, Roope; Lylykangas, Jani; Surakka, Veikko; Raisamo, Jukka; Salminen, Katri; Pakkanen, Toni; and Hippula, Arto "Method for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback", IEEE Trans. on Haptics, Vol 2 No 1, Jan 2009, pp 28-39

Abstract only, additional materials in file: Vibrating touch screen puts Braille at the fingertips: rhythmic haptic encoding of braille characters similar to Morse code; haptic/tactile display of braille on a touchscreen/multi-touch surface

[RapidRepair10a] (*) RapidRepair.com "iPad Repair Guide: Stay tuned for a shocking tear down of the new Apple iPad", www.rapidrepair.com, fetched 2010

Disassembly of Apple iPad: shows separate front-mounted digitizer with transparent screen.

[RayJ10a] (*) Ray, Jim "SAGE: Cold-War Forerunner to the Information Age", Available on eskimo.com

SAGE system: information on light gun

[RekimotoJ08a] (*) Rekimoto, Jun "Organic Interaction Technologies: From Stone to Skin", CACM, June 2008, Vol 51 No 6, pp. 38-44

Special issue on organic/graspable/haptic/tangible user interfaces. Deformable/rollable input devices, as SmartSkin, PreSense (pressure-sensing touchscreen surface -- see elastomeric touchscreens?). Examples include HoloWall -- compare with Wellner?

[ReynaA09] (*) Reyna, April S. "Multi-touch Technology", www.wiziq.com, June 6 2009

Internet posting of review of multi-touch technology: Perceptive Pixel, Apple, Microsoft Surface (infrared), Apple iPhone

[RichterH10a] (*) Rcihter, Hendrik; Ecker, Ronald; Deisler, Christopher; and Butz, Andreas "HapTouch and the 2+1 State Model: Potentials of Haptic Feedback on Touch Based In-Vehicle Information Systems", Proc. 2nd Int'l Conf. on Automotive User Interfaces and Interactive Vehicular Application, AutomotiveUI 2010, Nove 11-12 2010, Pittsburgh, PA. pp 72-79

Tactile/Haptic feedback on a touchscreen in an Automotive map user-interface: also tracks finger in proximity, or when not touching firmly. Application of Buxton 3-state model: Out-Of-Range on proximity, active tracking (a.k.a. passive tracking, and pressed.

[RobbinsDC08a] (*) Robbins, Daniel C; Sarin, Raman K;, Horviz, Eric J.; and Cutrell, Edward B. "Advanced navigation Techniques for Portable Devices", United States Patent 7,327,349, February 5, 2008

Browsing or scrolling a document (such as a map) using a virtual semi-transparent overlay over the image of the document: like moving a magnifying lens?

[RosenbergLB07a] (*) Rosenberg, Louis B. "Haptic Feedback Stylus and Other Devices", United States Patent 7,265,750, September 4, 2007 (See also 6,353,427, 6,088,019

Stylus with haptic feedback actuator in stylus tip: feedback can be jolt, vibration, constant force (for a constant time, or at a constant magnitude), or texture. Can also be mounted in a steering wheel axel, motion is perpedicular to steering wheel.

[RosenbergLB09a] (*) Rosenberg, Louis B. and Riegel, James R. "Haptic Feedback For Touchpads and Other Touch Controls", United States Patent 7,592,999, September 22, 2009 (See also 8,031,181, 8,059,105)

Haptic force feedback transducer/actuator mounted on back surface of touch surface or tablet, which is mounted on springs to allow motion.

[RoudautA09a] (*) Roudaut, Anne; Lecolinet, Eric; and Guiard, Yves "MicroRolls: Expanding Touch-Screen Input Vocabulary by Distinguishing Rolls vs. Slides of the Thumb", Proc. CHI 2009, April 4-9 2009, Boston, Massachusetts, pp. 927-936

Gesture based on rolling of thumb instead of sliding of thumb. Six microroll gestures (four directions, two circular) four slide gestures (direction) four swipe gestures (direction) two diagonal rubbing (rubout) gestures. Instead of marking menus, etc.

[SafferD08] (*) Saffer, Dan "Interactive Gestures: Designing Gestural Interfaces", O'Reily Press, 2008

General tutorial book on gestural interfaces including motion gestures such as Wii, hand-gestures, eye-winks, body motions, multi-touch from Fingerworks and iPhone. Mentions "the Clapper" as a gestural interface with indirect manipulation. First multi-touch device in 1982. Refers to gestures as motions of the human body.

[Samsung10a] (*) Samsung "Galaxy Tab Tablet Mobile Product Information", www.samsungmobile.com, Dec 2010

Samsung Galaxy Tab mobile tlabet device, includes Flash, android operating system. File contains additional material.

[SchmidtD10a] (*) Schmidt, Dominik; Chehimi, Fadi; Rukzio, Enrico; and Gellersen, Hans "PhoneTouch: A Technique for Direct Phone Interaction on Surfaces", Proc UIST '10, October 3-6, New York City, USA, pp. 13-16

Use input of smart phone such as iPhone (inertial input, keys, etc.) long with input from touch surface (simulated with video detection) as user input.

[Schweibenz09] (*) Schweibenz, Eric. W. "eInstruction Corporation Files New 337 Complaint Regarding Certain Collaborative System Products", Press Release, LexisNexis, July 13, 2009

eInstruction whiteboard system using wireless tablets, versus importer Qomo Hitevision of wireless tablets, contributory infringement

[SchweitzerB10a] (*) Schweizer, Bobby "How You Should Guage the Quality of a Touchscreen", www.tested.com, November 12, 2010

overview article on touchscreen products with short notes on multi-touch history, apparently taken from www.buxton.com. States taht "flick" gesture first implemented in 1999: compare with PenPoint flick gestures in 1991?

[SchwesigC08] (*) Schwesig, Carsten "What makes an Interface feel Organic?", Communications of the ACM, June 2008, Vol 51 No 6; pp 67-ff.

Organic user interfaces / tangible user interfaces: Gummi flexible display, can be bent as a form of gesture input (for zoom) combined with touchpad / touchscreen sensing. Bending force determines how fast it zooms.

[ScottJ10a] (*) Scott, James; Izadi, Shahram; Rezai, Leila Sadat; Ruszkowski, Dominika; Bi, Xiaojun; Balakrishnan, Ravin "RearType: Text Entry Using Keys on the Back of a Device", Proc. MobileHCI 2010, September 7-10, 2010, Lisbon.

User interface with physical keyboard on rear of hand-held (two hands) display: compare with LucidTouch

[SensAble09] (*) Sensable Technologies "Haptic Devices and Toolkits for Haptic Application Development", www.sensable.com

Product information on hand input devices with haptic force feedback: mechanical linkages. Force/touch effects include constant/gravity, viscosity, 3D friction, spring, friction, siffness, damping, front/back faces of virtual objects.

[ShannonMM08] (*) Shannon, Meg McGinity "This Menu has changed: Innovative interfaces will give wireless the golden touch", Communications of the ACM, May 2008, Vol 51 No 5, pp 19-21

Essay on multi-touch interfaces, gesture with iPhone. Jeff Han cited as multi-touch. GestureTek video gesture recognition -- GestureTek in business since late 1980s.

[ShenE09a] (*) Shen, Ehr-li (Early); Tsai, Sung-sheng (Daniel); Chu, Hao-Hua "Double-side Multi-touch Input for Mobile Devices", CHI 2009, April 2009, Boston MA, pp. 4339-4344

Multitouch touchpanel on back/rear of PDA/iphone so that display is not obscured. Multi-touch gestures (e.g. two-finger "grab"), fingertip positions displayed with small cursors on front display. Also double-side input multi-touch gestures on both sides at same time.

[ShermanE09] (*) Sherman, Erik "Can Apple's MultiTouch Patent Withstand Scrutiny - or Challenge?", BNET Technology Insights, Feb 6th 2009: www.bnet.com

Review of published patent application relating to iPhone/Fingerworks touch gestures

[Shneiderman10] (*) Shneiderman, Ben and Plaisant, Catherine "Designing the User Interface: Strategies for Effective Human-Computer Interaction, 5th Edition", Addison-Wesley, publishers 2010

University textbook on computer-human interaction - Earlier editions 1987, 1998. Discussion of direct manipulation, with Microsoft Office as an example -- direct manipulation because you have WYSIWYG behavior in the document, not because it is a tangible user interface. One chapter on input devices talks about pointing/digitizer input, Graffiti, some use of gestures.

[Smart10a] (*) SMART Technologies "SMART Technologies Inc. PROSPECTUS", www.smarttech.com

SMART board interactive whiteboard digitizers, with digital ink: Prospectus for public offering

[Spiegel09a] (*) Der Spiegel "Apples neue Maus hat keine Tasten", Der Spiegel, Germany: October 20, 2009

multi-touch mouse has no wheels or buttons: uses a touch surface.

[Spiegel10a] (*) Der Spiegel "Warum viele Blinde das iPhone lieben", Der Spiegel, Germany: October 17, 2010

Review of VoiceOver for iPhone: refers to gesture input on touchscreens has being the solution for visually-impaired/blind computer access

[Spiegel10b] (*) Der Spiegel "Cebit vor zehn Jahren: Ipad-Opa und Bluetooth-Waschmaschinen", Der Spiegel, Germany: Feb 28, 2010

Mentions skeye.pad webpad tablet computer at Cebit 2000 about the time of the Tablet PC introduction by Microsoft: Wireless connection, Webpanel, touchscreen interface with browser.

[Stantum09a] (*) Stantum.com "PMatrix: The unparalleled Multi-Touch detection firmware", www.stantum.com

Formerly known as JazzMutant / Lemur. Resistive-grid multi-touch detection using X/Y addressable nodes in a grid pattern, notes that it works with any touch stylus, unlike capacitive digitizer. Includes gesture-recognition software for pinch, twist, rotate, close, zoom gestures. Mentions bounce on scroll action, similar to iPhone/iPad?

[Stantum09b] (*) Stantum.com "Unlimited multi-touch", www.stantum.com

Resistive-grid multi-touch detection using X/Y addressable nodes in a grid pattern, notes that it works with any touch stylus, unlike capacitive digitizer.

[Stantum09c] (*) Stantum.com "Stantum adds Finger-Pressure Detection to Its Patented PMatrix Multi-Touch Detection Platform", www.stantum.com

pressure/force-sensing multi-touch resistive touchscreen digitizer.

[StewartWM09a] (*) Stewart, Walter Mason; Carrera, Marcelo; and Hook, Robert G. "E-Mail Virus Protection System and Method", United States Patent 7,506,155, Marcy 17, 2009

Filter Email for virus detection by executing program on another computer to check before sending to email recipient: send recipient converted file (e.g. PDF) instead. Virus is assumed to be executable code.

[Sobell08a] (*) Sobell, Mark G. "A Practical Guide to Red Hat Linux, Fourth Edition.", www.sobell.com/RH4 (author publication)

Definition Input Focus

[SuehleR10a] (*) Suehle, Ruth "Five open source alternatives to the iPad", opensource.com, 4 Apr 2010

web tablets, open source: Neofonie WePad with Android OS, TouchBook, iFreeTablet, MSI Taiwanese tablet with Android, Asus / Asusteck Eee Pad, rumored Google Tablet.

[SutantoH10a] (*) Sutanto, Herry; Spencer, Richard L; Landstad, Todd M.; Bhattacharyay, Subha; Wang, Haiyong; and Jones, F. David "Controlling Multiple Map application Operations with a Single Gesture", United States Patent 7,752,555, July 6, 2010

Using feature points/characteristics of a gesture in carrying out the operation of the gesture: characterizes this as performing multiple operations. Examples include endpoints and apex point of a checkmark. Compare with using single or multiple hotpoints of a gesture?

[Tabletized09] (*) www.tabletized.com "Journey to the beginning of Tablets. The Apple Newton.", www.tabletized.com, fetched 2010

History of Newton development: Walter Smith developer of NewtonScript object-oriented programming language. Original price for Newton Toolkit was $1000. Developers of Newton Toolkit: Norberto Menendez, Ben Sharpe, Peter Potrebic. Appears to be copy of Wikipedia article on Newton (platform).

[TaubDM09a] (*) Taub, Daniel Matthew "The BoPen: A Tangible Pointer tracked in Six Degrees of Freedom", Master's Thesis, EECS/MIT, August 21, 2009

Electronic copy only. Light-pen-like device using projected barcode pattern, projector uses switchable diffuse/clear surface that can project onto the surface and also see objects above the surface. Credits Doug Englebart with first GUI graphical user interface.

Cites to this bibliography and to this collection by name "which made my related works section both more interesting and immensely more time-consuming"

[TechHotSpot10a] (*) Unknown "Pen Computing", www.iturls.com/English/TechHotspot/TH_pen.asp

Compendium of URL links to pen computing, lists this reference. Terminology: uses Diagram Recognition for Sketch Recognition, includes several Chinese commercial handwriting recognition / pen-computing links.

[TechnologyReview08a] (*) Technology Review "Mouse for 3-D Navigation; Do-It-Yourself Multitouch Display", TechnologyRview, July/August 2008, page 30

SpaceNavigator 3-D mouse, www.3dconnexion.com -- six-degrees-of-freedom joystick-like input device.

nortd.com TouchKit -- open-source multitouch table input tablet, apparently optical

[Tekscan07a] (*) Tekscan, Inc. "Tekscan Pressure and Force Measurement Technology", Tekscan Inc, South Boxton MA, 2007 (fetched 2012, www.tekscan.com)

Force/pressure touch sensors using maxtrix of condoctores and pressure-sensitive conductive ink, can sense multiple touch points by scanning each node

[TheEngineer08a] (*) The Engineer "Magic touch", www.theengineer.co.uk, July 28, 2008

Review of some touch-screen and haptic technologies (seems to confuse "haptic" with "touch-input"). Roope Takala, Haptikos project at Nokia. Christophe Ramstein, Immersion corporation. Gary Todd, Virtual Veins. Mark Williams, Warwick Manufacturing Group (WMG), UK. iPhone.

[ThreeDconnexion08] (*) 3dConnextion "Perfekter Begleiter fuer Globe Strotter: 3Dconnexion stellt SpaceNavigator for Notebooks vor", www.3dconnexion.de

Press release for SpaceNavigator, three-dimensional mouse pointing device, using force/pressure for up and down, also rotation.

[TIPB10a] (*) TIPB.com "New Gesture in iPhone SDK 3.2 for iPad", tipb.com, March 10, 2010

Additional gestures for iPhone: Pinch-in/out/mix, Rotate-(anti)clockwise, 3Tap, etc.

[ToepkeMG08a] (*) Topeke, Michael G.; Blum, Jeffrey R.; and Parker, Kathryn L. "Soft Input Panel System and Method", United States Paten 7,411,582, August 12, 2008

Virtual Keyboard and other devices simulating actual devices by generating system messages same as drivers (e.g. keyboard driver) for physical input devices. SIP Soft Input Panel.

[Touchco09] (*) TouchCo "Touchco IFSR Multi-touch Resistive Sensors", www.touchco.com

Commercial company with touch/pressure sensitive digitizer using IFSR Force-sensitive resistor ink.

[Touchco10a] (*) TouchCo "Touch User Interface - Touch Screen and Multi Touch", www.touchco.com

Detailed description of IFSR (ink force-sensing resistor) multi-touch touchscreen: Stantum / Touchco

[Touchtisch08] (*) Touchtisch Projekt "Touchtisch Ausgabe 01: Erste Erfolge", (in German) Touchtisch Projekt, Brauneggerstrasse 55, Konstanz, Germany, touchtisch.wordpress.com

Student project on touch-sensitive interface, using in part a Wii hardware digitizer and Flash (software) on a MAC.

[TyphoonTouch09] (*) Typhoon Touch Technologies "Typhoon Touch Technologies, press information", www.typhoontouchtechn.com

Licensing company for two patents (see CloughWA) relating to application generators for tablet/pen computers. Company originally formed to distribute MP3 files. Press reports on settlements with Electrovaya, Motion Computing. See also Nova Mobility (product partner). EDGAR report states that original purpose of company was to sell MP3s on-line, acquired patents from Nova Mobility Systems. See file folder for patent information.

[vanMensvoortK09a] (*) van Mensvoort, Koert Martinus "What You See is What You Feel", Eindhoven University of Technology, 2009, ISBN: 978-90-386-1672-8

PH.D. Thesis on haptic touch user interfaces. Force-feedback, mechanically simulated or optically simulated (via cursor displacements) or via animation of stickiness. Changing cursor cited to 1988 for WIMP interfaces. Dynamic cursor invented 1968 by Engelbart. References to force-feedback back to 1990.

[VertegaalR08a] (*) Vertegaal, Roel and Poupyrev, Ivan "Organic User Interfaces", CACM, June 2008, Vol 51 No 6, pp. 26-30

Introduction to special articles on organic/graspable/haptic user interfaces. Credits Alan Kaye (indirectly) for inspiring the Tablet PC. Deformable/rollable input devices, such as paper that can be bend or folded.

[VilppulaM09] (*) Vilppula, Matti; Mattila, Arto; and Niemi, Markku "Method and Device for Position Determination", United States Patent 7,558,696

Handheld mobile (cellphone) device using GPS and other means for determining geographic position, API picks available means/method that meets accuracy requirements specificed via the API

[VogelD10a] (*) Vogel, Daniel "Direct Hand Input and Hand Occlusion", Ph.D. Dissertation, U. Toronto Dept. of Computer Science, 2010

Hand occlusion for pen input: points out problems of that pen / handwriting / gesture recognition is used with legacy/existing software. Pen input faster than pointing with a mouse -- compare with observations on Windows for Pen Computing and GO/PenPoint in early 1990's.

[Walkenbach08a] (*) Walkenbach, John "Lotus 1-2-3 Release History", j-walk.com/ss/123/index.htm

History of Lotus 123 Release dates: First Windows (non-DOS) version in 1991, Lotus 1.0 for Windows. Via Voice speech voice recognition added in 1998.

[Walkenbach08b] (*) Walkenbach, John "Excel 2007: Where It Came From", "Excel 2007 Power Programming with VBA", Wilely.com: j-walk.com, Chapter 1 Excerpt

Release and development history of Excel spreadsheet program: cites provenance from VisiCalc available at www.bricklin.com; Lotus 1-2-3

[WalkerG10a] (*) Walker, Geoff "Touch Technologies Tutorial", walkermobile.com, last update of April, 2010

Tutorial on touchscreen techologies. Haptic feedback. Distinguishes Touch Screens (passive) from Active Digitizers. Flexible displays. Non-multi-touch: analog resistive, Surface Acoustic Wave (SAW) Surface Capacitive (electrostatic), Traditional infrared (IR), EMR Electromagnetic Resonance, APR Acoustic Pulse Recognition, DST Dispersive Signal Technology, Force sensing (Vissumo). Multi-touch: Projected capacitive, LCD In-Cell (Optical, Switch, Capacitive), Optical, digital resistive, Waveguide infrared (RPO), Vision-base optical (e.g. includes FIR/FTIR). Figures on major vendors, market share. Alternative materials to ITO.

No treatment of electromagnetic, acoustic/sonar, or Anoto pattern?

[WardM10a] (*) Ward, Mark "Skin becomes gadget control pad", BBC News, March 26, 2010

Skinput: acoustic digitizer mounted on arm: must learn/be trained to recognized characteristic sound of tapping on different parts of the skin surface.

[WestermanWC06a] (*) Westerman, Wayne Carl and Elias, John G. "System and Method for Packing Multi-Touch Gestures onto a Hand", United States Patent 7,030,861, April 18, 2006

Multi-touch gestures with hand neutral (closed) and hand open, for twice as many chorded gestures. E.g. hand neutral four fingers for scroll, hand open four fingers for page up/down.

[WestermanWC08] (*) Westerman, Wayne Carl; Lamireaux, Henri; and Dreisbach, Matthew Evan "Swipe Gestures for Touch Screen Keyboards", United States Patent Application Publication 2008/0316183 A1, December 25, 2008

Swipe gestures by moving finger across keys on (simulated) keyboard touch-screen: compare with 1980's Japanese calculator in collection?

[WestlyE10a] (*) Westly, Erica "A Layman's Guide to the Tablet PCs of 2010", www.fastcompany.com, January 14, 2010

Review of "slab-form" tablet PCs, including Android and rumored apple iSlate. Lenovo IdeaPad U1 running Linux with multitouch tablet as display portion of Windows PC, Plastic Logic e-reader with multi-touch capacitive digitizer and annotation, dual-screen courier tablet (Microsoft?)

[WhiteJ09a] (*) White, Jeremy "Multi-touch Interfaces and Map Navigation", Master's Thesis, (Catography and GIS), U. Wisconson/Madison, 2009

Physical design of large rear-projection multi-touch interactive surface (FTIR Frustrated Total Internal Reflection: see Han). Contains review of usability of multi-touch gestures over mouse/keyboard. Describes algorithm for finding "center" of finger-touch blob for pointing.

[Wikipedia08a] (*) en.wikipedia.org "Mouse gesture", en.wikipedia.org/wiki/Gesture-based_interface

General reference on mouse gestures: history first mouse gesture (not using a pre-defined shape) was "drag" by Apple to replace a dedicated "move" button on the mouse. Cites lack of feedback to show that the gesture was recognized correctly (showing actual gesture: compare with GO/Agulnick), and visibility to make gestures easy to learn. Cites to Buxton for awkwardness of mouse as a gesture device compared to stylus and tablet digitizer.

[Wikipedia08b] (*) en.wikipedia.org "Post-WIMP", en.wikipedia.org/wiki/Post-WIMP

Post-WIMP: defines as paper sheet user interface, contrasted to WIMP Windows Icons, Menus, Pointing device user interfacse. See Andries van Dam

[Wikipedia08c] (*) en.wikipedia.org "Scrollbar", en.wikipedia.org/wiki/Scrollbar

Mentions google chrome browser scroll bar which places highlights/marks in trough of vertical scroll bar to indicate places where term was found that user was looking for in a web page

[Wikipedia08d] (*) en.wikipedia.org "Wang Laboratories", en.wikipedia.org/wiki/Wang_Laboratories, fetched 2008

Wang Laboratories Freestyle electronic ink/voice whiteboarding and communication desktop system using Hitachi digitizer: has link to Freestyle demonstration video

[Wikipedia08e] (*) en.wikipedia.org "WIMP (Computing)", en.wikipedia.org, fetched 2008

WIMP user interface: window, icon, menu, pointing device: mentions post-WIMP (Andries van Dam)

[Wikipedia10a] (*) en.wikipedia.org "Handwriting movement analysis", en.wikipedia.org/wiki/Handwriting_movement_analysis

Cites to Teulings and Jean Renard Ward. Mentions early history of pen-input devices and handwriting tablets: Scripture 1895 devices for storage of pen positions, McAllister 1900

[Wikipedia10b] (*) en.wikipedia.org "Xcode", en.wikipedia.org, fetched 2010

Xcode IDE and development tools superceded Project Builder IDE, which was derived from NeXT IDE and tools.

[Wikipedia10c] (*) en.wikipedia.org "SideKick", en.wikipedia.org, fetched 2010

Borland SideKick PIM / Personal Information Manager for DOS: included calendar, text editor, calculator, and address book / phone dialer. Over one million copies sold in first three years (starting 1983). Later development done by Starfish Internet Sidekick.

[Wikipedia10d] (*) en.wikipedia.org "Ken Knowlton", en.wikipedia.org, fetched 2010

Biography on Ken Knowlton: cites to patent 3,879,722 on automatically relabeled keys/button (soft button lables) by projection, graphical flip book from Freestyle at Wan, character/handwriting recognition with Jourjine

[Wikipedia10e] (*) en.wikipedia.org "Multi-Touch", en.wikipedia.org, fetched 2010

Review article on Muli-Touch: states that 1982 movie "Tron" shows Muli-Touch -- compare with Tog's movie?

[Wikipedia10f] (*) de.wikipedia.org "Gestenerkennung", de.wikipedia.org, fetched 2010

Wikipedia: Gesture recognition. Describes gesture as motion of human body, does not mention pen or tablet gestures. Also on www.spiegel.de

[Wikipedia10g] (*) en.wikipedia.org "Gesture", en.wikipedia.org, fetched 2010

Wikipedia: Gesture. Describes gesture as visible body actions communicate particular messages.

[Wikipedia10h] (*) en.wikipedia.org "Gesture Recognition", en.wikipedia.org, fetched 2010

Wikipedia: Defines gesture recognition as recognizing human (body motion) gestures, not PenPoint-type gestures.

[Wikipedia10i] (*) en.wikipedia.org "Pointing Device Gesture", en.wikipedia.org, fetched 2010

Wikipedia: Gesture for pen computing. States that "drag" was first gesture on apple Macintosh, involving motion while holding down mouse button.

[Wikipedia10j] (*) en.wikipedia.org "Pen computing", en.wikipedia.org, fetched 2010

Wikipedia: Pen computing -- contains (lengthy) historical notes going back to 19th century. direct manipulation/ handwriting recognition / gesture recognition. Absolute/relative pointing/locator input.

[Wikipedia10k] (*) en.wikipedia.org "Pie menu", en.wikipedia.org, fetched 2010

Wikipedia: Pie menu. Cites early references to pie meus to 1970s, as a gesture gestural user interface (similar to "drag" gesture?), makes assumptions about heirarchical menus and ability to chain multiple levels of menus.

[Wikipedia10l] (*) en.wikipedia.org "History of Microsoft Windows", en.wikipedia.org, fetched 2010

Wikipedia: Historical timeline of Microsoft Windows operating system. DOS addressing modes replaced with Windows 95. No mention of Windows for Pen Computing, or of Tablet PC. Comparison with OS/2.

[Wikipedia10m] (*) en.wikipedia.org "Windows CE 3.0", en.wikipedia.org, fetched 2010

Wikipedia: Windows CE 3.0 operating system ca. 2000 for palm-top pen computers, touchscreen digitizer. Reference has no information on gesture input. See also Windows

[WingfieldN09] (*) Wingfield, Nick "Notes for Tablet Aware Application Developers", Wall Street Journal, January 12, 2009

Mentions touch gestures on Windows 7 not working well, HP implementing alternatives

[WitternH09a] (*) Wittern, Hauke "Sketch Recognition", Colloquium of the Hochschule fuer Angewandte Wisstenschaften Hamburg, May 28, 2009

Review of Sketch Recognition, cites to ASSIST system (and video) from M.I.T. and to Sutherland Sketchpad. Research focus is multi-touch input for sketch recognition in programming tools.

Additional materials in electronic file

[WobbrockJO07a] (*) Wobbrock, Jacob O.; Chau, Duen Horng; and Myers, Brad A. "An Alternative to Push, Press, and Tap-tap-tap: Gesturing on an Isometric Joystick for Mobile Phone Text Entry", Procl CHI 2007, april 2007, San Jose, pp. 667-676

EdgeWrite unistroke/graffiti gesture/character recognition using joystick input, similar to approate for Tackball EdgeWrite. User moves to limits when making character, somewhat similar to zone-based recognition.

[WooYoung09] (*) Woo-Young, Kwak; Seung-Jun, Lee; and So-Young, Park "Scrolling method of mobile terminal", United States Patent Application 20090070711

Scrolling in mobile terminal, with feedback when the scrolling hits the last item of a menu list. Refers to flick gesture input, and to a graphical effect being displayed at the end of scrolling.

[WordNetWeb10a] (*) WordNetWeb "Stroke; Stylus", wordnetweb.princeton.edu, fetched Feb 2011

Definition of stroke

Definition of stylus

[Zeleznik08a] (*) Zeleznik, Robert; Bragdon, Andrew; Liu, Chu-Chi; and Forsberg, Andrew "Lineogrammer: Creating Diagrams by Drawing", Proc. UIST 08, pp. 161..170

Prettyfying graphical editor for line drawings: limited use of snap-to grid, heuristics to recognize drawings or text or gestures; double-circle / lasso gesture to select, pigtal lasso to delete (compare Scriboli), a GestureBar, scribble/scratch out, undo gestures similar to W4PC, zig-zag for zoom in / out, polilines, press-and-hold/dwell for panning. Uses timeout for distinguishing characters versus drawing. Supports overdrawing to connect disjoint lines. Vertex dragging.

[Zibreg09] (*) Zibreg, Christian "Apple's A-bomb against Palm: A 358 page iPhone patent", www.tgdaily.com, January 27, 2009

Reference to Palm Pre and Apple iPhone and unspecified patent claims concerning separate gesture area from display touchscreen in hand-held device

Main Reference Page