INTERACTIVE PAPER TECHNOLOGIES APPLICATIONS AND OPPORTUNITIES

Transcription

1 INTERACTIVE PAPER TECHNOLOGIES APPLICATIONS AND OPPORTUNITIES Nadir Weibel, DCog- HCI Lab Distributed and Human- Computer Lab University of California San Diego hkp://hci.ucsd.edu CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 1

2 The Myth of the Paperless Office > For decades, people predicted the office of the future as a paperless office The Office of the future I don't know how much hard copy printed paper I'll want in this world. George E. Pake, heads of Xerox PARC, 1975 The use of paper should be declining by Vincent E. Giuliano of Arthur D. LiKle, 1975 The last paper ediaon of The New York Times will appear in 2018 Dick Brass, vice- president of Technology Development at Microso_ Research, 2001 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 2

3 Paper Usage and Office increased 56% between 1996 and 2003 The EU Commission generates 83 pages of office paper per person per day The U.S. uses 4 million tons of copy paper annually A4 paper demand in Europe reached 5 million tons in 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 3

4 Integrate Paper and Digital Technologies "Rather than pursue the ideal of the paperless office, we should work toward a future in which paper and electronic document tools work in concert and organizaaonal processes make opamal use of both." Abigail Sellen and Richard Harper, The Myth of the Paperless Office, 2002 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 4

5 The Reading Machine This is a beauaful and ingenious machine, very useful and convenient for anyone who takes pleasure in study, especially those who are indisposed and tormented by gout. For with this machine a man can see and turn through a large number of books without moving from one spot. Moreover, it has another fine convenience in that it occupies very linle space in the place where it is set, as anyone of intelligence can clearly see from the drawing A. Ramelli. Le diverse et ar@ciose macchine del Capitano Agos@no Ramelli. Paris, 1588 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 5

6 Digital Desk Pierre Wellner, Xerox EuroParc 1992 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 6

7 Digital Desk: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 7

8 Electronic Paper Xerox Gyricon E- Ink XLibris Fujitsu E- Paper CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 8

9 Linking to CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 9

10 Encoding CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 10

11 Dataglyphs CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 11

12 Dataglyphs CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 12

13 Ink c) Pencil CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 13

14 Digital Pen and Paper Developed by Anoto Different pen manufacturers Logitech, Maxel, Nokia, Adapx, Livescribe... Pattern space 60 million km 2 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 14

15 Anoto PaKern CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 15

16 Paper Cross-Media Link Infrastructure Tools Publishing Applications CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 16

17 Paper Toolkits Paper Augmented Digital Documents PaperToolkit Hitachi JITInOffice ipaper / iserver CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 17

18 Paper Paper- based capturing of Digital Paper Bookmarks Pocket Pad Paper- Digital Document Paper Classroom Presenter Adapx CapturX ProofRite PaperProof PaperWeb Real- Time Capturing Generosa Enterprise Pointer Diamond s Edge DigiPost Paper Interfaces to Digital Applica@ons premote Hitachi ijitnote / ijitinoffice VoodooSketch / Shared Design Space Interac@ve Gigaprints ModelCra_ Rich Interac@ve Paper Applica@ons The Lost Cosmonaut Print- n- Link EdFest PaperPoint BuKerflyNet ModelCra_ CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 18

19 PaperPoint Tool Mobile tool Non- linear Paper- based Digital whiteboard pen support brainstorming Beat Signer, Nadir Weibel, Moira Norrie ETH Zurich, 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 19

20 PaperPoint Empty linked to specific PowerPoint slides Digital (text, image, movie,...) embedded in slides Mock- ups for paper CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 20

21 PaperPoint Architecture CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 21

22 BuKerflyNet Ron Yeh, ScoK Klemmer, Stanford 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 22

23 BuKerflyNet: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 23

24 EdFest Project N. Weibel, B. Signer, M. Grosniklaus, R. Beloq, C. L. Vukelija, M.Norrie, ETH Zurich, 2005 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 24

25 EdFest Documents CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 25

26 EdFest 2005 Flow CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 26

27 Channel Access Input Devices: Digital Pen GPS Sensors (weather, traffic, s, ) Voice (VoiceXML) Mul@ple Output Devices: Speech (VoiceXML) Browser (HTML) Paper (PDF) Mobile Phone (SMS) CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 27

28 EdFest Demo CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 28

29 EdFest: Where is on the map Find the on the map of a venue described in the event brochure CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 29

30 GigaPrints Ron Yeh, ScoK Klemmer, Stanford, 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 30

31 GigaPrints: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 31

32 ProofRite Kevin Conroy and François University of Maryland, 2004 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 32

33 ProofRite: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 33

34 PaperProof N. Weibel, B. Signer, A. Ispas, M. Norrie, ETH Zurich, 2008 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 34

35 Paper- Digital Proof- Tool Digital authoring of documents Proof- of digital documents on paper of paper- based edits CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 35

36 PaperProof Gestures- based Operation Gesture Delete or Replace or + ICR Insert or + ICR Move + + Range Annotation + + ICR Side Annotation or + ICR ICR = Intelligent Character Recogni@on CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 36

37 Shared Design Space Peter Brandl and Michael Haller, Upper Austria Univ. of Applied Sciences, 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 37

38 itable Pen-Based Google Earth Browser Pen-Based Drawing Tool Photo Browser Photo Browser (Slider) M. Geel, B. Signer, N. Weibel, M. Norrie, ETH Zurich, 2007 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 38

39 itable: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 39

40 FLY Pentop Computers Everything integrated into the pen Voice feedback on cartridges english to spanish translator calculator (draw interface)... CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 40

41 LiveScribe Pulse Smartpen Record and replay synchronised ink & audio 2/4 GB memory 32'000 / pages 200 / 400 hours recording 96x18 OLED Display Open applica@on plaxorm CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 41

42 HIPerPaper In with Prof. Falko Kuester: Calit2 Center of Graphics, and Virtual Reality CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 42

43 UbiSketch In with Prof. Bill Griswold: Computer Science and Engineering CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 43

44 Digital Ethnographer In with Prof. Ed Hutchins: Science CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 44

45 & Brain Dynamics In with Prof. ScoK Makeig: Swartz Center for Neuroscience CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 45

46 Exam: Tuesday 3/ In terms of format the final exam will be similar to the first exam. Our goal will be to emphasize the most important points from the textbook and lectures. Of course, somegmes one person s important point is another person s detail. Anne Marie will be available tomorrow Friday (11/12) from or 1-2 in DCOG- HCI Lab (SSRB Suite 100). SSRB is due west of Solis Hall. 100 is first door on the right if entering from the Solis side of the building. I will be available there on Monday (11/15) morning from Use the 120- instructors@hci.ucsd.edu if you have quesgons Grading Weekly posgngs (15%) we will drop your lowest score Assignments (15%) Hall of Fame/Shame 5% Contextual Interview 10% Exam 1 (20%) Exam 2 (20%) Final (30%) SecGon that covers material on exam 1 and 2 SecGon that covers material since exam2

47 Future of HCI and Issues In terms of HCI no moment in history has been more excigng and perhaps more dangerous What will the future hold? Where is the momentum taking us? Jesse Schell s Beyond Facebook talk: the future of games (see link onpprofessorhollan.blogspot.com) What do you want the future to be? Should we just go where the momentum is taking us? Who is driving? Are commercial interests going to take us were we want to or should go? What has been driving interface design in the recent past? Web and networks ConnecGng you everywhere: cell phone and small display Disappearing boundaries (work/ home/social/play real/virtual What about the future? What are important issues and drivers? Web and network Everything in the cloud Privacy issues Maybe movement to large displays MulGmodal embodied interacgon Sensors everywhere Things talking to things

48 Future of HCI and Issues Increasing quangty rather than quality feature lists for applicagons consider the word processor consider informagon: more or higher quality How to focus on and aid increasing quality? Search engines have been a another driving force One view is that this involves subtracgng informagon: finding specific documents or facts What about increasing the quality and diversity of informagon and seeing mulgple perspecgves If this is the informagon age what are we so well- informed about? What do you know about that your parents didn t when they were your age? One answer is that you know about NOW: what your friends are doing, where they are, what is current Does the flood of informagon about now shut out the past and the future? Can the technology also aid us in reflecgng and thinking about both the past and the future? What can we do now to help ensure our children and future generagons prosper You have a wonderful opportunity to help ensure systems and interfaces help us to be befer people, thinking befer thoughts, and communicate befer with other people