INTERACTIVE PAPER TECHNOLOGIES APPLICATIONS AND OPPORTUNITIES Nadir Weibel, weibel@ucsd.edu DCog- HCI Lab Distributed Cogni@on and Human- Computer Interac@on Lab University of California San Diego hkp://hci.ucsd.edu CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 1
The Myth of the Paperless Office > For decades, people predicted the office of the future as a paperless office The Office of the future I don't know how much hard copy printed paper I'll want in this world. George E. Pake, heads of Xerox PARC, 1975 The use of paper should be declining by 1980. Vincent E. Giuliano of Arthur D. LiKle, 1975 The last paper ediaon of The New York Times will appear in 2018 Dick Brass, vice- president of Technology Development at Microso_ Research, 2001 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 2
Paper Usage and Consump@on Office prin@ng increased 56% between 1996 and 2003 The EU Commission generates 83 pages of office paper per person per day The U.S. uses 4 million tons of copy paper annually A4 paper demand in Europe reached 5 million tons in 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 3
Integrate Paper and Digital Technologies "Rather than pursue the ideal of the paperless office, we should work toward a future in which paper and electronic document tools work in concert and organizaaonal processes make opamal use of both." Abigail Sellen and Richard Harper, The Myth of the Paperless Office, 2002 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 4
The Reading Machine This is a beauaful and ingenious machine, very useful and convenient for anyone who takes pleasure in study, especially those who are indisposed and tormented by gout. For with this machine a man can see and turn through a large number of books without moving from one spot. Moreover, it has another fine convenience in that it occupies very linle space in the place where it is set, as anyone of intelligence can clearly see from the drawing A. Ramelli. Le diverse et ar@ciose macchine del Capitano Agos@no Ramelli. Paris, 1588 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 5
Digital Desk Pierre Wellner, Xerox EuroParc 1992 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 6
Digital Desk: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 7
Electronic Paper Xerox Gyricon E- Ink XLibris Fujitsu E- Paper CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 8
Linking to Informa@on CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 9
Encoding Informa@on CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 10
Dataglyphs CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 11
Dataglyphs CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 12
Conduc@ve Ink c) Conduc@ve Pencil CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 13
Digital Pen and Paper Developed by Anoto Different pen manufacturers Logitech, Maxel, Nokia, Adapx, Livescribe... Pattern space 60 million km 2 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 14
Anoto PaKern CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 15
Interac@ve Paper Cross-Media Link Infrastructure Tools Publishing Applications CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 16
Interac@ve Paper Toolkits Paper Augmented Digital Documents PaperToolkit Hitachi JITInOffice ipaper / iserver CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 17
Interac@ve Paper Applica@ons Paper- based capturing of Annota@ons Digital Paper Bookmarks Pocket Pad Paper- Digital Document Cohabita@on Paper Classroom Presenter Adapx CapturX ProofRite PaperProof PaperWeb Real- Time Capturing Generosa Enterprise Pointer Diamond s Edge DigiPost Paper Interfaces to Digital Applica@ons premote Hitachi ijitnote / ijitinoffice VoodooSketch / Shared Design Space Interac@ve Gigaprints ModelCra_ Rich Interac@ve Paper Applica@ons The Lost Cosmonaut Print- n- Link EdFest PaperPoint BuKerflyNet ModelCra_ CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 18
PaperPoint Presenta@on Tool Mobile presenta@on tool Non- linear presenta@ons Paper- based real- @me annota@ons Digital whiteboard Mul@- pen support brainstorming Beat Signer, Nadir Weibel, Moira Norrie ETH Zurich, 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 19
PaperPoint S@ckers Empty S@ckers linked to specific PowerPoint slides Digital informa@on (text, image, movie,...) embedded in slides Mock- ups for interac@ve paper applica@ons CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 20
PaperPoint Architecture CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 21
BuKerflyNet Ron Yeh, ScoK Klemmer, Stanford 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 22
BuKerflyNet: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 23
EdFest Project N. Weibel, B. Signer, M. Grosniklaus, R. Beloq, C. Decur@ns, L. Vukelija, M.Norrie, ETH Zurich, 2005 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 24
EdFest Documents CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 25
EdFest 2005 Informa@on Flow CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 26
Mul@- Channel Access Mul@ple Input Devices: Digital Pen GPS Sensors (weather, traffic, emails, ) Voice (VoiceXML) Mul@ple Output Devices: Speech (VoiceXML) Browser (HTML) Paper (PDF) Mobile Phone (SMS) CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 27
EdFest Demo CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 28
EdFest: Where is on the map Find the posi@on on the map of a venue described in the event brochure CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 29
Interac@ve GigaPrints Ron Yeh, ScoK Klemmer, Stanford, 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 30
Interac@ve GigaPrints: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 31
ProofRite Kevin Conroy and François Guimbre@ère, University of Maryland, 2004 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 32
ProofRite: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 33
PaperProof N. Weibel, B. Signer, A. Ispas, M. Norrie, ETH Zurich, 2008 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 34
Paper- Digital Proof- Edi@ng Tool Digital authoring of documents Proof- edi@ng of digital documents on paper Automa@c integra@on of paper- based edits CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 35
PaperProof Gestures- based Opera@ons Operation Gesture Delete or Replace or + ICR Insert or + ICR Move + + Range Annotation + + ICR Side Annotation or + ICR ICR = Intelligent Character Recogni@on CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 36
Shared Design Space Peter Brandl and Michael Haller, Upper Austria Univ. of Applied Sciences, 2006 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 37
itable Pen-Based Google Earth Browser Pen-Based Drawing Tool Photo Browser Photo Browser (Slider) M. Geel, B. Signer, N. Weibel, M. Norrie, ETH Zurich, 2007 CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 38
itable: Video CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 39
FLY Pentop Computers Everything integrated into the pen Voice feedback Applica@ons on cartridges english to spanish translator calculator (draw interface)... CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 40
LiveScribe Pulse Smartpen Record and replay synchronised ink & audio 2/4 GB memory 32'000 / 64 000 pages 200 / 400 hours recording 96x18 OLED Display Open applica@on plaxorm CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 41
IPaper@UCSD: HIPerPaper In Collabora@on with Prof. Falko Kuester: Calit2 Center of Graphics, Visualiza@on and Virtual Reality CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 42
ipaper@ucsd: UbiSketch In Collabora@on with Prof. Bill Griswold: Computer Science and Engineering CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 43
ipaper@ucsd: Digital Ethnographer In Collabora@on with Prof. Ed Hutchins: Cogni@ve Science CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 44
ipaper@ucsd: Wri@ng & Brain Dynamics In Collabora@on with Prof. ScoK Makeig: Swartz Center for Computa@onal Neuroscience CogSci120 March 9 th /11 th 2010 Nadir Weibel weibel@ucsd.edu 45
Exam: Tuesday 3/16 8-11 In terms of format the final exam will be similar to the first exam. Our goal will be to emphasize the most important points from the textbook and lectures. Of course, somegmes one person s important point is another person s detail. Anne Marie will be available tomorrow Friday (11/12) from 11-12 or 1-2 in DCOG- HCI Lab (SSRB Suite 100). SSRB is due west of Solis Hall. 100 is first door on the right if entering from the Solis side of the building. I will be available there on Monday (11/15) morning from 10-12. Use the 120- instructors@hci.ucsd.edu email if you have quesgons Grading Weekly posgngs (15%) we will drop your lowest score Assignments (15%) Hall of Fame/Shame 5% Contextual Interview 10% Exam 1 (20%) Exam 2 (20%) Final (30%) SecGon that covers material on exam 1 and 2 SecGon that covers material since exam2
Future of HCI and Issues In terms of HCI no moment in history has been more excigng and perhaps more dangerous What will the future hold? Where is the momentum taking us? Jesse Schell s Beyond Facebook talk: the future of games (see link onpprofessorhollan.blogspot.com) What do you want the future to be? Should we just go where the momentum is taking us? Who is driving? Are commercial interests going to take us were we want to or should go? What has been driving interface design in the recent past? Web and networks ConnecGng you everywhere: cell phone and small display Disappearing boundaries (work/ home/social/play real/virtual What about the future? What are important issues and drivers? Web and network Everything in the cloud Privacy issues Maybe movement to large displays MulGmodal embodied interacgon Sensors everywhere Things talking to things
Future of HCI and Issues Increasing quangty rather than quality feature lists for applicagons consider the word processor consider informagon: more or higher quality How to focus on and aid increasing quality? Search engines have been a another driving force One view is that this involves subtracgng informagon: finding specific documents or facts What about increasing the quality and diversity of informagon and seeing mulgple perspecgves If this is the informagon age what are we so well- informed about? What do you know about that your parents didn t when they were your age? One answer is that you know about NOW: what your friends are doing, where they are, what is current Does the flood of informagon about now shut out the past and the future? Can the technology also aid us in reflecgng and thinking about both the past and the future? What can we do now to help ensure our children and future generagons prosper You have a wonderful opportunity to help ensure systems and interfaces help us to be befer people, thinking befer thoughts, and communicate befer with other people