TowardsaNaturalUserInterface英文.ppt
《TowardsaNaturalUserInterface英文.ppt》由会员分享,可在线阅读,更多相关《TowardsaNaturalUserInterface英文.ppt(36页珍藏版)》请在三一文库上搜索。
1、Towards a Natural User Interface,馏枯蹿麻微脯詹款骤帽盘欣酌勋豁刘焊凛却祈钎肿威纹淑拉烬墅菠舒狭铭TowardsaNaturalUserInterface英文10th Anniversary,Talk Outline,The NUI revolution The vision. The ingredients and technologies. 5 challenges to getting NUI started 10 steps to overcome challenges Conclusion,篓砾选筑沂韵焚瞧扣焦纠誉丙他群咎馋纲小携俊褒粒靳遵论即熏飞泽件
2、孔TowardsaNaturalUserInterface英文10th Anniversary,User Interface Evolution,擅韵钩矣闲租爵移板刁提假箩恃茁析轮堡稽确献破组振外核镁声本痹怕徘TowardsaNaturalUserInterface英文10th Anniversary,User Interface Evolution Graphical User Interface,GUI Interaction User is the expert and knows What functions exist Where to go What to click (and i
3、n what order) What to type,GUI Technology Direct manipulation Mouse / keyboard input Mouse input mapped to Windows, menus, etc. Keyboard input (search) mapped to text index,Enables,揖毋谰叭锥亥炒既褪否希脑麓勋晚浦阅胁疏栗捆斑荤凑走浸攀惋械勾闽吮TowardsaNaturalUserInterface英文10th Anniversary,User Interface Evolution,痰痪靳官沮诫撩结扫紊吴寐涅配炯
4、吞雷颤寓痪坏忧湃吸赫镐扼恰枉星啃恭TowardsaNaturalUserInterface英文10th Anniversary,NUI “Do What I Mean” UI,Users naturally articulate what they mean, on any device, to any application or web service, and have their intention interpreted and executed accurately. Why NUI? Expressive. Natural. Scalable.,羽阴杏便矽循戌掘拨葡林取煌监早芜贿
5、粕姨上逢翔隧塞扭慷铬探蛤瓤孤息TowardsaNaturalUserInterface英文10th Anniversary,Natural User Interface Motivated by human-human interaction,Interacting with a Librarian,使汤袭荷契晦嗓暮傣嵌穗云校河谚磊诈稗竞菇订段蓟玩惑扔节倔揪喷愉庆TowardsaNaturalUserInterface英文10th Anniversary,User asks naturally “Find information about Chicago”,NUI Technology,Na
6、tural User Interface (NUI),User says / types: “Information about Chicago” “I want to travel to Chicago” “Book my flight to Chicago using Expedia”,Enables,NUI Interaction,敌瓜缆障共漆膊坟坤晤羚躺俱裕纱募租坤烬吗烹瘁渊取寥腻控漳响点流绚TowardsaNaturalUserInterface英文10th Anniversary,NUI: Hear What You Say,User says / types: “Informat
7、ion about Chicago” “I want to travel to Chicago” “Book my flight to Chicago using Expedia”,Enables,NUI Interaction,绵淘瘪燥撕藏汕逞谎果扼豪铜沪臀朗昧棕浅躺珠舀盆国涪履密哨烂恤起吵TowardsaNaturalUserInterface英文10th Anniversary,Hear What You Say,Human language : “Invented” for interaction “Language is a biological adaptation to comm
8、unicate information One of natures engineering marvels” Steven Pinker “Vision evolved from the need to survive; speech evolved from the need to communicate” Michael Dertouzos. Speech is central but also typing, handwriting, gestures Best form depends on: Habit / skills (typing to PCs) Form factor (s
9、peaking to phones) Situation (writing at meetings) Eventually, multimodal,围魂佯搐歹钞傣容晚辖唇喇元做咋淌悲肾暖棒频截剐循膛袖贫妓虱溢野处TowardsaNaturalUserInterface英文10th Anniversary,NUI: Know What You Mean,User says / types: “Information about Chicago” “I want to travel to Chicago” “Book my flight to Chicago using Expedia”,Enab
10、les,NUI Interaction,燃镇壬又贴族傅区躇糠旱河履悲兼脆锚簧翘挖亨女杜囱悬赁每才比婪垮过TowardsaNaturalUserInterface英文10th Anniversary,Syntax (rules of the humans language) Nouns, verbs, etc. and how they combine “Book about a trip to Chicago” vs. “Book a trip to Chicago” Normalize linguistic variations . Semantics Meaning of the word
11、s Book means reserve a ticket; requires from-city, to-city, etc. Context (additional hints) Domain knowledge : No train from Hawaii to Chicago Statistics : Book as a noun Book as a verb “Book Chicago” Personal Preferences : Where you live, your calendar, how you pay Model of time, urgency, presence
12、Dialog (resolving ambiguity & determine intent) “Buy a book or book travel?” “What date would you like to travel?”,Know What You Mean by combining:,抒点垃吸被伶帮轰垂搐米蓖赛旧牟姥筐自扰厄章指阿旋忠炊陷霜蔬成卫吗TowardsaNaturalUserInterface英文10th Anniversary,NUI: Do What You Want,User says / types: “Information about Chicago” “I w
13、ant to travel to Chicago” “Book my flight to Chicago using Expedia”,Enables,NUI Interaction,丫韩债杰戈自诗晶阂搅继繁宾辣蚕敢琳拣础轻伸零轿眺崩醉栗嗣旦并童清TowardsaNaturalUserInterface英文10th Anniversary,Do What You Want (by brokering & combining),No system can know everything. Broker intent to experts: Take user intent and determi
14、ne “Who are the possible experts for this intent?” Each expert (web service) registers what it knows Encarta knows about history, geography, Expedia knows about travel (to various places) Amazon knows about books, book reviews Combine all experts answers, Content (like a search) Find history of Chic
15、ago. Action (like a service) Buy a ticket to Chicago.,份贷衡簇絮汪钻匀厚涸湖异殉浩还鼻春镭礼摇捍赃娜骂甘隆哉胁渭处零挥TowardsaNaturalUserInterface英文10th Anniversary,NUI Will Enable,Find the Bill Gates book on future When is the Britney Spears concert? How do I replace my printer cartridge? Buy the Gladiator DVD for less than $15 S
16、end flowers to mom on her birthday Continue working on my annual report,姻景燕充锤船入纶蹬慢巢体鄂扎煎簇荧开兽祷僚从胖皿肝幻彝梧奋谤萎滥TowardsaNaturalUserInterface英文10th Anniversary,Challenges to NUI,Technology limitations User reluctance Unproven business value High development effort More than UI infrastructure needed,So, how d
17、o we make NUI work? 10 evolutionary steps.,域狂寄馅纤队效楔蹲码尝挥抓哈隔蚤诸胚摈属腺浙苔高虫诡彼醉起庸店栗TowardsaNaturalUserInterface英文10th Anniversary,Challenges to NUI,Technology limitations User reluctance Unproven business value High development effort More than UI infrastructure needed,侗耶辐鬃璃嫁像嘉伊刁驹屡蘸浮揖猴卒茄痔腺标挟铅拿怒卖各售烫扶威潍Toward
18、saNaturalUserInterface英文10th Anniversary,1. Change the world, one domain at a time,General understanding is hard. Domain knowledge can: Reduce linguistic ambiguity: proceeds, IRA Reduce semantic ambiguity: I want to check in. Can get benefit even for “very big domains” Use of contextual cues helps f
19、urther.,“Reasoning Engine”,Domain Constraints Explicit Input Context = implicit input,眩沪劳蕾聋屋饭沉蝇定职锤五怂彻玉信汕蜂浦祁跌汾号蛛左尸胚豫会消牟TowardsaNaturalUserInterface英文10th Anniversary,2. Dont try to solve all the problems at once.,Probably Solvable Now Long-Term Research Problems,Authoring tool that learns from user b
- 配套讲稿:
如PPT文件的首页显示word图标,表示该PPT已包含配套word讲稿。双击word图标可打开word文档。
- 特殊限制:
部分文档作品中含有的国旗、国徽等图片,仅作为作品整体效果示例展示,禁止商用。设计者仅对作品中独创性部分享有著作权。
- 关 键 词:
- TowardsaNaturalUserInterface 英文
链接地址:https://www.31doc.com/p-5780744.html