home

 
The Interface Ecology Lab investigates the future of human expression, focusing on creativity, play, participation, and education. We develop interdisciplinary research and education from our home in the Texas A&M Department of Computer Science and Engineering.
7/2014  PI Andruid Kerne presents at Microsoft Research, Embodying Ideation and Play.
6/2014  The Interface Ecology Lab publishes a foundational method for how to study creativity support environments, Using Metrics of Curation to Evaluate Information-based Ideation, in the premier journal, ACM Transactions on Computer-Human Interaction (ToCHI).
3/2014  The Interface Ecology Lab releases TweetBubble, a free and open source Chrome extension that helps users explore social media network connections in Twitter.

IdeaMÂCHÉ
IdeaMÂCHÉ is a web browser and cloud-based creativity support tool that uses information composition as a medium of curation. Curation is the process of assembling information in meaningful exhibits, for people to think about. Curation involges finding, choosing, collecting, arranging, annotating and synthesizing information to connect and form ideas. In IdeaMÂCHÉ, users gather clippings, which automatically become enriched with metadata and so are represented as rich bookmarks. The metadata includes descriptions and images, as well as authors, categories, and citations of articles and patents, and price, ratings and bestseller rankins of products from vendors such as Amazon and HomeDepot. Expressive operations on clippings can create a visual sense of connectedness among curated elements.

publications + exhibits
Kerne, A., Webb, A.M., Smith, S.M., Linder, R., Lupfer, N., Qu, Y., Moeller, J., Damaraju, S., Using Metrics of Curation to Evaluate Information-based Ideation , ACM Transactions on Computer-Human Interaction (ToCHI), 21(3), June 2014, 48 pages. http://dx.doi.org/10.1145/2591677
Qu, Y., Kerne, A., Lupfer, N., Linder, R., Jain, A., Metadata Type System: Integrate Presentation, Data Models and Extraction to Enable Exploratory Browsing Interfaces, Proc. ACM Engineering Interactive Computing Systems (EICS) 2014, 107-116 [18%]. http://dx.doi.org/10.1145/2607023.2607030
Hamilton, W., Garretson, O., and Kerne, A. Streaming on Twitch: Fostering Participatory Communities of Play within Live Mixed Media, Proc. CHI 2014, 1315-1324 [23%]. http://dx.doi.org/10.1145/2556288.2557048
Linder, R., Snodgrass, C., and Kerne, A. Everyday Ideation: All of My Ideas Are On Pinterest, Proc. CHI 2014, 2411-2420 [23%]. http://dx.doi.org/10.1145/2556288.2557273
Webb, A.M. and Kerne, A., Embodying Diagramming through Pen + Touch Gestures, CHI 2014 Workshop: Gesture Interaction Design: Communication and Cognition, Toronto, Canada.
Webb, A.M., Kerne, A., Linder, R., Lupfer, N., Qu, Y., Keith, K., Carrasco, M., Multi-Scale Information Composition: a New Medium for Freeform Art Curation in the Cloud, CHI 2014 Workshop: Curating the Digital: Spaces for Art and Interaction, Toronto, Canada, April 2014.
Fischer, J.E., Jiang, W., Kerne, A., Greenhalgh, C., Ramchurn, S.D., Reece,S., Pantidi, N., Rodden, T., Supporting Team Coordination on the Ground: Requirements from a Mixed-Reality Game, Proc. Design of Cooperative Systems (COOP) 2014, 49-67 [42%]. http://dx.doi.org/10.1007/978-3-319-06498-7_4
Fei, S., Webb, A.M., Kerne, A., Qu, Y., and Jain, A., Peripheral Array of Tangible NFC Tags: Positioning Portals for Embodied Trans-Surface Interaction, Proc. ACM Interactive Tabletops and Surfaces 2013 [29%]. http://dx.doi.org/10.1145/2512349.2512820 [video]
Webb, A.M., Linder, R., Kerne, A., Lupfer, N., Qu, Y., Poffenberger, B., and Revia, C., Promoting Reflection and Interpretation in Education: Curating Rich Bookmarks as Information Composition, Proc. Creativity and Cognition 2013, 53-62 [32%].
Kerne, A., Latulipe, C., Drucker, S.M., Candy, L., Höök, K., Webb, A.M., and Carroll, E. Evaluation methods for creativity support environments, Proc CHI 2013 Extended Abstracts, 3295-3298. http://dx.doi.org/10.1145/2468356.2479670
Linder, R., Webb, A.M., and Kerne, A., Searching to Measure the Novelty of Collected Ideas, CHI 2013 Evaluation Methods for Creativity Support Environments Workshop, Paris, France, May 2013.
Damaraju, S., Seo, J.H., Hammond, T., Kerne, A., Multi-tap sliders: advancing touch interaction for parameter adjustment, Proc IUI 2013, 445-452 [22%]. http://dx.doi.org/10.1145/2468356.2479670
Hamilton, W., Kerne, A., and Robbins, T., High-Performance Pen + Touch Modality Interactions: A Real-Time Strategy Game eSports Context, Proc. UIST 2012, Cambridge, MA, USA, OCT 2012.
Moeller, J. and Kerne, A., ZeroTouch: An Optical Multi-Touch and Free-Air Interaction Architecture, Proc. CHI 2012, 2165-2174 [23%]. Best Paper Honorable Mention. http://dx.doi.org/10.1145/2207676.2208368 [video]
Hamilton, W., Kerne, A., and Moeller, J. Pen-in-Hand Command: NUI for Real-Time Strategy eSports, CHI 2012 Video Showcase, Austin, TX, May 2012. In Ballroom D Tuesday: 11:30 - 12:50; 7 pm - 8:30.
Webb, A.M. and Kerne, A., Creative Visual Thinking through Information Composition + Diagramming, CHI 2012 Visual Thinking & Digital Imagery Workshop, Austin, TX, USA, May 2012.
Linder, R. and Kerne, A., Using Information Composition to Represent Connections Among Events Across Time and Place, CHI 2012 Workshop on Heritage Matters: Designing for current and future values through digital and social technologies.
Toups, Z. O., Kerne, A., Hamilton, W. A. The Team Coordination Game: A zero-fidelity simulation abstracted from fire emergency response work practice, ACM Transactions on Computer-Human Interaction (ToCHI) 18, 4, 2011, 37 pages. DOI:10.1145/2063231.2063237
Kerne, A., Hamilton, W., Toups, Z., Culturally Based Design: Embodying Trans-Surface Interaction in Rummy, Proc CSCW 2012, 509-518 [top 9%]. http://dx.doi.org/10.1145/2145204.2145284
Damaraju, S., Kerne, A., Comparing Multi-Touch Interaction Techniques for Manipulation of an Abstract Parameter Space, Proc. International Conference on Multimodal Interaction (ICMI) 2011, 221-224 [39%]. http://dx.doi.org/10.1145/2070481.2070520
Qu, Y., Kerne, A., Webb, A.M., Herstein, A. Interoperable Metadata Semantics with Meta-Metadata: A Use Case Integrating Search Engines. Proc ACM DocEng 2011, 171-174 [53%]. http://dx.doi.org/10.1145/2034691.2034729
Toups, Z. O., Hamilton, W. A., Kerne, A. Zero-fidelity simulation: Engaging team coordination without physical, functional, or psychological re-creation, Proc. MODSIM World 2011, 451–459.
Webb, A.M., Kerne, A. Integrating Implicit Structure Visualization with Authoring Promotes Ideation, Proc Joint ACM/IEEE Conf on Digital Libraries (JCDL), June 13–17, 2011, Ottawa, Canada.
Moeller, J., Lupfer, N., Hamilton, B., Lin, H., Kerne, A., intangibleCanvas: Free-Air Finger Painting on a Projected Canvas , Proc CHI 2011 EA, 1165-1170 [46%]. http://dx.doi.org/10.1145/1979742.1979817
Moeller, J. and Kerne, A., ZeroTouch: A Zero-Thickness Optical Multi-Touch Force Field, Interactivity Exhibit, Proc CHI 2011 EA, 1165-1170 [46%]. http://dx.doi.org/10.1145/1979742.1979710 [video]
Toups, Z.O., Kerne, A., Hamilton, W. A., Shahzad, N. Zero-Fidelity Simulation of Fire Emergency Response: Improving Team Coordination Learning, Proc CHI 2011, 1959–1968 [26%]. http://dx.doi.org/10.1145/1978942.1979226
Kerne, A., Qu, Y., Webb, A.M., Damaraju, S., Lupfer, N., Mathur, A. Meta-Metadata: A Metadata Semantics Language for Collection Representation Applications, Proc ACM Conference on Information and Knowledge Management (CIKM), 1129-1138 [12.7%]. http://dx.doi.org/10.1145/1871437.1871580
Moeller, J., Kerne, A., Scanning FTIR: Unobtrusive Multi-Touch Sensing through Waveguide Transmissivity Imaging, Proc ACM Tangible, Embedded and Embodied Interaction (TEI) 2010, 73-76 [34%]. http://dx.doi.org/10.1145/1709886.1709900
Koh, E., Kerne, A., Deriving Image-Text Document Surrogates to Optimize Cognition, Proc ACM DocEng 2009, 84-93 [29.6%]. http://dx.doi.org/10.1145/1600193.1600212
Koh, E., Kerne, A., Berry, S., Test Collection Management and Labeling System, Proc ACM DocEng 2009, 39-42 [29.6%]. http://dx.doi.org/10.1145/1600193.1600203
Toups, Z. O., Kerne, A., Hamilton, W. Game Design Principles for Engaging Cooperative Play: Core Mechanics and Interfaces for Non-Mimetic Simulation of Fire Emergency Response, Proc ACM SIGGRAPH Symposium on Games 2009, 71-78 [30%] http://dx.doi.org/10.1145/1581073.1581085
Toups, Z. O., Kerne, A., Hamilton, W., Blevins, A. Emergent Team Coordination: From Fire Emergency Response Practice to a Non-Mimetic Simulation Game, Proc ACM Group 2009, 341‐350 [36%]. http://dx.doi.org/10.1145/1531674.1531725
Hamilton, W., Toups, Z. O., Kerne, A. Synchronized Communication and Coordinated Views: Qualitative Data Discovery for Team Game User Studies, Proc CHI Extended 2009, DOI:10.1145/1520340.1520702
Toups, Z. O., Kerne, A., Hamilton, W. Motivating Play through Score, ACM CHI 2009 Workshop on Engagement by Design.
Kerne, A., Koh, E., Smith, S. M., Webb, A., Dworaczyk, B., combinFormation: Mixed-Initiative Composition of Image and Text Surrogates Promotes Information Discovery , ACM Transactions on Information Systems (TOIS), 27(1), Dec. 2008, 5:1-45. http://dx.doi.org/10.1145/1416950.1416955
Kerne, A., Damaraju, S., Kumar, B., and Webb, A. Meta-Metadata: A Semantic Architecture for Multimedia Metadata Definition, Extraction, and Presentation, Poster and Demo Proc International Conf on Semantic and Digital Media Technologies (SAMT) 2008.
Damaraju, S., Kerne, A. Multitouch Gesture Learning and Recognition System, Extended Abstracts of IEEE Workshop on Tabletops and Interactive Surfaces 2008.
Kerne, A., Toups, Z.O., Dworaczyk, B., Khandelwal, M. A Concise XML Binding Framework Facilitates Practical Object-Oriented Document Engineering , Proc ACM Symposium on Document Engineering (DocEng) 2008, 62-65 [43%]. http://dx.doi.org/10.1145/1410140.1410152
Kerne, A., Smith, S.M., Koh, E., Choi, H., Graeber, R., An Experimental Method for Measuring the Emergence of New Ideas in Information Discovery, International Journal of Human-Computer Interaction (IJHCI), 24 (5) July 2008, 460-477. http://dx.doi.org/10.1080/10447310802142243
Webb, A., Kerne, A. The In-Context Slider: A Fluid Interface Component for Visualization and Adjustment of Values while Authoring, Proc ACM Advanced Visual Interfaces (AVI) 2008, 91-99, [27.5%]. http://dx.doi.org/10.1145/1385569.1385586/a>
Toups, Z. O., Kerne, A., Implicit Coordination in Firefighting Practice: Design Implications for Teaching Fire Emergency Responders, Proc CHI 2007, 277-286 [25%]. http://dx.doi.org/10.1145/1240624.1240734
Kerne, A., Koh, E., Representing Collections as Compositions to Support Distributed Creative Cognition and Situated Creative Learning, New Review of Hypermedia and Multimedia (NRHM), 13(2) Dec 2007, 135-162. http://dx.doi.org/110.1080/13614560701711859
Kerne, A., Koh, E., Smith, S.M., Choi, H., Graeber, R., Webb., A., Promoting Emergence in Information Discovery by Representing Collections with Composition, Proc ACM Creativity and Cognition 2007, 117-126 [23%]. http://dx.doi.org/10.1145/1254960.1254977
Koh, E., Kerne, A., Webb, A., Damaraju, S., Sturdivant, D., Generating Views of the Buzz: Browsing Popular Media and Authoring using Mixed-Initiative Composition, Proc ACM Multimedia 2007, 228-237 [19%]. http://dx.doi.org/110.1145/1291233.1291282
Koh, E., Caruso, D., Kerne, A., Gutierrez-Osuna, R., Elimination of Junk Document Surrogate Candidates through Pattern Recognition, Proc ACM Symposium on Document Engineering (DocEng) 2007, 187-195 [39%]. http://dx.doi.org/110.1145/1284420.1284466
Webb, A., A Transitory Interface Component for the In-Context Visualization and Adjustment of a Value , M.S. thesis, Texas A&M University, August 2007.
Koh, E., Kerne, A., Hill, R., Creativity Support: Information Discovery and Exploratory Search, Proc SIGIR 2007, 895-896. http://dx.doi.org/110.1145/1277741.1277963
Kerne, A., Koh, E., Creativity support: the mixed-initiative composition space, Proc Joint ACM/IEEE Conf. on Digital Libraries (JCDL), 509-509.
Koh, E., Kerne, A., combinFormation: Exploring Multiple Searches Together through the Mixed-Initiative Composition Space, CHI 2007 Workshop on Exploratory Search and HCI, San Jose, California [24%].
Toups, Z. O., Kerne, A., Location-Aware Augmented Reality Gaming for Emergency Response Education: Concepts and Development, CHI 2007 Workshop on Mobile Spatial Interaction, San Jose, California.
Kerne, A., Koh, E., Dworaczyk, B., Mistrot, J.M., Choi, H., Smith, S., Graeber, R., Caruso, D., Webb, A., Hill, R., Albea, J., combinFormation: A Mixed-Initiative System for Representing Collections as Compositions of Image and Text Surrogates,
Proc Joint ACM/IEEE Conf. on Digital Libraries (JCDL) 2006, 11-20 [23%]. http://dx.doi.org/110.1145/1141753.1141756
Webb, A., Kerne, A., Koh, E., Joshi, P., Park, Y., Graeber, R., Choreographic Buttons: Promoting Social Interaction through Human Movement and Clear Affordances, Proc ACM Multimedia 2006.
Graeber, R., Kerne, A., Henderson, K., ZooMICSS: a zoomable map image collection sensemaking system (the Katrina Rita context), Proc ACM Multimedia 2006, 795-796 [37%]. http://dx.doi.org/110.1145/1180639.1180813
Toups, Z. O., Graeber, R., Kerne, A., Tassinary, L., Berry, S., Overby, K., Johnson, M., A Design for Using Physiological Signals to Affect Team Game Play, Proc Augmented Cognition International 2006.
Koh, E., Kerne, A., I Keep Collecting: College Students Build and Utilize Collections in Spite of Breakdowns, Proc European Conf on Digital Libraries (ECDL) 2006, 303-314 [27%]. http://dx.doi.org/10.1007/11863878_26
Kerne, A., Koh, E., Choi, H., Dworaczyk, B., Smith, S.M., Hill, R., Albea, J., Supporting Creative Learning Experience with Compositions of Image and Text Surrogates, Proc Ed Media 2006.
Alley, E., Cooper, T., Graeber, R., Kerne, A., Overby, K., Toups, Z., Censor Chair: Exploring Censorship and Social Presence through Psychophysiological Sensing, Proc ACM Multimedia 2005, 922-929 [16%]. http://dx.doi.org/10.1145/1101149.1101345
Stenner, J., Kerne, A., Williams, Y., Playas: Homeland Mirage, ISEA/Zero One, Aug 2006, San Jose.
Stenner, J., Kerne, A., Williams, Y., Playas: Homeland Mirage, Proc ACM Multimedia 2005, 1057-1058 [28%]. http://dx.doi.org/10.1145/1101149.1101375
Kerne, A., doing interface ecology: the practice of metadisciplinarity, Proc SIGGRAPH Art and Animation, 181-185 [20%]. http://dx.doi.org/10.1145/1086057.1086144
Kerne, A., Koh, E., Sundaram, V., Mistrot, J.M., Generative semantic clustering in spatial hypertext, Proc ACM Document Engineering (DocEng) 2005, 84-93 [30%]. http://dx.doi.org/10.1145/1096601.1096624
Kerne, A., Smith, S.M., Choi, H., Graeber, R., Caruso, D., Evaluating Navigational Surrogate Formats with Divergent Browsing Tasks, Proc CHI 2005 Extended, 1537-1540. http://dx.doi.org/10.1145/1056808.1056960
Kerne, A., Mistrot, J.M., Khandelwal, M.,Sundaram, V., Koh, E., Using Composition to Re-Present Personal Collections of Hypersigns, Proc Computational Semiotics in Games and New Media (CoSIGN) 2004, Split, Croatia.


Thanks for support provided by the National Science Foundation.