home

 
The Interface Ecology Lab develops human-centered creative and expressive computing. We imagine and explore new relationships among people and technology. We develop interdisciplinary research and education amidst the Texas A&M Department of Computer Science and Engineering. We mash-up disciplines, methods, concepts, and media, taking an interface ecosystems approach.
5/2011  We exhibited the ZeroTouch sensor, with new hand+pen-in-hand interaction and the free-air intangibleCanvas, at the ACM CHI Conference in Vancouver.
ZeroTouch featured on The Today Show and beyond by international press:
Time, MSNBC, Discovery News, Popular Science, PC World, New Scientist, Slashdot, Engadget, Gizmodo, InRumor.com, YouTube, Texas A&M Engineering News.
4/2011  We used combinFormation to author a series of information compositions to represent the CreativeIT Canon, a literature review developed by an NSF Workshop.
4/2011  The Interface Ecology Lab's S.IM.PL initiative receives funding from the 2011 Google Summer of Code program!
4/2008  Interface Ecology Lab director Andruid Kerne is awarded an NSF CAREER grant by the Human-Centered Computing program for the proposal, "A Multimodal Mixed-Initiative Research Notebook for Information Discovery".
7/2008  The Interface Ecology Lab is awarded an NSF IIS Medium grant by the Human-Centered Computing program for the proposal, "A Location-Aware Non-Mimetic Simulation Game for Teaching Team Coordination".
combinFormation [4.0 Beta 1]
integrates searching, browsing, collecting, and organizing to promote information discovery, the emergence of new ideas while finding information. Agents work with the participant to collect and compose relevant image and text clippings, forming a continuously evolving navigational informationscape composition.
[supported by NSF Advanced Learning Technologies, NSF IIS CAREER]

TTeCLoG: Team Coordination Games
Teaching Team Coordination with Location-aware Games (TTeCLoG) takes situated work practice of fire emergency responders, and develops games to teach team coordination. From a grounding in practice, we design non-mimetic simulations that re-create information flows and team structure, without a mimesis of fire and smoke.
[supported by NSF Information & Intelligent Systems, HARC Summer Scholars Program]

embodied interfaces
We develop interfaces that fully engage our sense of perception, taking a synesthetic approach to human-computer interaction. Recent developments in our lab include thin, transparent, pressure sensitive, multi-touch sensing technologies, as well as tools and frameworks to fully take advantage of the high input dimensionality afforded by such interfaces.
[supported by NSF IIS CAREER]

current publications + presentations
Toups, Z. O., Kerne, A., Hamilton, W. A. The Team Coordination Game: A zero-fidelity simulation abstracted from fire emergency response work practice, ACM Transactions on Computer-Human Interaction (ToCHI) 18, 4, 2011, 37 pages, [DOI:10.1145/2063231.2063237].
Kerne, A., Hamilton, W., Toups, Z. Culturally Based Design: Embodying Trans-Surface Interaction in Rummy Proc CSCW 2012, in press [top 9%].
Damaraju, S., Kerne, A., Comparing Multi-Touch Interaction Techniques for Manipulation of an Abstract Parameter Space, accepted to Proc. International Conference on Multimodal Interaction (ICMI) 2011.
Qu, Y., Kerne, A., Webb, A.M., Herstein, A. Interoperable Metadata Semantics with Meta-Metadata: A Use Case Integrating Search Engines. Proc ACM DocEng 2011, Mountain View, CA, USA, Sept. 20-22, 2011, 171-174 [DOI=10.1145/2034691.2034729].
Toups, Z. O., Hamilton, W. A., Kerne, A. Zero-fidelity simulation: Engaging team coordination without physical, functional, or psychological re-creation, Proc. MODSIM World 2011, 451–459.
Webb, A.M., Kerne, A. Integrating Implicit Structure Visualization with Authoring Promotes Ideation, Proc Joint ACM/IEEE Conf on Digital Libraries (JCDL), June 13–17, 2011, Ottawa, Canada.
Moeller, J., Lupfer, N., Hamilton, B., Lin, H., Kerne, A., intangibleCanvas: Free-Air Finger Painting on a Projected Canvas , CHI Works-in-Progress -- Extended Abstracts of the 29th International Conference on Human factors in computing systems, May 7-12, 2011, Vancouver, BC, CA.
Moeller, J. and Kerne, A., ZeroTouch: A Zero-Thickness Optical Multi-Touch Force Field, CHI Interactivity -- Extended Abstracts of the 29th International Conference on Human factors in computing systems, May 7-12, 2011, Vancouver, BC, CA.

[Video]

Toups, Z.O., Kerne, A., Hamilton, W. A., Shahzad, N. Zero-Fidelity Simulation of Fire Emergency Response: Improving Team Coordination Learning, Proc ACM SIGCHI 2011, Vancouver, BC, Canada, 7–12 May 2011, 1959–1968, [DOI:10.1145/1978942.1979226].
Kerne, A., Qu, Y., Webb, A.M., Damaraju, S., Lupfer, N., Mathur, A. Meta-Metadata: A Metadata Semantics Language for Collection Representation Applications, Proc ACM Conference on Information and Knowledge Management, Toronto, Ontario, Canada, October 26–30 2010.
Moeller, J., Kerne, A., Scanning FTIR: Unobtrusive Multi-Touch Sensing through Waveguide Transmissivity Imaging, Proceedings of the 4th International Conference on Tangible, Embedded and Embodied Interaction, Cambridge, MA, Janurary 25–27 2010.
Koh, E., Kerne, A., Deriving Image-Text Document Surrogates to Optimize Cognition, Proc ACM DocEng 2009, Munich, Germany, Sept 16–18.
Koh, E., Kerne, A., Berry, S., Test Collection Management and Labeling System, Proc ACM DocEng 2009, Munich, Germany, Sept 16–18.
Toups, Z. O., Kerne, A., Hamilton, W. Game Design Principles for Engaging Cooperative Play: Core Mechanics and Interfaces for Non-Mimetic Simulation of Fire Emergency Response, Proc ACM SIGGRAPH Games 2009, New Orleans, Louisiana, USA, August 3–7, 2009, 71–78, [DOI:10.1145/1581073.1581085].
Toups, Z. O., Kerne, A., Hamilton, W., Blevins, A. Emergent Team Coordination: From Fire Emergency Response Practice to a Non-Mimetic Simulation Game, Proc ACM Group 2009, Sanibel Island, Florida, USA, May 10–13, 2009, 341–350, [DOI:10.1145/1531674.1531725].
Hamilton, W., Toups, Z. O., Kerne, A. Synchronized Communication and Coordinated Views: Qualitative Data Discovery for Team Game User Studies, Ext Abs ACM Computer Human Interaction 2009, Boston, Massachusetts, USA, April 4–9, 2009, 4573–4578, [DOI:10.1145/1520340.1520702].
Toups, Z. O., Kerne, A., Hamilton, W. Motivating Play through Score, ACM Computer Human Interaction 2009 Workshop on Engagement by Design, Boston, Massachusetts, USA, April 4–9, 2009.
Kerne, A., Koh, E., Smith, S. M., Webb, A., Dworaczyk, B., combinFormation: Mixed-Initiative Composition of Image and Text Surrogates Promotes Information Discovery , ACM Transactions on Information Systems (TOIS), 27(1), Dec. 2008, 5:1-45,
http://doi.acm.org/10.1145/1416950.1416955.
Kerne, A., Damaraju, S., Kumar, B., and Webb, A. Meta-Metadata: A Semantic Architecture for Multimedia Metadata Definition, Extraction, and Presentation, Poster and Demo Proceedings of the 3rd International Conference on Semantic and Digital Media Technologies, Koblenz, Germany, 3-5 December 2008.
Damaraju, S., Kerne, A. Multitouch Gesture Learning and Recognition System. , Extended Abstracts of IEEE Workshop on Tabletops and Interactive Surfaces, Amsterdam, Netherlands, 1-3 October 2008.
Kerne, A., Toups, Z.O., Dworaczyk, B., Khandelwal, M. A Concise XML Binding Framework Facilitates Practical Object-Oriented Document Engineering , Proceedings of ACM Symposium on Document Engineering, Sao Paulo, Brazil, 16-19 September 2008.
Kerne, A., Smith, S.M., Koh, E., Choi, H., Graeber, R., An Experimental Method for Measuring the Emergence of New Ideas in Information Discovery, International Journal of Human-Computer Interaction (IJHCI), 24 (5) July 2008, 460-477.
Webb, A., Kerne, A. The In-Context Slider: A Fluid Interface Component for Visualization and Adjustment of Values while Authoring, Proceedings of ACM Advanced Visual Interfaces, Napoli, Italy, 28-30 May 2008.
Kerne, A., Koh, E., Representing Collections as Compositions to Support Distributed Creative Cognition and Situated Creative Learning, New Review of Hypermedia and Multimedia (NRHM), 13(2) Dec 2007, 135-162.
Koh, E., Kerne, A., Webb, A., Damaraju, S., Sturdivant, D., Generating Views of the Buzz: Browsing Popular Media and Authoring using Mixed-Initiative Composition, Proceedings of ACM Multimedia, Augsburg, Germany, 23-29 September 2007.
Koh, E., Caruso, D., Kerne, A., Gutierrez-Osuna, R., Elimination of Junk Document Surrogate Candidates through Pattern Recognition, Proceedings of ACM Symposium on Document Engineering, Winnipeg, Canada, 28-31 August 2007.
Webb, A., A Transitory Interface Component for the In-Context Visualization and Adjustment of a Value , M.S. thesis, Texas A&M University, August 2007.
Koh, E., Kerne, A., Hill, R., Creativity Support: Information Discovery and Exploratory Search, Proceedings of ACM SIGIR Conference, Amsterdam, Netherlands, 23-27 July 2007.
Kerne, A., Koh, E., Smith, S.M., Choi, H., Graeber, R., Webb., A., Promoting Emergence in Information Discovery by Representing Collections with Composition, Proc ACM Creativity & Cognition, Washington DC, June 2007, 117-126.
Kerne, A., Koh, E., Creativity support: the mixed-initiative composition space, Proc Joint ACM/IEEE Conf. on Digital Libraries (JCDL), Vancouver, June 2007, 509-509.
Koh, E., Kerne, A., combinFormation: Exploring Multiple Searches Together through the Mixed-Initiative Composition Space, ACM Computer Human Interaction 2007 Workshop on Exploratory Search and HCI, San Jose, California, USA, April 2007.
Toups, Z. O., Kerne, A., Implicit Coordination in Firefighting Practice: Design Implications for Teaching Fire Emergency Responders, Proc ACM Computer Human Interaction 2007, San Jose, California, USA, April 2007, 277-286.
Toups, Z. O., Kerne, A., Location-Aware Augmented Reality Gaming for Emergency Response Education: Concepts and Development, ACM Computer Human Interaction 2007 Workshop on Mobile Spatial Interaction, San Jose, California, USA, April 2007.
Webb, A., Kerne, A., Koh, E., Joshi, P., Park, Y., Graeber, R., Choreographic Buttons: Promoting Social Interaction through Human Movement and Clear Affordances, Proc ACM Multimedia, Santa Barbara, Oct 2006.
Graeber, R., Kerne, A., Henderson, K., ZooMICSS: a zoomable map image collection sensemaking system (the Katrina Rita context), Proc ACM Multimedia, Santa Barbara, Oct 2006.
Toups, Z. O., Graeber, R., Kerne, A., Tassinary, L., Berry, S., Overby, K., Johnson, M., A Design for Using Physiological Signals to Affect Team Game Play, Proc Augmented Cognition International, Oct 2006, San Francisco.
Koh, E., Kerne, A., I Keep Collecting: College Students Build and Utilize Collections in Spite of Breakdowns, Proc European Conf on Digital Libraries (ECDL), Sept 2006, Alicante, Spain.
Kerne, A., Koh, E., Dworaczyk, B., Mistrot, J.M., Choi, H., Smith, S., Graeber, R., Caruso, D., Webb, A., Hill, R., Albea, J., A Mixed-Initiative System for Representing Collections as Compositions of Image and Text Surrogates,
Proc Joint ACM/IEEE Conf. on Digital Libraries (JCDL), June 2006, Chapel Hill.
Kerne, A., Koh, E., Choi, H., Dworaczyk, B., Smith, S.M., Hill, R., Albea, J., Supporting Creative Learning Experience with Compositions of Image and Text Surrogates, Proc Ed Media 2006, June 2006, Orlando.
Toups, Z., Overby, K., Kerne, A., Graeber, R., Cooper, T., Alley, E., Censor Chair, ACM SIGCHI Intl Conf on Advances in Computer Entertainment, June 2006, Hollywood.
Alley, E., Cooper, T., Graeber, R., Kerne, A., Overby, K., Toups, Z., Censor Chair: Exploring Censorship and Social Presence through Psychophysiological Sensing, Proc ACM Multimedia, Nov 2005, Singapore, 922-929.
Koh, E., Kerne, A., Berry, S., Test Collection Management and Labeling System, Proc ACM DocEng 2009, Munich, Germany, Sept 16-18.
Stenner, J., Kerne, A., Williams, Y., Playas: Homeland Mirage, ISEA/Zero One, Aug 2006, San Jose.
Stenner, J., Kerne, A., Williams, Y., Playas: Homeland Mirage, Proc ACM Multimedia, Nov 2005, Singapore, 1057-1058.
Kerne, A., doing interface ecology: the practice of metadisciplinarity, Proc SIGGRAPH Art and Animation,
Aug 2005, Los Angeles, 181-185.
Kerne, A., Koh, E., Sundaram, V., Mistrot, J.M., Generative semantic clustering in spatial hypertext, Proc ACM Document Engineering 2005, Nov 2005, Bristol, UK, 84-93.
Kerne, A., Smith, S.M., Choi, H., Graeber, R., Caruso, D., Evaluating Navigational Surrogate Formats with Divergent Browsing Tasks, Proc ACM CHI, April 2005, Portland, Oregon.
Kerne, A., Mistrot, J.M., Khandelwal, M.,Sundaram, V., Koh, E., Using Composition to Re-Present Personal Collections of Hypersigns, Proc Computational Semiotics in Games and New Media (CoSIGN), Sept 2004, Split, Croatia.


Thanks for support provided by the National Science Foundation.