Tag: communication

Research Statement

A downloadable PDF version of this article is available here.

The ability to access social interactions is important for everyone, but many people may often be denied access or experience reduced access because of physical, cognitive, or social barriers. A lack of quality access leads to impoverished social experiences and a host of other problems such as loneliness, depression, and anxiety. My research agenda aims to understand how we can design and develop technology to support social interactions – exploring how sociality crosses into both physical and virtual spaces. For physical environments, I have designed and developed assistive technology as a therapeutic tool using whole-body interactive systems to expand modes of communication. Beyond physical spaces, my dissertation focuses on social interactions within and across social media platforms, including a Minecraft virtual world for children with autism, through ethnographic methods. In my future research, I will explore how individuals navigate access not only from platform to platform, but also from the physical world to the virtual and back again. Insight from this work will lead to theoretical and practical contributions of how individuals with disabilities and their social networks adopt, use, and modify technical systems that facilitate social interactions. Further, my work will lead to a better understanding of these communities and how to design more inclusive technology.

Assistive Technology for Children with Autism

Whole-Body Interactive Systems

A shape of a strawberry that has been colored in red and green, with the coloring going outside the lines.

Figure A. Strawberry outline colored by the user.

A silhouette of a boy's legs with a red target that has been painted over in green.

Figure B. A target with the silhouette of the user in the background.

Access to otherwise prohibitively expensive (e.g., money, time, energy) therapy is made possible by using whole-body interactive technology and augmenting the therapeutic and home environments for users. I conducted research of two systems using whole-body interactions – SensoryPaint and DanceCraft – which augmented therapies already being employed by children with autism. Both systems were developed using the Kinect, an inexpensive device that can be placed in a user’s home or doctor’s office. These projects allow for a more inclusive therapeutic environment by creating accessible, inexpensive solutions.

SensoryPaint uses a projection on a wall that the users interacted with using rubber balls. The user receives visual feedback of their activity via a silhouette displayed on the projection. The system allows for multiple types of interaction. For example, the user can digitally “paint” with the Kinect, tracking the ball and displaying the ball’s path in various colors on the wall (See Figure A). The user can also throw the ball at the projection to get a “splash” effect (See Figure B). From the results of the pilot study of SensoryPaint, I found that whole-body interactions can be more engaging for children than traditional therapies by giving participants different interactive options that suit their specific sensory needs. Including a flexible interface allows both therapists and children to use relevant segments of the program and change settings as needed. I presented these results at the Conference on Pervasive and Ubiquitous Computing (UbiComp) where I was nominated for a Best Paper award [8].

A shadow puppet with grass and clouds and birds flying in the background.

Figure C. Shadow puppet interface of DanceCraft.

Following the SensoryPaint study, I led a team of undergraduates to design and develop the DanceCraft system. The interface uses a similar silhouette feature that gives the user visual feedback on their activity. The user follows along with pre-recorded dances displayed as a “paper doll” figure (See Figure C). By including a feature to replay recorded dances on-the-fly, therapists and instructors can record dances specific for each child and session. The replay feature also allows for children to watch their own dance choreographies, giving them instant feedback. A therapist can then track a child’s progress across sessions through their saved recordings. Future iterations of the DanceCraft software will calculate whether the user’s captured dance moves are the correct dance moves as prescribed by the therapist. A pilot study of DanceCraft showed the feasibility of augmenting therapy in the home. I coauthored these preliminary findings, which were presented at the ACM Tapia Diversity conference [1], and a manuscript for the Transactions of Computer-Human Interaction (TOCHI) journal is currently in progress. Future work on these whole-body interactive systems will focus on creating intelligent software that can adapt to a growing, developing child’s needs and be intuitive for parents and therapists.

3D Printing from User-created Models in the Minecraft Virtual World

Minecraft is a popular virtual “sandbox” – with currently over 27 million units of the software sold – where players can build and create objects, environments, and worlds with a high degree of freedom. The multiplayer-capabilities of virtual worlds in Minecraft make it an ideal system for examining how technology facilitates and drives social interactions between users. I designed and programmed software that allows players to 3D print models of objects they have created within Minecraft. The application takes the coordinates of an object and translates it into a file that can be sent to a 3D printer, making their creations come to life in a sense. I designed the software to leverage the familiar interface by creating it as an add-on for Minecraft. To use the program, the user creates the 3D printing “magic wand” object within the virtual world, types in commands for the wand in the Minecraft interface, and then saves the files to the local computer. This program has potential in establishing engaging social interactions with greater accessibility due to the inherent nature of virtual environments, where conditions such as geographical or physical limitations are less hindering. Future work in this project will explore how users experience blending virtual creation of 3D objects with their tangible, physical representations. As part of a campus-wide effort to retain underrepresented students in STEM, this work was presented by my undergraduate mentee at the UCI Summer Research Symposium [9].

Exploring Virtual Worlds as a Support for Social Play in Children with Disabilities

Autcraft is a specific iteration of a Minecraft virtual world dedicated to children with autism and their allies. Drawing from work in Disability Studies, my dissertation examines data collected from ethnographic research conducted over three years in Autcraft (See Figure D). My research has uncovered how the Autcraft community works to create a safe, inclusive space through both social and technical means [6]. Parents actively work to maintain safety and accessibility in the Autcraft community through modifying Minecraft and other mainstream technology to create assistive devices [5]. Additionally, the findings from this work indicate the importance of a supportive communication framework (e.g., Facebook, Twitter, YouTube, and Twitch) that has emerged in the Autcraft community [7]. This constellation of social media is comprised of different platforms used in tandem to create a social, community experience. Community members can thereby empower themselves through online activism that supports better treatment of individuals with disability [2]. This also gives the children an outlet to express themselves creatively on safe online platforms [4]. Ultimately, I found the community searches for, practices, and defines sociality through the various communication channels and means of communication indicating evolving definitions of what it means to be social [3,7]. Results from this research project have appeared in multiple venues, including Human Factors in Computing Systems (CHI) and Computer Supported Cooperative Work and Social Computing (CSCW).

A Minecraft character next to a pond wearing a white lab coat with brown hair.

Figure D. A screen shot of my avatar, ResearcherKate – used to complete my virtual world ethnography.

Contributions of Dissertation

My dissertation contributes an empirical understanding of how access is granted to some individuals and not to others, creating an uneven distribution of experiences when interacting with technologies. This includes an exploration of how the intersectionality of multiple identities of community members, such as autistic or child, impacts social play online and how social play enables the performance of these identities. Insight from my work can help shape our scholarly understanding of how users approach technology, as well as some of the work marginalized users do to fully experience interactions. This includes some of the “Do-It-Yourself” activities individuals engage in to make systems more usable for themselves and their communities.

In this work, I highlight the value of virtual social interactions for marginalized users. When scholars, designers, therapists, or parents privilege physical, face-to-face social interactions over virtual ones, they run the risk of making invisible those who prefer, or have better access to, virtual social interactions. My dissertation challenges the mainstream discourse and contributes to normalizing social play as it occurs in virtual spaces for children with autism. Often, society tells these children they should focus solely on their physical-world engagements, while their online relationships and experiences are discounted. Children with autism are just one example of a subset of people who may prefer virtual interactions.

Finally, my work contributes a new way for HCI researchers to define and study social media. This work expands the definition of social media to include games and virtual worlds, beyond the scope of other social media platforms such as Facebook, Twitter, and Tumblr. The ethnographic methods used in this project also exemplify how HCI researchers should look beyond the bounds of a single social platform to understand a user or a community of users. Social media platforms work together to create an organic network for social interaction. This holistic lens of research allows for a far more complete understanding of users, which is necessary to create access and inclusion.

Research Agenda

My future research program will continue to explore the frontier where physical and virtual interactions no longer simply coexist, but are seamless. My work will encompass the following three themes: 1) understanding how people use a constellation of social platforms, 2) understanding disabled embodied experiences as mediated by technology, and 3) using the lens of intersectionality to represent a more complete person regardless of ability. To explore these threads, my research lab will engage in community-based work with individuals with disability and relevant organizations. Together we will answer questions regarding how we can design and develop sustainable technology that mediates social interactions and how access to these social interactions will improve quality of life. Research activities will include: designing and developing software for virtual reality (VR) and augmented reality (AR) platforms in tandem with whole-body sensors; holding workshops with marginalized individuals to both help with the design of these systems and to test the efficacy of the systems; and outreach programs with students in the department with local groups and schools.

This research will not only further the field in terms of understanding how people can build innovative technology, but also aid in the academic STEM pipeline for underrepresented students. As with my previous work, I will continue to mentor graduate and undergraduate students who are interested in working with marginalized populations in the areas of technology, games, and media studies. Results from this work will be published in conferences and journals geared towards HCI (such as CHI, Ubicomp, and ASSETS). My goal is to produce scientific results from multiple, diverse perspectives that will ensure a broader impact.

References

[1]       J.K. Brown, K.E. Ringland, and G.R. Hayes. 2016. DanceCraft: A Whole-Body Dance Software for Children with Autism. Tapia Celebration of Diversity in Computing 2016.

[2]       K.E. Ringland. 2017. On Being “Autsome”: An Exploration of Online Social Play as a Means of Empowering Autistic Youth. Popular Culture Association / American Culture Association.

[3]       K.E. Ringland. 2017. Minecraft as a Site of Sociality for Autistic Youth. QGCon 2017.

[4]       K.E. Ringland, L.E. Boyd, H. Faucett, A.L.L. Cullen, and Gillian R. Hayes. 2017. Making in Minecraft: A Means of Self-Expression for Youth with Autism. In Proc. IDC 2017, ACM.

[5]       K.E. Ringland, C.T. Wolf, L.E. Boyd, M. Baldwin, and G.R. Hayes. 2016. Would You Be Mine: Appropriating Minecraft as an Assistive Technology for Youth with Autism. In Proc. ASSETS 2016, ACM.

[6]       K.E. Ringland, C.T. Wolf, L. Dombrowski, and G.R. Hayes. 2015. Making “Safe”: Community-Centered Practices in a Virtual World Dedicated to Children with Autism. In Proc. CSCW 2015, ACM.

[7]       K.E. Ringland, C.T. Wolf, H. Faucett, L. Dombrowski, and G.R. Hayes. 2016. “Will I always be not social?”: Re-Conceptualizing Sociality in the Context of a Minecraft Community for Autism. In Proc. CHI 2016.

[8]       K.E. Ringland, R. Zalapa, M. Neal, L. Escobedo, M. Tentori, and G.R. Hayes. 2014. SensoryPaint: A Multimodal Sensory Intervention for Children with Neurodevelopmental Disorders. In Proc. UbiComp, ACM.

[9] Tamimi, A., Ringland, K.E., Hayes, G.R. 2016. “Developing a User-Friendly System to 3D Print Minecraft Creations.” UCI Summer Research Colloquium. Irvine, CA.

DML 2016 Recap

This week I attended my first Digital Media and Learning conference, which was held here on the UC Irvine campus. I thought I would write a short recap of my experiences. Disclaimer: these thoughts are by no means all encompassing.

photo of a sign with lego texture that reads, DML Digital Media and Learning Conference

My first impressions of the DML community is that they are very friendly and very passionate about what they do. It’s a wonderful combination for someone joining in for the first time. There was also lots of engagement on Twitter throughout the conference, which I found to be a helpful way to make the event more accessible.

hand hold a DML conference badge, the text on the badge reads Kathryn Ringland Kate, University of California Irvine

Fun DML 2016 badge.

While I enjoyed all the sessions I attended, the keynote and plenary conversation were definitely the highlights. The conversations I had in between sessions and during the reception were by far the most inspiring part of the conference for me in terms of ideas for my own scholarly work.

a woman at a podium next to a projected slide

Constance Steinkuehler talking about the future that is games.

What is most exciting for me are the following two takeaways:
1. Play and games are truly coming into their own in the academic space. I am so excited to see games research in these more educational and learning spaces realize the potential of well designed games (i.e., not those educational games that kids see straight through and aren’t fun at all to play.)

a photo of a slide of a trojan horse painted, with text reading games are a trojan horse for interest driven learning

Slide of the trojan horse that is GAMES.

2. There were hints and whispers throughout DML of inclusion. For many this meant socioeconomic status, race/ethnicity, gender, but very little about ability. The last two ignite talks at the end of the conference were calls for more disability work in the space. I whole-heartedly agree and am very excited to contribute next year as I can.

Of the many memorable moments, the students on campus held a protest during the plenary talk this morning because apparently the LA Police Chief was giving a talk somewhere else on campus.

I was ecstatic when Henry Jenkins discussed how Star Trek changed his world view.

All in all, it was an awesome event and I’m looking forward to attending again next year!

Minecraft Interviews

Screenshot 2015-06-30 12.06.09

The purpose of this research is to determine how children with Autism Spectrum Disorder use the virtual world Minecraft to communicate. While there are no direct benefits from participation in the study, it may explain how children with Autism Spectrum Disorder socialize and how to best assist them with technological interventions for communication. Interviews will take place within Minecraft, in person, or via Skype, depending on your preference. Interviews should take approximately 1 hour.

Please email me at kringlan [at] uci [dot] edu to arrange an interview!

Click HERE for info for parents.

Click HERE for info for adults being interviewed.

Click HERE to learn more about the overall study.

Minecraft Study Blog Week 1

My intention with these blog posts is to have a sort of informal record of my time spent in Autcraft. They will be my beginnings, in a way, of creating my overall narrative of my experience. I will be creating much more formal documentation in the form of conference papers and journal articles, but here I want to create a space that is more open to dialogue and discussion. I also want the community to know that I am completely open and willing to share my thoughts and findings as much as I want to hear the thoughts of those in the community. My hope is to be able to tell the story of Autcraft and to be able to, through technology, expand on what it has given the autism community if I can.

My first week in the Autcraft community has been an extremely humbling experience. As I made my first timid steps into the unknown, I was greeted with open arms. A good number of people have given me encouragement, offered to help, welcomed me and offered friendship, and thanked me. I feel like I should be the one thanking every single member of the Autcraft community for allowing me to be among them.

I feel like I have accomplished a lot in the few hours I have played over the last week: I’ve built a modest office, explored many different areas, gone mining, died in lava, played Hide and Seek with other players, marveled at all the amazing things other players have built, played Paint Ball with other players, and died falling from a giant pink pony. All and all, a very busy, but successful week.

a pink pony statue in minecraft

Fell off from the top of a giant pink pony and died. Admittedly a first for me.

I have been struck by the many different ways in which players communicate in Autcraft. There is text chat, but there is so much more. Players also communicate via their characters (how they look and through their movements), via their constructions, via signs littered throughout the world, and more. I am sure those that have a limited understanding of autism would be very surprised to hear that these players are communicating at all. And while I am still in the very early stages of my research, I can assure anyone reading this that these players are communicating- in a varied and rich format.

I will close with that for this week. Please stay tuned and feel free to email me at kringlan [at] uci [dot] edu with any questions about my work. Thanks and keep on building!

EAPSI 2014

cloth fish flying in hiroshima

At the Hiroshima Flower Festival 2013. Photo Credit: Severn Ringland.

In the fall of 2013, I applied for the NSF’s East Asia Summer Institute Program and was accepted February 3, 2014. The abstract to my proposal:

While there are a variety of available Augmentative and Alternative Communication (AAC) devices available for individuals with Autism Spectrum Disorder in the United States, these devices are infrequently found for users in Japan especially in their native language. A culturally appropriate AAC system for use with Japanese children will be designed using participatory design workshops with stakeholders from Hiroshima University. During this project she will come to better understand the process of designing assistive technology as it occurs between local stakeholders in Japan and American researchers and to create a framework to help facilitate this kind of work in the future.

Click here for a full version of my proposal.

Last Updated: April 3, 2014

Related Posts:

EAPSI Alum Advice for Applicants

I have been getting questions about the EAPSI application process, so I thought I would save everyone some time and ...

Video: Development of EAPSI Project App Part 1

I've been making steady headway into my project development. This last week, I overcame some large hurdles which should mean ...

Video: Design of EAPSI Project App

Here's a short video of my design motivation and sketches of my communication app for Japanese children with autism. After ...

Minecraft Study

Screen shot of sunset and a volcano in Minecraft

Sunset and a volcano in Minecraft

RecruitmentFlyer

My name is KateRingland and I am a PhD student in Informatics at the University of California, Irvine. I will be conducting observations of players in Minecraft. For the most part, this will just look like I’m playing the game like everyone else. However, I will be taking notes of my experiences and possibly screen shots. I will not be recording any identifiable information. I will not record any real names or real screen names. If I take a screen shot, I will blur out anything that would identify an individual player.

What are you looking for during your observations? I am mostly just watching to see how players on Minecraft interact. I would also like to explore the various ways in which players communicate during game play. I am hoping this research leads to helping children with Autism Spectrum Disorder have a supportive, fun environment to play in.

I am now conducting interviews! Find out more information HERE.

Please email me at kringlan [at] uci [dot] edu if you have any questions.

CLICK HERE FOR ADDITIONAL STUDY INFORMATION.

Our first paper from this project is published at Computer Supported Collaborative Work (CSCW) 2015, titled ‘Making “Safe”: Community Centered Practices in a Virtual World Dedicated to Children with Autism’.

Last Updated: June 1, 2015.

© 2024 Kate Ringland, PhD

Theme by Anders NorenUp ↑