Teaching Students to Use iPads for Survey Data Collection (2 of 2)

In my last post, I wrote about a Comm Research project where students use iPads for survey data collection.This is my favorite of the 3 projects we do in my Communication Research Class (see all posts on Comm 435; see syllabus).

This week, I want to follow up by discussing how to program the surveys to work on the iPads. I’ll talk through how I teach all of this in class and through activities.

Lastly, I’ll explain how I prepare the data for use in SPSS.

Once students have created their surveys, we need to get them onto ONA.io

Programming surveys to work on ONA.io – the free, open-source tool used by my class and researchers around the world – is a little tricky. It follows XLS formatting. Once you get the hang of it, it is super easy. And it is quick to teach and learn.

I go over this online Lab Guide (http://bit.ly/435_lab_digitalsurvey) that I created on how to program XLS forms in class. I then provide students with a practice activity to create a survey in Excel or Google Spreadsheets. The activity asks students to create:

1) A question of how many years they are in school

2) A check all that apply question – I usually pick something fun like their favorite movies from a list

3) A likert-style question. Ex: How much they like binge-watching on Netflix.

In sum, they practice creating an integer, select_multiple, and select_one question.

Once students get the hang of it, they log into an ONA.io account I create for the class. Next, they upload their practice survey to test in class using our department’s iPads. But, this could be done on a phone or even a computer itself (Instructions on how to do this are in the lab guide).

The #1 thing, is that things have to be done exactly in this formatting. So, little errors like forgetting to put an _ (and putting a space instead) for “list_name” will result in ONA.io kicking the survey back and telling you there is an error. If a mistake is made, no problem. Just fix your form and re-upload.

I check to make sure everything is done correctly. This saves time when they program their own surveys. If everything is good, I give students lab time to work on formatting their surveys and help out as needed.

After everything has been uploaded successfully – this usually takes time outside of class, so I make it due the following class – students are ready to go out into the field. This is where the fun happens!

Students always get great feedback when they use iPads to collect survey data. People tend to be interested in what they’re doing and happy to participate. Some students this year told me that people came up to them around campus and asked if they could participate. That is much different than the usual online survey where we often struggle to get respondents! I can’t express how rewarding it is to see students go out into the field, collect data, and come back having gathered data no one else has before. For most of them, this is their first time doing data collection of any kind. And so while the class is tough and a lot of work, it is rewarding. You can see the ‘aha’ moments the students have when they start drawing inferences from their data.

Preparing Data for Analysis in SPSS

If you only want to look at summaries of responses, you can check that out in ONA.io. But, if you want to analyze the data you’ve got to get it from the way students labeled it to the #s for SPSS.

For example, in the below example where the question asks the participant their favorite ice cream, if the ‘choices’ in our XLS code is:

Lab_Guide_-_FormHub_-_Google_Docs

And the participant answers “Vanilla” the data collected would be icecream2.

But, SPSS can’t analyze “incecream2.” It can only analyze a number. So, we need every instance when a participant selected Vanilla to be recorded as simply “2” in SPSS.

Here’s how to quickly do this:

Download the data Excel file of the completed surveys. Open in Excel. Replace “icecream” with “” (that is, with nothing – no spaces. Just leave the replace section blank). Excel will remove “icecream” from the Excel file and you’re left with the number for responses such that “icecream2” now is “2”. Repeat this step for each question. For check all that apply questions, ONA.io records “FALSE” for answer choices left blank, and “TRUE” for instances when the participant checked the answer choice. For example, if the question was “Check all your favorite ice cream flavors” and the participant checked “Vanilla,” ONA would record a “TRUE” and if they left it blank, ONA would record “FALSE.” These can be easily prepared for SPSS by replacing FALSE with “0” and TRUE with “1”.

Admittedly, this step is the drawback of using XLS forms. While a little tedious, it is quick and easy to do. Considering the advantages, I don’t mind taking 20 minutes of my time cleaning the data for my students.

When done, I send the student teams their data and we work on analyzing them in class.

 

Well that’s all for now! I hope you enjoyed this tutorial and consider using iPads for survey data collection in your research class, or other classes where surveys could prove valuable!

Here at Shepherd, finals week starts this week. I hope everyone has a great end to the semester!

Using iPads for Survey Data Collection in the Communication Research Class

Surveys are a common method uses in communication research class projects. Since I started teaching this class at Shepherd University, I’ve added a fun, cool feature that really brings the survey data collection process to life!

Students in my Comm 435 Communication Research class (see all posts on Comm 435; see syllabus) now use iPads for data collection in the field. My students grab a department iPad and go around campus to recruit participants. The participants complete the surveys on the iPads, and the data is synched to the cloud where it can be downloaded and analyzed.

ipadsurveys

Overview

For the final of three hands-on projects in my class, student teams identify a problem or question they have pertaining to Shepherd University or the local community. They design a study to research that problem. In my first two hands-on projects, students don’t design the methods or the measurements. They are based on scenarios I set up and materials I provide. For example, here’s a discussion of my computer-assisted content analysis assignment.

As a part of the assignment for today’s post, students are required to conduct 1) surveys, and 2) either focus groups or interviews. Let’s talk about the surveys:

After discussing surveys as a method, with a particular focus on survey design and considerations, each team designs a brief survey.

In the lecture before they create the survey, I lecture on important considerations in survey design. And then students do an in class activity to practice putting these concepts into motion using a mock scenario. I then provide feedback on their survey design, and help them make improvements.

The class the following time we meet is dedicated to helping students design measurements that meet the research objective and research questions they’ve developed that will help them get the answers to the questions they want to know. The day is also dedicated to helping them write effective survey questions (as well as interview or focus group questions, for that part of the assignment). I started dedicating an entire class period to measurement design after spotting this as a major weakness in the projects last semester.

Next, rather than using paper & pen, or surveymonkey.com (which limits students to only 10 questions), teams program their surveys into ONA.io. It is a free, open access web survey tool designed by folks at Columbia University. So, we spend the 3rd day learning how to use ONA.io to program their surveys. I’ll talk in detail about that in the next post.

During data collection week, students check out department iPads, load the survey onto their iPad, and go out into the field to collect data. A group of students will check out several iPads and hit up the student union, library, or campus quads and collect data fairly quickly. The data syncs automatically over our campus-wide wifi! That means, when all students get back to the computer lab, their data – from each iPad used – is already synced to ONA.io where it could be downloaded and analyzed.

Pretty cool, huh? It is my favorite project that we do in my communication research class and the students seem to really enjoy using the iPads for surveys.

There are a few caveats.

  1. After the data is collected, in order for it to be analyzed in SPSS it has to be cleaned. If you do formhub, you’ll notice that the data you get doesn’t quite fit in with the format SPSS needs. So, I spend a few hours before we meet as a class to look at the data that was collected and analyze it.
  2. This year, Formhub.org seems to be moving painfully slow. I’ve had trouble last week getting the website to work. And am still having trouble this week. With data collection set to start tomorrow, I am stressing that it may not work! – update: I’ve read in several places about ongoing stability issues with Formhub. I’m now using ONA.io instead which works the exact same way! I’ve updated verbiage above to reflect that.

I’ve provided a copy of the assignment below. Enjoy!

On my next post, I will provide info on programming surveys into the XLS forms format, which is a bit tricky. I spend a day in class teaching this. I’ll also show you how to load the surveys onto the iPads and get them synced up to the computer if you aren’t on WiFi when you collect the data.

photo: CC by Sean MacEntee

Teaching Computer-Assisted Content Analysis with Yoshikoder

Last blog post I discussed the second project in my applied research class, a sentiment analysis of Tweets using Yoshikoder – a free computer-assisted content analysis program from Harvard.

As promised, I want to share my assignment, and my handout for students that teaches them how to use Yoshikoder. Before we do the project, however, I do a brief in class activity to get students learning how to use Yoshikoder. So let’s start there for today’s post. And next post, I’ll share the assignment itself.

PART 1: THE SET UP

What I like to do, is present the problem to the students via the project assignment. Then, we go back and start learning what we’d need to do to solve the problem. So, after lecturing about what sentiment analysis is and why it is important, I get students introduced first to the idea of constructing a coding sheet for keywords by taking a list of keywords and adding them to categories.

First, we talk about the idea in class, and I show them some simple examples, like: If I wanted to code a sample for the presence of “sunshine” – what words would I need? Students brainstorm things like  start, sun, sunny, sunshine, etc., etc.

We discuss the importance of mutual exclusivity, being exhaustive, etc.

I show an example from my dissertation which looked at agenda setting topics on Twitter.

On the class day before I introduce Yoshikoder to the class, students do a practice assignment where I give them a list of random terms related to politics and elections. They then have to create “positive” and “negative” content categories using the terms. The terms aren’t necessarily well fit for this exercise, which gets them thinking a bit… They then hand code a sample of Tweets I provide about two different politicians. I tend to use the most recent election. So, in this case Obama and Romney. They are frustrated by having to hand code these Tweets – but a little trick is to do a search for the exact phrases in the Tweet files on the computer and they are done fairly quickly. Ok, so on the next class period:

1) Practice with Yoshikoder We do the same basic task, but this time they learn to program their “positive” and “negative” categories into Yoshikoder. They then load the Tweets (which I have saved as a txt file) and analyze them for the presence of their positive and negative content categories. This is a great point to stop and have students assess the reliability between what they hand coded and what the computer coded. Often, there will be discrepancies. And this makes for a great opportunity for discussion.

Here is the activity that I use in class. I also provide Tweets that I’ve downloaded using the search terms for the politician/candidate I’m using in the activity (e.g., Obama; Romney) in plain text format so Yoshikoder can read it. Also, see the below handout which I provide students to show them how to use Yoshikoder and how to program, and run the analyses I just described.

As I mentioned above, I create a handout that I like to give students that explains the different functionalities of Yoshikoder and how to run the analyses. As I’ve discussed elsewhere, I like to provide handouts. And the one below isn’t one of my more elaborate handouts. But it provides a quick overview with some screen shots to show what buttons need to be clicked. This is super helpful if you are trying to learn Yoshikoder, or want to use it alongside the activity (discussed in this post or the project discussed in my last post, and which I will provide in my next blog post).


Enjoy! .

EDIT: The assignment is now up. See the post.

If you’d like to learn more about using Yoshikoder, I found this great tutorial:

– Cheers! Matt