About Surveys

The Chi-square statistic is the primary statistic used for figuring out the significance of the cross-tabulation table. It is used to test for independence between the variables.  If the variables are independent of each other (or in other words they have no relation), then the Chi-Square test will be non-significant.  If the variables are found to be related, then the results of the statistical test will be "significant" and we can state that there is some relationship between the variables.

Survey Skip Logic is a great function to use if you want to skip survey respondents around in an online survey based on how they answer certain questions.  For example, you can skip someone from question #3 to question #20, if they choose a specific answer choice in question 3 (questions 4-19 may not apply to a respondent, if they answer a certain way in question 3).  I use skip logic often when creating surveys.

Automating processes is the new assembly line of the twenty first century.  Using computers and machines we take simple mind numbing tasks that humans dislike doing over and over again and we do them automatically with little or no human intervention.  When we automate surveys by programming them and putting them online we eliminate the need for humans to administer these surveys.  This decreases costs and increases accuracy for the data collected. 

While you will always find bias, for an online survey which is automated it is easier keep it unbiased.  This is because there is nobody actually giving the survey who could possibly allow their biases (even subconsciously) to affect the respondents.  Each survey will be presented in exactly the same way for each respondent.  The randomization of questions, answers or whole question scenarios becomes a breeze.   And the good part is that it has become very easy to make these surveys.  You no longer need to know how to do computer programming to make them.  These automated online surveys can be made online from a variety of companies (I suggest Qualtrics) in a very short time.

Hurray for modern technology!

One of the most asked questions in surveys and sampling is "what should my sample size be?"  It is definitely important and there are several factors that need to be taken into account before a sample size is determined.  These factors are:

The level of precision

The confidence level

Degree of Variability

There are several strategies in determining a sample size:

Use a Census for small populations

Use a Sample Size of a similar study

Use Published tables

Use a formula

There are actually several formulas that can be used to determine sample size.   They are all variations of the same princple formula.  A simple formula that will almost always be effective in determining a proper sample size is:

n=(N/(1+N(e)^2))

where:

n=sample size

N=Population size

 e=margin of error

A 360 evaluation is a technique used to gather information about an individual from all around them.  This is usually done through a survey.  The same survey is distributed to people with different relations to the individual.  For example, the feedback would come from subordinates, peers, and managers in the organizational hierarchy.  It is also common to obtain a self-assessment from the individual.  It is called a 360 Evaluation because the feedback comes from all-around the individual.

This is helpful because some individuals can be two-faced, and act and behave on one way to those above them, and completely different to those underneath them. With a 360 Evaluation, you can determine what different levels feel about the individual and get a better perspective of the whole picture.  Qualtrics surveys are great for doing 360-Evaluations and provide great reporting tools so you can easily understand what the feedback is saying.

Often when working online, you are in need of a spell-check feature. Let's face it, if you're like me, a spell-check feature comes in handy when you're typing faster than you're thinking. I create a lot of surveys and I've found, thankfully, there are some very simple options that are very helpful when creating survey questions. 

The latest versions of Mozilla's Firefox and Apple's Safari browsers both provide built-in spell-check features. If you are using Microsoft's Internet Explorer 7, then you can install a simple add-on that will accomplish this for you (IE7Pro and ieSpell both provide a nice option for spell checking as well as instructions on how to use them).Now, any time you are entering text for a survey question, you will see the red underline when you have a questionable spelling. Hopefully you find these alternatives as helpful as I do!

Recently I had the opportunity to travel to Japan and conduct several cross-cultural psychology experiments. For the majority of our experiments we used pencil and paper surveys. What a pain! We were collecting data from several colleges around the country, more specifically Hiroshima, Tokyo, Nagasaki, Aomori, Saporro, Kyoto, Sendai, and Osaka. Luckily we had about seven research assistants because it took forever to put all the information into a spreadsheet and then analyse it in SPSS. After putting all the information in the computer we also had to seperate different surveys from one another. It took about two months to complete. One of the other experiments, studying surnames and affluency, was completed using  an online survey tool. Although we had a lot of respondents in total our team probably only spent a couple hours having to analyze the results. It was so much easier to simply export the data into SPSS, rather than having to code, type, and then analyze. It saved us loads of time.

As the online survey software market grows, so do the features that are offered with various programs. Most have capabilities in other languages, depending on the language installed on the respondents computer. Many can even do multiple languages in the same survey. This is especially helpful when collecting data with a multilingual population. You can give the respondents the survey in the language that they would prefer. Thus, decreasing respondent comprehension errors.

Online surveys are no doubt the best way to do surveys. I was doing a survey for a project in my marketing class.  I proof read it and then I had some of my team mates proof read it.  It all looked good when we sent it out to our panel, but the next day I got an email from one of our respondents who Notified me that there were a couple of spelling errors (really embarrassing ones) in our survey.  Now in a paper survey there would have been no hope.  Reprinting and redistributing 50 or so surveys that had not yet been taken wouldn’t have been possible.  But because it was an online survey we were able to correct the errors in a less than a minute, and no one who hadn’t already seen the survey ever knew the difference. 

 Later that same year in my Economics class we were doing another survey to determine a demand curve.  About mid survey I was looking at the data, as it was being collected in real time, (which by its self is reason enough to use online surveys), when I noticed that one of our questions was not the correct question type to get us the data we needed.  The question was collecting what peoples preferences where but respondents were not ranking their preferences as we needed.  No problem I simply changed the question mid stream and we moved onward with survey, this time getting the data that we needed. 

This is the big benefit of online surveys.  You can see the results in real time and you can fix any errors in real time.  Online surveys are just so much more flexible and resilient than are paper surveys. 

Branch Logic works to navigate a survey respondent to a specific block or group of questions based on how they answered previous questions in the survey, or on certain data specific to that person (e.g., gender, age, ethnicity, department, class, major, etc.) For example: If a survey respondent indicates that he or she is a Psychology major, a block or group of questions may be created using Branch Logic will contain questions that are specific and applicable to Psych majors. Each person who indicates they are majoring in Psychology will navigated to this branch. Those who indicate a different major, will be taken to another branch created specifically for them.

Joy. Peace. Unadulterated Happiness, these are words that researchers often use to describe their mood when they are about to launch a project. Months of hard work and planning has come to a few simple days, and yet often one runs into bumps and problems. This happened to me the other week, when the night before the survey was to be launched, I remember I hadn't randomized any of the scenarios, participants were supposed to see. Stricken with panic, I quickly logged on to our online survey software, and luckily, found that the program could randomize it for me. No messing with latin squares or other annoying, vexing randomizing procedures. With a couple clicks of the mouse I was able to save myself from professional calamity.

The best part about my online software was I didn't even know which participants got which scenario until the results poured in. It made for a wonderful double blind experiment.  I'm now convinced that online survey software is the best way to randomize variables in a survey.