How we calculate scores
For a question that uses the 5 point agree/disagree scale, scores are calculated in the following way:
Responses of “agree” or “strongly agree” are counted as positive responses. Responses of “disagree” or “strongly disagree” are negative responses, and neutral responses are neutral. The score of a question is the number of responders who gave a positive responses out of the number of total responders for that question.
You've sent out a survey to all of your 150 employees. For a particular questions, 100 people in total responded (the other 50 people either skipped it or didn't get around to it). The response breakdown is as follows:
Strongly agree: 30 people
Agree: 20 people
Neutral: 10 people
Disagree: 25 people
Strong disagree: 15 people
No response: 50 people
For this question then, the score would be (30 + 20) / 100, which calculates out to 50%.
The score of a theme that contains multiple questions IS NOT the average score of all the questions within the theme.
Instead, to calculate the score of a theme, we take all of the users that have responded to at least one question associated with the theme. For each user in that group, we take all of their responses to the questions associated with the theme and calculate an average (on the scale of strongly disagree = 1 and strongly agree = 5) score for that user. If the average is 3.5 or greater, than that user is marked as having a positive response to that theme. After doing this for every user in the group, we count the number of users who qualify as having a positive response to that theme, and divide by the total number of users to calculate a score for that theme.
We use this methodology so that the score for a theme does not over-weigh the responses from people who have answered all the questions within the theme vs. those who only answered one.
Questions or themes without scores
A question or theme won't have a score associated with it for two possible reasons:
First, the question could have been set as solely a "comment" question, meaning that responders were prompted for a free text response rather than a scale rating. In this case, there is no score to show. The same applies if a theme consists only of question that are comment questions.
The second reason for this is that there aren't enough responses to a question or theme to show the score. Currently, Lattice has set an "anonymity threshold" of 3, meaning that if you are looking at a view of a question or theme that has less than five responders, no score will be shown in order to protect the anonymity of the responders.
For employees who have filled out part (or even all of a survey) but have not submitted it when the survey is ended, those filled out responses are pulled into survey analytics when the survey is ended.