The same set of considerations will be taken into account when attempting to make sense of mean scores and variance scores for this third question. The absolute value associated with each of the mean scores must be considered and we will do so when discussing results from this third question. It is also important for us to rank the mean and variance scores, given the same potential response set distortions in the data derived from responses to this question. Given these response set concerns, we offer the following listing of mean scores (from high to low) for this third question from our Study One respondents:
Question Three. In your RECENT coaching work, how much …
l. How important to you is your further development as a coach?(mean = 4.57)
b. Does this change feel like progress or improvement?(mean = 4.20)
f. Do you feel you are deepening your understanding of coaching?(mean = 4.16)
e. Do you feel you are becoming more skillful in practicing coaching?(mean = 4.13)
g. Do you feel a growing sense of enthusiasm about doing coaching?(mean = 3.95)
k. How capable do you feel to guide the development of other coaches?(mean = 3.81)
a. Do you feel you are changing as a coach?(mean = 3.73)
d. Do you feel you are overcoming past limitations as a coach?(mean = 3.56)
h. Do you feel you are becoming disillusioned about coaching?(mean = 0.52)
j. Do you feel your performance is becoming mainly routine?(mean = 0.48)
c. Does this change feel like decline or impairment?(mean = 0.20)
i. Do you feel you are losing your capacity to respond empathetically?(mean = 0.19)
Rey Carr
December 17, 2015 at 4:00 pm
The best part of this report of the results of these two surveys is the discussion of the concepts. Such discussion is valuable regardless of the reliability or validity of the results (or evidence).
Unfortunately, the methodology section is missing the most important aspect of methodology: how were each of the surveys distributed and what was the rate of return. If, as I suspect, this was an Internet-based survey, then the results have an exceptionally low chance of being either reliable or valid. That is, the likelihood that they reflect the “coaching industry” or “a typical coach” is incredibly small. Thus, conclusions based on the results are suspect.
But there’s the point. The discussion itself has its own reliability and validity independent of the survey. The points made are worthy of continuing discussion regardless of the surveys.