BernhardSchieber

Communication Surveys: Measure a Defined Construct Not Communication in General

Communication · Executive Insight Brief · 186

A survey needs an object

Decision-led design turns employee or stakeholder self-report into evidence without inventing a universal questionnaire in organizational practice.

Premise

A survey described simply as measuring communication has no stable object. Timeliness, access, clarity, credibility, channel use, satisfaction, feedback, and psychological safety are different constructs requiring different questions. The executive discipline is to begin with the decision and evidence gap, then design the shortest survey respondents can answer reliably. Digital distribution, anonymity, or a census invitation does not compensate for an undefined construct or biased response process.

The essential model

There is no canonical Communication Survey or single originator. Defensible practice combines general survey methodology with validated communication measures appropriate to the population and purpose. A survey brief should specify decision, constructs, target population, coverage and sampling, confidentiality, response mode, analysis, and reporting audience. Items should address one idea, use meaningful time frames, and match frequency, evaluation, agreement, importance, or satisfaction with an appropriate response format. Cognitive and pilot testing examine how respondents understand, retrieve, judge, and map experience onto answers. Nonresponse, mode, language, routing, missing data, and weighting remain part of the measurement.

Communication Survey — A survey needs an object. Executive Insight Brief 186 by Bernhard Schieber.

Why this matters

If leaders believe remote employees ignore internal messages, a useful survey might separately assess timely receipt of task information, later retrieval of authoritative decisions, and channel use for urgent versus reference needs. Stratified sampling covers relevant roles, and pilots test wording and mobile access. High satisfaction with alerts alongside poor decision retrieval among remote teams identifies a localized system question. Comments about conflicting versions in chat and email can guide interviews and document analysis. The evidence does not justify labeling remote employees poor communicators.

Risks and limits

Self-report reflects memory, interpretation, current events, and social desirability. A census can still suffer concentrated nonresponse, while mandatory participation can produce compliance without candor. Group differences may reflect tenure, geography, role composition, or exposure rather than communication management. Means can conceal distributions and “not applicable” experience. Confidentiality must match the data architecture because demographic combinations can re-identify respondents. Validated scales may carry copyright or license conditions; custom items do not transfer those rights automatically.

Executive takeaway

Approve a communication survey only when every item traces to a construct, population, decision, and analysis. Review distributions and response patterns before averages, triangulate surprising findings, and state what the survey cannot establish. Repeated measurement is valuable only when design and context remain comparable enough for change to be interpretable. Before launch, test mobile presentation, accessibility, translations, routing, completion burden, and the credibility of the confidentiality promise. After fielding, document exclusions, missing-data and weighting rules rather than allowing dashboard defaults to determine the organizational conclusion. Survey results describe what selected respondents reported under particular fieldwork conditions; they do not independently explain the underlying communication system on their own.

Key questions

  • What decision and precisely defined communication construct does each proposed item support?
  • Who is missing from the coverage frame or response pool, and how could that nonresponse change the result?
  • Do wording, time frame, mode, language, routing, and response options match what respondents can actually know?
  • Which survey finding requires interviews, observation, network data, or communication artifacts before leaders intervene?

Selected sources

  • Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method (4th ed.). Wiley.
  • Groves, R. M., Fowler, F. J., Jr., Couper, M. P., Lepkowski, J. M., Singer, E., & Tourangeau, R. (2009). Survey Methodology (2nd ed.). Wiley.
  • Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The Psychology of Survey Response. Cambridge University Press.
Brief 0Axiom 0: Communication is EverythingRead the axiom →
What these mean

Editorial orientation · Family

Tool

In this series, Tool names the editorial family primarily used to act on, examine, measure or organize communication. It includes instruments, methods, practices, protocols, codes and institutional arrangements. Membership does not certify effectiveness, portability or safe use in every setting.

Editorial orientation · Category

Research & Analysis Methods

Establishes procedures for collecting, coding, comparing or interpreting information for inquiry or analysis. Its contribution is a defensible route from observations or materials to an account, finding or interpretation.

All Communication briefs · Knowledge