A social norms approach determines the exaggerated and actual norms of a population through formative research, and then informs the population of the actual norms through a message campaign. The next step is determining the effectiveness of the messages through a
summative evaluation. Finally, the results from the evaluative research can also be used to craft new messages to revise the message campaign, and thus the campaign is cyclical. The following provides a more in-depth description of the steps involved in a social norms campaign.
Formative evaluation Formative evaluation is the first step in a social norms campaign and consists of surveying the population, as well as message creation based on the survey results. The formative evaluation phase is the time when information regarding perceived norms and actual behaviors is garnered from the audience. In order for a social norms approach to be the appropriate means for intervention, two conditions must first be satisfied: •
There must be misperceptions between actual behavior and perceived behavior – This simply means that there must be a difference between what people do and what they think other people do or believe. This difference must be a misperception in the direction of overestimation of problem behavior. If there is no difference, the social norms approach is not appropriate. A caveat is that there is almost always a difference. Sometimes a more sensitive instrument is necessary to uncover the misperceptions. •
At least half of the population must behave "correctly" – If over half of the population behaves in a way that is contrary to the intervention, a social norms approach is not the best interventional strategy. Because a social norms approach assumes that individuals want to be normal, if most of the individuals (i.e., over 50%) behave in a way that is harmful, a social norms message campaign might encourage the harmful behavior. It is important to ask questions about both descriptive and injunctive norms.
Surveying The most effective way to establish the baseline levels of behavior and perceptions is through the use of surveys. Internet surveys, for example, are an often-used method of generating a substantial response rate. They are especially suited for college students because of their familiarity with the technology, the containment of the population (i.e., all are part of a specific community), and the ability of the students to take the survey at their own pace and during the time that works best for them. Not only are web surveys ideal for students, but they are also highly advantageous for researchers. They provide quick turnaround for
data analysis, higher
response rates, less missing data, and they eliminate interviewer effects. Other possible methods of administering a survey are pencil and paper surveys, phone surveys, or personal interviews. The following describes a typical and thorough process used to survey a population: •
Plan • Decide what topics will be covered • Decide when to administer the survey • Develop useful questions •
Acquire incentives to provide for respondents – There are two different types of incentives: Individual rewards and lottery rewards. Individual rewards are given to every person who completes the survey (e.g., a coupon for a free pizza). Lottery rewards are awarded to individuals at random (e.g., 10 people receive a $50 gift certificate). Individual rewards are more expensive but provide higher
response rates. •
Survey Design •
Notifying the Sample – Often, a double-barreled
method is used: • Pre-letter or pre-email notification – A personalized letter notification delivered several days before the survey opens. The letter includes the purpose and goal of the research, when and at what email address they will receive the email notification, how long the survey will be active, access information (IDs, pass codes), what they will get out of it (i.e., incentives), how their privacy will be protected, and contact information for the surveyors. • Email notification – This
email repeats much of the information of the original letter, but also provides a link for the survey. • Reminder – A reminder often mentions previous notifications, sympathizes about why the respondent might not have completed the survey, mentions the importance of the survey, and includes the incentive information again.
Creating a campaign After completing
data collection, researchers then analyze the data and search for patterns, looking for inconsistencies between actual behavior, attitudes, and perceived norms. When these differences are consistent with the campaign and the majority of students adhere to the beneficial idea, they are then used in the next round of message creation. For example, the data could show that
college students report they consumed 0–4 drinks the last time they partied, but they believe that the average student consumed 5 or more drinks. After discovering this statistic, a researcher may craft a message like, "Most students drink 0–4 drinks when they party", to correct the misperceived descriptive norm. The most important descriptive researchers look for in the data is the 51% or greater statistic, or items where "most" (i.e., over 50%) of the population adheres to the beneficial behavior. These statistics could occur in injunctive norms (i.e., "Most students believe passing out from drinking too much is wrong."), protective/healthy behaviors (i.e., "Most students use a
designated driver, even when only having one or two drinks."), or other numerous behaviors. There are different message components that can be varied, which are experimented with during pre-testing. For example, researchers test different
vocabulary (e.g., "66%" vs. "Most" vs. "Majority), using different behaviors to find out which ones are the easiest and most acceptable to perform (e.g., "eating while drinking" vs. "keeping track while drinking"), and using varying degrees of
citations (e.g., large
citations vs. small citations of data source). These preliminary messages are pretested on small groups in order to refine them before they are presented to the entire population. Other aspects examined in pretesting include which messages are most socially acceptable, which are believed to be the most effective, and which messages have the highest believability.
Believability Believability is a necessary but not a
sufficient condition for an effective campaign. If believability of messages is low, change will probably not occur because the
persuasive messages are falling into the audience's latitude of rejection. In other words, the audience will reject the message without even considering it. It is also important to note, however, that if believability is extremely high (e.g., over 90%), change is also unlikely to occur because the message is not challenging enough. In other words, it serves only as a
reinforcement rather than an element of change. Thus, while there are no specific
guidelines, it is ideal to aim for believability above 50%. In an assessment of the believability of a social norms campaign, Polonec, Major, and Atwood found that students' own drinking experiences and the experiences of their friends contributed to disbelief in the message "Most students on campus choose to have 0 to 4 drinks when they party." Another study found that disbelief may be due to preconceived notions about drinking that students develop even before they arrive on campus.
Evaluation After implementing a campaign, researchers then perform a summative evaluation which measures the success of the campaign. This step consists of examining and evaluating the progress made by an intervention through assessing the outcome and impact,
cost and benefits, and
cost effectiveness of a program. It is typical for researchers to use surveys similar to those used in formative evaluation. The following are questions that a
summative evaluation can answer: •
Did change occur in perceptions? A social norms approach is based on correcting misperceptions before changing behavior. The changes in behavior are thought to occur as an outcome of corrected perceptions. The goal is thus for the population to understand the prevalent behavior so they do not feel they have to live up to misperceived norms of behavior. If there is a reduction in misperceptions, then the campaign has been implemented in a manner consistent with the social norms approach. •
How much change occurred? Is the difference significant or is it equally likely to have been caused by chance? •
Is the change associated with the intervention? Are the changes observed the result of some other factor or is there reason to believe the program was the basis for the change? This question can be answered by comparing the results with nationwide averages. •
How much did it cost? This is a method of weighing the benefits achieved by a program against its cost. An especially important part of
summative evaluation is the assessment of
market saturation and reach. Clearly, if a social norms campaign does not reach very much of its intended audience, then its potential effectiveness decreases. If researchers can demonstrate that their campaign had high reach, then that strengthens the connection of the intervention to positive outcomes. It also lets researchers know what methods are effective for distributing the campaign. It is necessary for an audience to be exposed to campaign messages frequently to change misperceptions. However, overexposure is possible, leading to a loss of
credibility and
habituation. Thus, it is important to determine the proper dosage of the campaign in order to achieve maximum effectiveness. Silk et al. provide a comprehensive evaluation of a socials norms campaign related to mental health among college students, revealing positive outcomes for students who were exposed to the social norms campaign (e.g., greater likelihood to visit the university's counseling center). Once the evaluation is complete, it has the potential to help the
intervention.
Summative evaluation not only tells whether a program is working, but it can also feed new messages and new campaigns by providing new, updated data. == Glossary ==