Researchers Measured Love With a Poor Thermometer for 30 Years. Here Is What a Better One Shows
A study of 5,315 people found that the classic relationship questionnaires asked many questions that told almost nothing. The scale that replaced them shows how satisfaction differs between newlyweds and long marriages, and what goes with it.
Do you and your partner agree on how to deal with your in-laws?
For decades, that question was part of how psychologists measured whether a relationship was happy. It sat in the most used questionnaires in the field, next to questions about friends, hobbies and whether you both prefer to stay at home or be on the go.
Then two researchers checked what each question was actually worth. The answer was awkward: many of the questions told them almost nothing about how happy a couple was.
This is the story of how relationship satisfaction is measured, why the old way was imprecise, and what the better measurement shows about love over time.
A thermometer nobody had checked
In 2007, Janette Funk and Ronald Rogge at the University of Rochester pointed out something uncomfortable about their own field. Researchers had studied what makes couples happy for thirty years, and almost all of that research rested on two questionnaires: the Marital Adjustment Test from 1959 and the Dyadic Adjustment Scale from 1976.
Nobody had tested, question by question, how precise they were. Funk and Rogge compared it to running thirty years of research on fever with one brand of thermometer, without knowing whether it was accurate to one degree or to ten.
So they checked. They put the old questionnaires and many new questions into one large online survey, and people in relationships answered all of it.
With that many answers they could use a method called item response theory, the same method used to build large standardised exams. It shows how much each single question helps to tell a happy person from an unhappy one.
The questions that told almost nothing
Some questions worked very well. They were the plain ones: how happy are you in the relationship, all things considered? Do you have a good relationship? In general, how satisfied are you?
Others worked badly. The weakest question in the whole set asked whether you and your partner prefer to be "on the go" or to stay at home in your free time. Questions about agreeing on friends and on how to deal with parents or in-laws also told the researchers little.
The reason is easy to see once it is pointed out. Happy couples disagree about in-laws too. And two people can agree on everything practical and still feel empty together. Agreement is not the same thing as satisfaction.
The result was that the long questionnaires were not much better than short ones.
Dyadic Adjustment Scale (1976), 32 questions
gave about as much information asQuality of Marriage Index, 6 questions
Marital Adjustment Test (1959), 15 questions
gave about as much information asA 4-question short form
There was one more surprise. One of the best ways to measure satisfaction was also the simplest: showing people two opposite words, such as bad and good or empty and full, and asking where their relationship falls between them. For nearly everyone, a set of fifteen such word pairs told the researchers more than the classic 32-question scale did.
Building a better one
From all the questions, Funk and Rogge kept the 32 that told them the most and overlapped the least. They called the result the Couples Satisfaction Index.
It asks directly about the relationship: how happy you are in it, how rewarding it is, whether you would choose the same person again, and whether you have had second thoughts lately. It ends with seven of the word pairs.
The new scale measured the same thing as the old ones. The scores moved together almost perfectly. But it measured with less noise. People who were about equally satisfied got more similar scores, and small real differences were easier to see.
Each answer gives points, and the total runs from 0 to 161. The average in the study was 121. The researchers also set a cut-off: scores below 104.5 point to notable dissatisfaction. That line was chosen because it sorted people the same way as the established cut-off on the older scale.
What a normal score looks like
Here is the part most people want to know. Is my score normal?
In a later talk, Rogge showed how scores were spread in different groups: people who were dating, engaged, newly married and married for many years. The picture is clear.
- Dating, age 18–19about 136
- Dating, age 20–29about 127
- Dating, age 30–39about 114
- Engaged, age 20–29about 139
- First year of marriageabout 141
- Married 1–5 yearsabout 125
- Married 5–10 yearsabout 119
- Married 10–25 yearsabout 104
Satisfaction was highest among engaged people and in the first year of marriage. It was lower in each group that had been married longer. In the group married for 10 to 25 years, the typical score sat right at the cut-off. That means about half of that group scored in the range the scale calls dissatisfied.
Three things are worth holding on to here.
The honeymoon level is not the normal level. If you compare a relationship of fifteen years with how it felt in the first year, almost every relationship loses. A score of 110 is below the overall average and above the typical score for a long marriage.
These are different people, not the same couples over time. The chart does not show that every marriage declines. Unhappy couples who split up early are not in the later groups, and the people who answer an online survey about relationships after twenty years may be the ones who are wondering. Studies that follow the same couples for years do find that satisfaction tends to fall on average, with large differences between couples.
The spread was wide in every group. Among people married for more than ten years there were scores close to 0 and scores close to 160. The typical score tells you little about any single couple.
What goes together with satisfaction
The survey also measured other things, so the researchers could see what satisfaction is linked to.
- Arguments that are left unresolved−0.79
- Thoughts and steps towards breaking up−0.78
- Constructive communication+0.71
- Stress in life in general−0.52
- Hostile conflict: yelling, nagging−0.48
- Physical and emotional chemistry+0.45
- Neuroticism (a tendency to worry)−0.38
The strongest link was not how much couples fight. It was whether their arguments get resolved. People who agreed with statements like "our arguments are left hanging and unresolved" were much less satisfied. Hostile conflict, meaning yelling and nagging, was linked to dissatisfaction as well, but clearly less.
That fits a common finding in couples research: a disagreement that ends is very different from the same disagreement that returns every month.
Chemistry mattered, but less than many would guess. General stress in life was about as strongly linked to satisfaction as the chemistry between the two.
Where personality comes in
One of the things measured was neuroticism, the Big Five trait that describes how easily a person worries and feels low. People higher in neuroticism were somewhat less satisfied with their relationships.
The link was the weakest of the seven, and that is useful to know. Personality colours how you experience a relationship, but what happens between the two of you is linked to satisfaction far more strongly than the temperament one of you brings along.
If you want to see where you fall, you can take the Big Five test and read more about neuroticism.
Can a score tell when something has changed?
A good thermometer should also pick up a change. In the same talk, Rogge reported follow-up studies where about 2,000 people answered again after weeks and months, and also said whether the relationship had become better or worse.
From the people who said nothing had changed, the researchers could see how much a score moves by chance. On the 32-question scale, a shift of about half a standard deviation was needed before it meant more than noise. That is roughly 15 points.
So if you take the test twice and move from 118 to 124, the honest reading is that nothing has changed. A move from 118 to 95 is a different matter.
What the research cannot tell us
- The participants were not a cross-section of anyone. Eight in ten were women, the average age was 26, and most were dating and not married. They found the survey through wedding forums, email lists and online ads.
- The cut-off is borrowed. The line at 104.5 was set to match the older scale's cut-off. It does not come from following couples to see who stayed together.
- The group figures come from a talk, not a published table. We read them from charts, so each can be a few points off.
- One person answers. The scale measures how you see the relationship. Your partner may see it differently.
- Satisfaction is not the same as a good relationship. A person can be satisfied in a relationship that is not good for them, and dissatisfied in one worth working on.
See it from your side, and from both
The questionnaire is free to use, and we have built it as a test. It takes about five minutes. You get your score against the cut-off, against people at your stage, and a breakdown of where your answers were lowest. You can also invite your partner and compare your two scores.
A score from one of you is half the picture. That is why we also made Pair Perspective, our own relationship test. Both of you answer 57 questions separately, and then you see where you experience the relationship alike and where you differ.
Answer the same 32 questions and see your score against the cut-off and against people at your stage.
Take the testPair Perspective is our relationship test. Answer 57 questions separately, then explore the strengths you share and the differences worth talking about.
Try Pair Perspective Opens on pairperspective.comSources and further reading
- Funk, J. L. & Rogge, R. D. (2007). Testing the ruler with item response theory: Increasing precision of measurement for relationship satisfaction with the Couples Satisfaction Index. Journal of Family Psychology, 21(4), 572–583.
- Rogge, R. D. The Couples Satisfaction Index (CSI). Lecture slides, University of Rochester. Source of the figures by stage of the relationship and on change over time.
- Karney, B. R. & Bradbury, T. N. (1997). Neuroticism, marital interaction, and the trajectory of marital satisfaction. Journal of Personality and Social Psychology, 72(5), 1075–1092.
- Locke, H. J. & Wallace, K. M. (1959). Short marital-adjustment and prediction tests: Their reliability and validity. Marriage and Family Living, 21(3), 251–255.
- Spanier, G. B. (1976). Measuring dyadic adjustment: New scales for assessing the quality of marriage and similar dyads. Journal of Marriage and the Family, 38(1), 15–28.