For the past three decades, National Journal has rated members of Congress based on selected roll-call votes from the previous year to see how they compared with each other on an ideological scale. Unlike interest groups that rate lawmakers, National Journal does not attempt to say how members should have voted. Our goal is to describe how they voted in comparison with one another.
The ratings system was devised in 1981 under the direction of Bill Schneider, a political analyst and longtime contributor to National Journal.
For the 2013 ratings, National Journal examined all of the roll-call votes in the first session of the 113th Congress — 641 in the House and 291 in the Senate — and identified the ones that show ideological distinctions between members. Many votes did not make the cut — those that involve noncontroversial issues or that fall along regional lines, for instance. In the end, 117 votes in the Senate and 111 votes in the House were selected and were categorized as economic, foreign, or social.
As in other years recently, economic issues dominated the House’s attention; there were fewer votes on social issues (such as abortion rights or gun control) and foreign issues (such as war funding and foreign aid). The Senate voted on more social issues than the House because of its consideration of immigration and gun-control measures.
Lists were downloaded from the House and Senate websites showing how all the members voted on the selected votes. The votes in each issue area were then subjected to a principal-components analysis, a statistical procedure designed to determine the degree to which each vote resembled other votes in the same category (the same members tending to vote together).
The analysis also revealed which yea votes correlated with which nay votes within each issue area (members voting yea on certain issues tended to vote nay on others). The yea and nay positions on each roll call were then identified as conservative or liberal.
Each roll-call vote was assigned a weight from 1 (lowest) to 3 (highest), based on the degree to which it correlated with other votes in the same issue area. A higher weight means that a vote was more strongly correlated with other votes and was, therefore, a better test of economic, social, or foreign policy ideology. The votes in each issue area were combined in an index (liberal or conservative votes as a percentage of total votes cast, with each vote weighted 1, 2, or 3).
Absences and abstentions were not counted; instead, the percentage base was adjusted to compensate for missed roll calls. A member who missed more than half of the votes in any issue category was scored as “missing” in that category (shown as an asterisk [*] in the vote-rating tables).
Members were then ranked from the most liberal to the most conservative in each issue area. These rankings were used to assign liberal and conservative percentile ratings to all members of Congress.
The liberal percentile score means that the member voted more liberal than that percentage of his or her colleagues in that issue area in 2013. The conservative figure means that the member voted more conservative than that percentage of his or her colleagues.
For example, a House member in the 30th percentile of liberals and the 60th percentile of conservatives on economic issues voted more liberal than 30 percent of the House and more conservative than 60 percent of the House on those issues, and was tied with the remaining 10 percent. The scores do not mean that the member voted liberal 30 percent of the time and voted conservative 60 percent of the time.
Percentile scores can range from a minimum of 0 to a maximum of 100. Some members, however, voted either consistently liberal or consistently conservative on every roll call. As a result, there are ties at both the liberal and the conservative ends of each scale. For that reason, the maximum percentiles are usually less than 100. This was most apparent in the social and foreign categories in the Senate last year. Many members had the same scores because they voted alike. In the economic category, there were fewer ties.
Members also receive a composite liberal score and a composite conservative score determined by their issue-based scores. Members who missed more than half of the votes in any of the three issue categories do not receive composite scores (shown as an asterisk [*] in the vote-rating tables).
To determine a member’s composite liberal score, for example, first add the liberal scores in all three issue areas. Next, in each issue area, calculate 100 minus the member’s conservative score and add the three results together. The two figures are then combined and divided by 6 (the number of individual scores).
Critics have sometimes accused National Journal of rigging the vote ratings so that certain members of Congress are ranked as the most liberal or most conservative. The criticism is unfounded. When we select the votes, we have no idea how an individual member of Congress will be ranked.
Keep in mind that no single measure of voting behavior is likely to be perfect. For instance, consider the hypothetical example of a vote in the House on cutting domestic spending. Let’s say the bill passed with overwhelming support from House Republicans and overwhelming opposition from House Democrats. A vote for the bill would be counted as conservative and a vote against the bill would be counted as liberal. But let’s say a handful of House Republican conservatives voted against the bill on the grounds that the budget cuts didn’t go far enough. In so doing, they voted against most conservatives and with most liberals. Their votes would be counted as liberal because they voted with liberals. It’s beyond the capacity of a vote-ratings system to determine why a member voted the way he or she did on any particular piece of legislation. For that reason, some high-profile votes that have conservatives voting against a measure because it isn’t conservative enough and liberals voting against the same measure because it isn’t liberal enough are often omitted from the vote ratings.
National Journal‘s annual vote ratings, like any other vote ratings, should be viewed as a tool in assessing a member of Congress but not the only tool. Other vote ratings should also be taken into consideration, as should attributes beyond the capability of a rating system to assess, such as leadership and effectiveness.
What We're Following See More »
Not since Eagles fans booed Santa Claus have this many people been dismayed at Philadelphia. Traffic gridlock, poor logistics, and the inevitable summer heat and thunderstorms are drawing the ire of convention goers, as "peeved" delegates complained about "Homerian odysseys" to get from place to place. "On Twitter, out-of-town media complained about the logistics of the convention, spread out between the sports complex in South Philadelphia, media tents a hike away, and the daytime events at the Convention Center in Center City."
"Two attackers killed a priest with a blade and seriously wounded another hostage in a church in northern France on Tuesday before being shot dead by French police. The attack took place during morning mass at the Saint-Etienne parish church, south of Rouen in Normandy. Five people were initially taken hostage." The case has been referred to anti-terrorism officials in Paris.
"Sometimes, unity is procedural. Mr. Sanders’s delegates will get the chance to back him in a roll-call vote from the convention floor on Tuesday, a largely symbolic gesture intended to recognize the breadth of Mr. Sanders’s support as the former rival campaigns negotiate an awkward peace." Around 6 p.m., they'll begin calling the states to vote. Sanders won't be in a generous mood—at least at the beginning. Last night from the stage, he said, "I look forward to your votes during the roll call tomorrow night." Indeed, in 2008, Clinton herself insisted on a roll call, before halting it "midway through, asking that Mr. Obama be approved by acclamation."
Instead of his usual stump speech, Bernie Sanders tonight threw his support behind Hillary Clinton, providing a clear contrast between Clinton and GOP nominee Donald Trump on the many issues he used to discuss in his campaign stump speeches. Sanders spoke glowingly about the presumptive Democratic nominee, lauding her work as first lady and as a strong advocate for women and the poor. “We need leadership in this country which will improve the lives of working families, the children, the elderly, the sick and the poor,” he said. “Hillary Clinton will make a great president, and I am proud to stand with her tonight."
In a stark contrast from Michelle Obama's uplifting speech, Massachusetts Senator Elizabeth Warren spoke about the rigged system plaguing Americans before launching into a full-throated rebuke of GOP nominee Donald Trump. Trump is "a man who has never sacrificed anything for anyone," she claimed, before saying he "must never be president of the United States." She called him divisive and selfish, and said the American people won't accept his "hate-filled America." In addition to Trump, Warren went after the Republican Party as a whole. "To Republicans in Congress who said no, this November the American people are coming for you," she said.