Methodology › 2019 Methodology

2019 Methodology

The 2019 American Values Atlas (AVA) is a project of PRRI. Results for all demographic, religious affiliation, and political affiliation questions were based on 53,474 bilingual telephone interviews (including 33,708 cell phone interviews) conducted between January 2, 2019 and December 30, 2019 by professional interviewers under the direction of SSRS. Results for questions on specific issues are based on a subset of 40,357 telephone interviews (including 26,142 cell phone interviews) conducted between March 26, 2019 and December 29, 2019. The survey was made possible by generous support from the Arcus Foundation, the E. Rhodes & Leona B. Carpenter Foundation, the Evelyn and Walter Haas, Jr. Fund, the Gill Foundation, and Unitarian Universalist Veatch Program at Shelter Rock.

Throughout 2019, at least 1,000 interviews were completed each week, with about 600 interviews conducted among respondents on their cell phones. Mid-year, the cell phone proportion was increased to about 700 per week. Each week, interviewing occurred over a five- or six-day period, starting Tuesdays or Wednesdays and going through Sunday or Monday. The selection of respondents within households was accomplished by randomly requesting to speak with the youngest adult male or female currently living in the household.

Data collection was based on stratified, single-stage, random-digit-dialing (RDD) of landline telephone households and randomly generated cell phone numbers. The sample was designed to represent the total U.S. adult population from all 50 states, including Hawaii and Alaska, and the District of Columbia. The landline and cell phone samples were provided by Marketing Systems Group.

The weighting was accomplished in two separate stages. The first stage of weighting corrects for different probabilities of selection associated with the number of adults in each household and each respondent's telephone usage patterns. In the second stage, sample demographics were balanced to match target population parameters for gender, age, education, race and Hispanic ethnicity, region (U.S. Census definitions), population density, and telephone usage. The population density parameter was derived from 2010 Census data. The telephone usage parameter came from an analysis of the January-June 2017 National Health Interview Survey. All other weighting parameters were derived from an analysis of the U.S. Census Bureau's March 2017 Current Population Survey.

The sample weighting was accomplished using iterative proportional fitting (IFP), a process that simultaneously balances the distributions of all variables. Weights are trimmed so that they do not exceed 4.0 or fall below 0.25 to prevent individual interviews from having too much influence on the final results. The use of these weights in statistical analysis ensures that the demographic characteristics of the sample closely approximate the demographic characteristics of the target populations.

The table below shows the sample sizes for all 50 states and 39 metro areas for both sample and issue subsample. The margin of error for the total sample is +/- 0.4 percentage points at the 95% level of confidence. The margin of error for issue subsample is +/- 0.6 percentage points at the 95% level of confidence. The design effect for the total sample and the issue subsample is 1.3. In addition to sampling error, surveys may also be subject to error or bias due to question wording, context, and order effects.

Sample Sizes for States and Metro Areas

State Total Sample Issue Subsample
United States 53,474 40,357
Alabama 769 567
Alaska 268 191
Arizona 1,160 891
Arkansas 415 309
California 5,605 4,257
Colorado 1,065 831
Connecticut 604 450
Delaware 203 151
Florida 3,866 2,977
Georgia 1,845 1,413
Hawaii 207 152
Idaho 381 280
Illinois 1,635 1,259
Indiana 1,149 848
Iowa 622 461
Kansas 492 371
Kentucky 800 593
Louisiana 580 426
Maine 266 204
Maryland 967 745
Massachusetts 1,027 781
Michigan 1,879 1,419
Minnesota 945 708
Mississippi 388 282
Missouri 931 685
State Total Sample Issue Subsample
Montana 274 196
Nebraska 416 300
Nevada 463 357
New Hampshire 260 193
New Jersey 1,318 994
New Mexico 452 356
New York 3,388 2,550
North Carolina 1,884 1,429
North Dakota 182 130
Ohio 2,160 1,634
Oklahoma 573 437
Oregon 854 623
Pennsylvania 2,216 1,681
Rhode Island 163 124
South Carolina 941 721
South Dakota 157 106
Tennessee 1,099 815
Texas 3,434 2,599
Utah 628 473
Vermont 135 96
Virginia 1,529 1,147
Washington 1,268 929
West Virginia 322 235
Wisconsin 984 748
Wyoming 155 115
Metro Area Total Sample Issue Subsample
United States 53,474 40,357
Akron 134 103
Albany 204 135
Albuquerque 195 149
Allentown 154 127
Atlanta 1,000 761
Austin 266 205
Baltimore 439 333
Birmingham 162 124
Boston 723 560
Buffalo 253 188
Charleston 161 135
Charlotte 405 310
Chicago 1,200 924
Cincinnati 441 336
Cleveland 374 273
Columbus 448 354
Dallas 809 612
Denver 520 400
Detroit 841 647
El Paso 137 107
Grand Rapids 159 119
Greensboro 140 106
Greenville 210 168
Hartford 225 172
Houston 760 572
Indianapolis 414 315
Jacksonville 306 238
Kansas City 346 259
Knoxville 224 163
Las Vegas 308 240
Los Angeles 1,890 1,494
Louisville 230 170
Memphis 149 102
Miami 1,020 802
Milwaukee 267 197
Minneapolis-St. Paul 610 469
Nashville 257 194
New Orleans 175 123
New York City 3,224 2,439
Oklahoma City 187 141
Omaha 150 119
Orlando 412 333
Philadelphia 975 755
Phoenix 702 544
Pittsburgh 466 352
Portland 469 344
Providence 237 174
Raleigh 197 149
Richmond 212 160
Riverside 633 480
Rochester 187 138
Sacramento 338 251
Salt Lake City 259 202
San Antonio 293 222
San Diego 494 372
San Francisco 560 421
San Jose 217 158
Seattle 567 416
St. Louis 418 321
Tampa-St. Petersburg 544 423
Tucson 179 137
Tulsa 132 103
Virginia Beach 280 202
Washington, DC 1,139 877
Winston-Salem 169 134