Frequently Asked Questions

1. What problem is the Public Pulse trying to solve?

The Public Pulse addresses the lack of a systematic, vetted, and accessible synthesis of public opinion on key policy issues. While many polls exist, they are scattered, uneven in quality, and often reported in isolation, making it difficult to understand where the public actually stands overall. Individual polls also vary in methods, wording, and quality, and are often cited selectively or without context. The Public Pulse evaluates and synthesizes across surveys to provide a clearer, more reliable picture.

2. How is this different from a literature review?

The Public Pulse is in essence an enhanced and expanded extension of a traditional literature review.  The Public Pulse evaluates, compares, and synthesizes survey findings using standardized criteria, with a focus on usability, transparency, and interpretation for non-specialists.

3. How is this different from polling aggregation?

Polling aggregation typically averages results and is appropriate mainly for a few standardized questions which are asked in consistent ways across survey organizations (presidential job approval and horse race polls.) The Public Pulse deals with survey questions asking about complex policy issues, usually with differing question wordings and approaches.  The Public Pulse addresses this situation by assessing survey quality, question wording, consistency, and uncertainty, and by explaining why results may differ.

4. How is this different from journalism or expert commentary?

The Public Pulse does not offer opinions or advocacy. It provides neutral, evidence-based syntheses of survey research summarizing what the American public thinks about key policy issues. The Public Pulse synthesizes and reports on what the public is thinking and feeling, not the thoughts of elites, journalists or other individual opinion makers, separating what the data show from interpretation or argument. The Stanford team working on the Public Pulse consists of sociologists, political scientists, and psychologists who are experienced and expert in the study of public opinion and survey analysis. The Public Pulse Board of Advisors includes leading public opinion polling experts from across business and academia. 

5. Why should public opinion matter for policy decisions?

Public opinion provides essential information about citizens’ views, priorities, and judgments—information which provides context and understanding behind the legally binding, periodic vote. While public opinion does not dictate policy, leaders make better decisions when they understand where the public stands rather than relying solely on anecdote, ideology, lobbying, or other selective feedback.

6. Is this project arguing that policy should follow majority opinion?

No. The Public Pulse does not make normative claims about the degree to which public opinion should dictate policy. Rather, the Public Pulse provides definitive reviews and summaries of public opinion as an important component of the policy making process, available for use by elected representatives, journalists, and the general public. 

7. Is The Public Pulse promoting a particular policy agenda?

No. The project is explicitly neutral and non-advocacy-oriented. It is not developed to favor outcomes or to bolster existing positions.  It documents and evaluates American public opinion as measured by surveys.

8. Who decides which issues are “key policy issues”?

Issues are selected based on their salience in legislative, policy, and journalistic debate, with input from Public Pulse staff and from a Board of Advisors made up of experienced experts in the field of survey research. Selection also takes into account topics which have been well researched by survey organizations. 

9. What surveys are included, which are excluded?

Surveys are included in Public Pulse reviews and reports based on methodological quality, transparency, and relevance. Low-quality or poorly documented surveys are excluded. The procedures for inclusion are documented and transparent. 

10. How do you handle differences in question wording?

Differences in wording across survey questions asking about policy topics are the norm rather than the exception. One of the objectives for the Public Pulse is to treat question wording differences as substantive evidence, not noise. The Public Pulse explicitly analyzes how question wording and format affect results and focuses on what can be learned from different approaches to measuring opinion on each issue. Conflicts are reported and explained, not averaged away. 

11. Does the Public Pulse process reduce complex attitudes to simple percentages?

The process of using survey questions to assess public opinion on any given topic is, with some exceptions, one of asking respondents to evaluate and report their personal opinions on a quantitative scale.  As is the case in the use of quantitative tests and measures in medical science as a key window into the health and disease process of individuals, such measures are a key method for understanding public opinion.  But, as is also the case with medical science, these quantitative measures (including percentages) are analyzed in context, and taken as a whole, with the objective of arriving at a thorough and valid understanding of the public’s views on the key policy issues of the day. 

12. How do you handle uncertainty, ignorance, or non-attitudes?

The Public Pulse explicitly discusses the challenges associated with differing levels of public knowledge, uncertainty, and weakly held opinions.

13. How does the Public Pulse handle changes over time in public opinion?

The Public Pulse focuses mainly on current public opinion, under the assumption that where the public stands today is of the most relevance to the intended audience of leaders, policy makers, journalists and the American public. Trends and the durability of opinions are discussed when relevant data are available.

14. How do you handle partisan, ideological, or demographic divides? Is national public opinion the right level of analysis?

The primary focus of the Public Pulse is on national public opinion, based on philosophic assumptions about the nature of a representative democracy.  Partisan, regional, demographic and other subgroup analyses are included where relevant and data permit.

15. Why should we trust this synthesis?

Because it is transparent, methodologically grounded, overseen by experts, open-source, and neutral, with clear documentation of decisions and uncertainty.

16. Is the methodology documented and replicable?

Yes. Public Pulse methods, criteria, and sources are fully documented, allowing all involved to evaluate, critique, or replicate the work.

17. How often will the synthesis be updated?

Reviews are updated on a rolling, as-needed basis, triggered by new high-quality data, major events, or meaningful shifts in public opinion.

Frequently Asked Questions Relating to the Science of Survey Research and Public Pulse Methodological Foundations

1. How are the topics for each Public Pulse report selected?  

Topics for inclusion in a Public Pulse report are chosen based on four criteria:

• Ongoing public and policy debate
• Relevance to legislation or government action
• Availability of reliable polling data
• Demonstrated public interest. 

Public Pulse leadership and Board of Advisors oversee topic selection. The Public Pulse will also receive suggestions from external sources.

2. How is each issue subdivided into subtopics?

Broad issues (e.g., gun policy, immigration) are divided into subtopics based on the common themes that appear across survey questions within that issue area. This allows Public Pulse to provide detailed analysis of public opinion on the specific aspects of each issue for which there is relevant survey data. The list of subtopics for each general topic is reviewed by subject matter experts. 

3. What is the process of finding the questions included in the report?

Public opinion data used for inclusion in the Public Pulse reports are developed based on searches across multiple platforms, including:

• The Roper Center for Public Opinion Research (iPoll database)
• Google, AI, and other search engines
• Continual monitoring of selected, high-quality polling organizations

While Roper iPoll provides extensive coverage of major polling organizations, some surveys are either too recent to appear in iPoll or conducted by organizations that are not yet archived there.

To capture these, the Public Pulse team manually reviews each approved organization’s official polling archive—typically available on their websites—scanning all polls conducted between the established dates for inclusion. Any poll containing topic questions is flagged and cross-referenced with the Roper iPoll exports. Questions not present in the Roper data are marked for manual extraction.

Most flagged polls are available only in PDF topline format. The goal is to extract each question, its response options and percentages, and all available metadata—matching the exact structure used in Roper iPoll for seamless merging. 

Link to Roper iPoll

4. How was the structure of the report developed? 

For each subtopic, the Public Pulse analytic team produces an in-depth summary and analysis of public opinion, based on a rigorous review of high-quality available data. This comprehensive review and synthesis serve as the final output of the Public Pulse process and forms the basis of what is shared with the intended audience.

The format of each Public Pulse report follows this structure: 

1. Key Point Summary
2. Availability of Data and Confidence in Conclusions
3. Policy Implications
4. Detailed Discussion
   1. Graphic Representation
   2. Overall Support Levels
   3. Impact of Question Wording and Context
   4. Trends Over Time
5. Supporting References

The strength of the evidence becomes part of the review, helping users assess how reliable and actionable the public opinion data is on any specific topic.

Each Public Pulse report is developed, written, and finalized using a multi-stage process.

1. A refined and systematic AI process is used to create an initial and broad starting point summary of what the data show about public opinion on the subtopic
2. A team of trained mid-level analysts review and revise
3. A senior level Public Pulse expert scholar reviews and revises
4. The report is reviewed by experts from the Public Pulse Board of Advisors and other subject matter experts
5. How is the issue of conflicting results and different question wording dealt with?

Each subtopic report includes analysis of conflicting results and question wording differences. The core focus is analyzing how the responses to specific question stimuli further the understanding of underlying public opinion on an issue.  In short, what do we learn about public opinion on a policy issue by examining the patterns of responses to questions that use different wordings? 

5. Why was the decision made to focus on national samples, rather than state and CD level populations? And why the focus on national samples rather than partisan or demographic subgroups? 

The Public Pulse focuses primarily on measures of public opinion representing the national population. This approach reflects both the design of the American political system and the nature of the policy questions available for inclusion in the report.

While political representation in the United States is organized geographically, the structure of the Constitution was designed to aggregate local and regional interests into decisions made on behalf of the nation as a whole. Federal policy is enacted with national scope and authority, and elected officials are charged not merely with reflecting the preferences of their immediate constituencies, but with exercising judgment in light of broader national interests. For this reason, national public opinion remains a central indicator of democratic legitimacy for national policy.

The Founders put the representative democracy together under an assumption that the president is elected by a national vote, and that the 435 members of Congress and the 100 members of the Senate represent the nation taken as a whole. Votes in Congress and votes in the Senate are tallied across the entire group and have political force depending on the overall (not partisan) vote. 

Measuring opinion at the national level does not assume that public preferences are uniform across states or regions, nor does it imply that majority national opinion should automatically determine policy outcomes. Rather, national measures provide a common reference point for understanding how Americans collectively view key policy choices and the prevailing public climate within which political decisions are made.

Additionally, there are practical issues. Data collection on specific issues across states, congressional districts, or other geographic units are unsystematic and rarely employ consistent question wording or methods. This lack of routine or systematic data collection on key policy issues makes it generally difficult to provide worthwhile information at subnational levels. 

The Public Pulse team continues to explore mechanisms created to impute CD and state level response to national questions, although these processes depend on large initial national samples as the baseline database from which imputations are developed. 

Almost all questions relating to major policy issues and areas of concern are viewed differently by partisan and demographic subgroups of the American population. For the reasons outlined above, however, the major focus on the Public Pulse reports remains on the national population. This approach reflects the purpose of the project: to assess how Americans collectively view major national policy questions, rather than to catalog divisions among political parties or other subgroups.

Political parties play an important role in structuring political competition, but they are not governing institutions and do not hold formal responsibility for public policy. Federal policy is enacted in the name of the nation, and its legitimacy ultimately rests on public consent that extends beyond partisan affiliation. For this reason, national public opinion provides the most valuable measure of the overall public climate surrounding key policy issues. By emphasizing national measures, the Public Pulse seeks to capture the broader contours of public agreement and disagreement that define the political environment in which policy decisions are made.

This approach does not deny the importance of partisan differences, nor does it suggest that such divisions are irrelevant to political outcomes. However, subgroup analyses are treated as secondary to the central question of how the American public, taken as a whole, views national policy choices.

6. Why does the report focus mainly on current public opinion versus historical trends in public opinion?

The Public Pulse emphasizes current measures of public opinion on key policy issues, rather than organizing its primary analyses around long-term trend data. This decision reflects the practical purpose of the project: to inform contemporary decision-making by elected officials, policymakers, journalists, and the public.

Public policy decisions are for the most part made in response to prevailing political, economic, or social conditions. In this context, the most relevant question for decision-makers is not how opinion has evolved over decades, but where the public stands now. Current public opinion provides a direct measure of the political environment within which choices must be made, debates framed, and actions justified.

The Public Pulse recognizes that overtime trends offer valuable scholarly insight into opinion stability, change, and generational dynamics. Trend data can thus illuminate how attitudes arrived at their present state, but they are less directly applicable to near-term policy deliberation. 

Accordingly, the Public Pulse treats trend analysis as complementary rather than central. Where historical context materially clarifies present opinion, trend data will be included and referenced to provide perspective. However, the primary analytic focus remains on contemporaneous measures that reflect the public’s current judgments about national policy issues.

7. How was the decision made on which survey were “qualified” for inclusion in the report? 

The surveys from which each potential question is obtained are reviewed in stages to meet five core standards:

1. Transparency

   Polls must disclose full methodological details per AAPOR and Roper Center standards. If these details are missing, the survey is excluded.

2. Probability Sampling

   Only surveys using probability-based sampling are included, as in those included in Roper’s “Longstanding Methods” collection.

3. National Scope

   We prioritize surveys of U.S. adults or registered voters. Local or regional polls may be referenced when relevant to subgroup analysis.

4. Recent Data

   Most included surveys will be from the past 2–4 years. Older data may be used for trend analysis when newer data are unavailable.

5. Non-Advocacy Sources

   Surveys conducted by organizations with stated advocacy goals or objectives relating to the survey subject matter will normally be excluded. 

The application of these criteria generally leads to the inclusion of nonpartisan surveys from news organizations, universities, nonprofits, and commercial firms with public interest missions. 

The curated list of High Quality Polling Organizations that meet the inclusion and methodological criteria described above are recognized for consistent transparency, use of probability-based sampling, and public availability of data. This list is not static. Additional organizations will be included as appropriate. Additionally, individual survey questions from approved survey organization are each screened for inclusion based on the general Public Pulse criteria.  

8. How do the Public Pulse reports deal with differences between national adults versus registered voters?

The Public Pulse draws on national survey samples of both U.S. adults and registered voters. This approach reflects a practical and methodological judgment grounded in contemporary survey research practice.

High-quality public opinion polling organizations make independent decisions about whether to survey national adults or registered voters, depending on considerations of study purpose and in some instances historical practice.  Limiting analysis to studies based on only one of these sample bases would unnecessarily exclude valuable, rigorously collected data and reduce the breadth of evidence available for understanding public opinion on key policy issues.

Empirically, differences in policy attitudes between national adult samples and registered voter samples are typically modest. While registered voters may differ slightly from the broader adult population in levels of political engagement, these differences rarely produce substantively divergent conclusions about public support or opposition to major national policies. As a result, both sample bases provide valid and informative measures of the national opinion climate.

Conceptually, national policy affects all adults, not solely those who are registered or likely to vote. Measures drawn from adult samples capture the views of the broader population subject to federal policy, while registered voter samples reflect the opinions of those more directly engaged in electoral politics. Taken together, these perspectives offer complementary insights into national public sentiment.

Accordingly, the Public Pulse treats national adult and registered voter samples as appropriate indicators of public opinion on national policy issues. Where distinctions between these groups are analytically meaningful, they will be noted. However, the primary emphasis remains on the overall direction and level of national opinion rather than on differences arising from sample base alone.

9. How do the reports deal with the issue of differing levels of interest, strength of opinion, and intensity of about each topic and subtopic?

These are important concerns and remain a theoretical focus point of the Public Pulse process. However, at this point in time, there is very little data on strength and intensity of opinion routinely included in the surveys whose data form the basis for the Public Pulse report. This makes it impossible to assess strength and intensity of opinion for most of the subtopics addressed. The Public Pulse team continues to consider possible avenues by which this type of important data can be collected in the future. .

10. What is the basis for the decision to develop levels of confidence that are reported for the data for each subtopic? 

The Public Pulse includes a confidence rating for each topical summary designed to estimate the degree of certainty associated with the report’s characterization of public opinion. This rating is intended to help readers distinguish between findings that are strongly supported by the available evidence and those that are necessarily more tentative.

The confidence rating is based primarily on two factors.

First, it reflects the volume of relevant survey data available on a given topic. Topics that have been examined frequently across multiple high-quality surveys provide a stronger empirical foundation for summarizing public opinion than topics with limited or sporadic measurement. In general, a larger body of data allows for greater confidence that observed patterns reflect underlying population attitudes rather than sampling variability or isolated findings.

Second, the confidence rating incorporates the degree of congruence among survey findings. When multiple surveys produce similar estimates of public opinion, confidence in the accuracy of the summary increases. Conversely, when surveys yield widely divergent results, confidence is reduced, reflecting greater uncertainty about the public’s true position. Divergence may arise from question wording, timing, context, or genuine instability in public attitudes, all of which complicate precise estimation.

Together, the amount of data and the consistency of findings provide a practical and transparent basis for assessing confidence in summaries of public opinion. The confidence rating does not express certainty about future opinion or policy outcomes, nor does it imply normative judgment. Rather, it communicates the strength of the existing empirical evidence supporting each summary.