Back to Blog Emerging Markets

Survey Quality in Brazil: Observations from Early Fieldwork

Abstract concept representing survey quality observations from Brazilian fieldwork

Brazil is a substantial and growing market for online survey research, but it has distinct response-quality characteristics that do not map cleanly onto either North American panel benchmarks or the MENA and Sub-Saharan Africa contexts that our team knows most deeply. As we extend Besample's detection calibration to Latin America, Brazil has been the first market we have worked to understand in detail.

This article shares what we have observed about Brazilian panel characteristics from a signal-detection perspective. We are describing methodological observations and working hypotheses, not reported results from deployed fieldwork. Our purpose here is to be transparent about how we approach market-specific calibration and what the reasoning behind it looks like.

The Brazilian Online Panel Landscape

Brazil has a mature online panel infrastructure relative to much of Latin America. Major international aggregators operate substantial Brazilian samples, and there are several domestic panel companies with long-running recruitment histories. Panel penetration in urban centers, particularly in the South and Southeast, is comparable to mid-tier European markets in terms of respondent familiarity with survey completion.

At the same time, Brazil spans enormous geographic and socioeconomic diversity. The same panel that serves middle-class urban respondents in Sao Paulo also reaches respondents in smaller cities in the North and Northeast with meaningfully different connectivity conditions and device distributions. A quality detection framework calibrated against the urban Southeast segment will behave differently on samples drawn more broadly from across the country.

The device profile of Brazilian panelists skews mobile more heavily than North American consumer panels, though not as extremely as mobile-first markets in Sub-Saharan Africa or South Asia. Desktop completion rates are low enough that timing calibrations designed for keyboard and mouse input need adjustment for touch-primary devices, but not so low that desktop completions become outlier signals on their own.

The Acquiescence Question in Brazilian Survey Data

Acquiescence bias, the tendency of respondents to agree with positively framed items regardless of content, appears in survey data from many cultural contexts, but its magnitude and distribution varies across markets. Brazilian survey research practitioners have long noted elevated acquiescence tendencies in certain population segments, particularly in lower-income cohorts and in regions with lower educational attainment relative to the national mean.

For a quality detection system, elevated acquiescence creates a methodological challenge. If a meaningful proportion of your legitimate respondents tend to rate scale items positively regardless of content, then high-agreement response patterns that would look like straightlining in a low-acquiescence population are actually representative of genuine response behavior. Applying a detection threshold calibrated for a low-acquiescence market to Brazilian data will produce false positives among respondents whose behavior is authentic but concentrated in the upper register of a Likert scale.

The approach we are exploring for Brazilian calibration distinguishes between high-agreement and straightlining by examining within-item variance across conceptually distinct constructs. A respondent who answers 4 or 5 on every item in a brand attitude battery but shows differentiation between clearly unrelated topics is probably expressing genuine strong agreement, even if the overall pattern looks concentrated. A respondent who gives identical scores across items that are known to be orthogonal in the construct space is more likely straightlining regardless of which scale value they chose.

This is harder than straightforward pattern detection because it requires knowing something about the questionnaire structure, not just the response values. But for Brazilian panels, it is likely necessary to avoid systematic false positives among legitimate respondents in certain demographic segments.

Completion Speed Patterns and Device Effects

Brazilian mobile completion speed distributions show characteristics worth noting for calibration purposes. The combination of a high proportion of mid-range Android devices, variable 4G coverage quality, and the prevalence of survey completion in the early morning or late evening hours, when respondents are likely on lower-quality signals, produces timing distributions that have longer upper tails than equivalent samples from higher-income urban populations in the same market.

A timing floor calibrated against the central tendency of this distribution will flag a different proportion of responses than one calibrated against a North American consumer panel, even if the underlying fraud rate in the two populations is identical. The legitimate slow completions pull the distribution out, and where you place the floor relative to that distribution determines how many legitimate responses you exclude.

There is also a device-related speed effect at the low end of completion times that is worth understanding separately from fraud patterns. Certain popular Android models in the Brazilian market produce gesture inputs that register faster than comparable manual inputs on other device types. This is not a fraud indicator. It is a device-specific timing artifact that, at high sensitivity settings, would produce false positives for speed-based fraud detection. Recognizing this requires calibrating expected speed floors by device class rather than using a single minimum completion time across all devices.

Geographic Validation Challenges

Geolocation-based quality checks face specific complications in the Brazilian context. Brazil's major cities are densely built, and GPS accuracy in multi-story urban environments is subject to the same canyon-effect degradation that affects geolocation signals in other major emerging market cities. The practical effect is that declared-versus-device location matching, applied with tight geographic tolerance, will produce more false positives in dense urban areas of Brazil than in suburban or rural areas of the same market.

More significantly for panel quality, Brazil has one of the more developed VPN usage cultures in Latin America, driven by both privacy concerns and content access motivations. This creates a category of respondents who may complete surveys over VPN connections for reasons entirely unrelated to panel fraud. The geolocation mismatch that results looks identical in the signal to mismatch produced by a panelist completing from a country other than their declared location. Distinguishing these cases requires treating VPN-associated geolocation mismatches as lower confidence fraud signals than clean out-of-country placements, and weighting them accordingly relative to other signals rather than treating them as standalone exclusion triggers.

What Our Detection Approach Is Designed to Handle

The calibration work we are doing for Brazilian panels is aimed at adapting our signal weights to the specific distributional characteristics described above: adjusted acquiescence thresholds that account for cultural response tendencies in the population, timing floors calibrated to device class distributions in the market, and geolocation confidence scoring that reflects VPN prevalence in the context.

We are not claiming to have solved these calibration problems at this stage. We are describing the design direction we are pursuing and the reasoning behind it. What we do believe, based on our understanding of the detection problem, is that a quality check system that applies North American calibrations to Brazilian data will produce systematically suboptimal results in both directions: over-excluding legitimate responses from certain segments while under-detecting specific fraud patterns that the North American-derived signals were not designed to catch.

The Broader Principle for Latin America

Brazil is the largest market in Latin America for online survey research, but the calibration challenges it presents are not unique to it. Mexico, Colombia, Argentina, and other Latin American markets each present their own combinations of device distributions, connectivity patterns, cultural response tendencies, and panel maturity levels that require market-specific calibration rather than a single regional archetype.

We are starting with Brazil because of its size and the depth of academic and practitioner literature on Brazilian survey response characteristics. The goal is a Brazilian archetype that we can then adapt for other Latin American markets rather than starting from scratch in each one.

If you are running fieldwork in Brazil or other Latin American markets and have observations about response quality patterns that you have encountered in practice, we would like to hear about them. This calibration work benefits from multiple perspectives, and the practitioners who have been running fieldwork in these markets have seen patterns that methodological literature does not capture. Research at getbesample.com is the right place to reach us.

Audit your next wave with Besample

Connect your survey platform and get per-response quality scores as fieldwork runs, not after it closes.

Request Access