WeProx logo
Use case

Realtor.com Mobile Proxies for MLS Listing Data

Realtor.com draws its for-sale inventory from MLS feeds, which makes it a useful place to watch listing status changes, open house schedules and price edits close to the source. It is also a heavily protected site, and crawlers that ignore how it paginates and how it reacts to fast traffic spend most of their time reading challenge pages. The notes below are written for analysts tracking public listing data for market research, and for brokerages checking how their own listings are displayed, using a WeProx dedicated US carrier line with a pacing plan that fits the site.

Which fields are worth tracking

Each listing page exposes status (for sale, pending, contingent, sold, off market), list price and price changes, open house dates, property details, the listing brokerage, and extra layers such as flood and noise information that Realtor.com licenses from third parties. For market research, the high-value signals are transitions: a status flip, a price reduction, a new open house, a relisting under a new ID. Those transitions happen on the listing's schedule, not yours, so a sensible job checks each property on a cadence tied to how quickly the market moves, not as fast as the network allows.

Third-party layers such as flood risk are licensed content. Record that a property carries a given rating if your terms review allows it, but do not republish those layers in full.

URL structure and pagination

Search pages are organized by place, with a city and state slug in the path and page numbers appended as a path segment such as pg-2, pg-3 and so on. Filters for price, beds and property type are also encoded in the path. Like most listing portals, a single search stops returning new homes after a limited number of pages, so large cities need to be split by zip code, neighborhood or price band. Store the property ID from each result and compare the unique count against the total the page reports; a gap means your slice is too large or pagination was interrupted by a challenge page that your parser silently accepted as an empty result.

Why a carrier line helps here, and its limits

Realtor.com screens traffic with bot management that weighs several signals at once: IP reputation, TLS and browser fingerprint, cookie continuity and request timing. Datacenter ranges start with a poor score on the first of those. A WeProx line is a real AT&T, T-Mobile or Verizon device, and its address sits in the carrier's CGNAT pool alongside ordinary phones, so the IP signal stops working against you. The other signals are still yours to get right. An HTTP client with a default library fingerprint and perfectly regular timing will be challenged from any address, mobile or not.

Use a real browser engine for pages that need rendering, keep cookies consistent within a session, and let each session look like a person working through a neighborhood: a search page, a few listings, a pause.

A pacing plan that holds up

Keep each sticky session to one search slice and a modest number of listing pages, then rotate the line and start fresh. Keep concurrency per line low against Realtor.com and spread work across several lines if you need coverage across many metros. Unlimited data removes any reason to block images or fonts, which otherwise makes a browser session look unusual. Run daily jobs at varied start times instead of on the stroke of the hour.

Reading failures correctly

A 429 response means slow down on that line. A challenge page with a normal status is the quieter signal, so validate that each body contains the listing data you expect before writing it to storage. A cluster of failures seconds after a rotation is the modem re-attaching to the carrier; wait, verify the new IP, continue. If one metro's line is repeatedly challenged while others are fine, compare its recent request volume before assuming anything about the address.

Keep each run's slice definitions with the data so later comparisons use identical boundaries.

Setting up a Realtor.com proxy on WeProx

  1. Choose a WeProx metro and carrier at checkout, or any city with stock.
  2. Copy the line's host, port, username, password and rotation URL.
  3. Split each target city into zip or price slices that fit within the page limit.
  4. Configure a browser-based collector with one sticky session per slice.
  5. Validate every body for listing fields before storing it.
  6. Rotate between slices and log exit IP, slice and status for each request.

Realtor.com proxy questions

Is collecting Realtor.com data allowed?

The site's terms, robots rules and applicable law decide that, and its terms restrict automated access. Keep to public data you have a legitimate reason to monitor, at a low rate, or license MLS data directly. A proxy only changes the network path.

Why do I get empty search pages after page two?

Usually a challenge page parsed as an empty result, or a slice larger than the pagination limit. Validate bodies and split the search into smaller slices.

How many lines do I need for several metros?

Coverage depends on pace, not bandwidth. One line can handle a modest daily watchlist across metros, but spreading work across a few lines keeps each one's request rate low.

Does the line's metro change results?

Search results follow the location in the URL. The line's metro mainly affects default views and suggestions. WeProx lines run in eight US metros and moving one is free.

Real US carrier IPs for Realtor.com

Dedicated 4G and 5G lines in eight US metros. Sticky sessions, unlimited rotation, HTTP(S) and SOCKS5. From $4/day.

View plans See all locations

More WeProx use cases

All WeProx use cases →