Index our websites so that EVERY property detail page is indexed for Google and search engines
Why XXXXX.kw.com Listing Pages Aren’t Showing Up in Web Searches? No Indexed Pages for Each Listing: Unlike Zillow, your KW site might not be creating permanent, search-friendly pages for every listing that Google can crawl. Often, IDX search results are dynamic (generated when a user searches) and may not be exposed for Google to index. Unless your site provides an indexable URL for each property (e.g. a “property details” page that Google can find via links or sitemaps), those pages won’t appear in search. It looks like XXXXX.kw.com’s listings are behind a search interface – Google isn’t easily finding or indexing those individual property URLs. Even if the URL exists, there may be no direct links on your site that Googlebot can follow to discover all those pages.
Possible Restrictions (Robots/Noindex): Many IDX platforms intentionally add noindex meta tags or use a subdomain specifically to prevent indexing of listing pages. This is done to avoid SEO penalties for duplicate content. We’d need to verify, but it’s possible Keller Williams’ site template or the MLS rules add a noindex tag to property detail pages. If that’s the case, Google is literally instructed not to index those pages. (Our quick check didn’t show a visible noindex tag, but the site’s behavior suggests limited indexing regardless.) Some real estate agents choose to keep IDX pages unindexed and focus SEO on their own content – this might be happening by design on KW’s platform.

-
Jeff Guykema commented
It would also be helpful if we could have access to the system files for our website (robots.txt) so that we can add helpful information for Google and AI to search structured content on our site.