T2 Industries

Live · T2Bot crawling now

The web, indexed fresh.
One API away.

T2 runs its own crawler and keeps re-checking what it has, so you can search the web, read the clean text of any page, profile a domain, and follow what changed — through a REST API or straight from an AI agent over MCP. Every record says when we last saw it.

Get a free API key See pricing

  • 1,000 free credits every month
  • No card to start
  • Public pages only · never AI training
385M+pages in the search index
1.1B+URLs discovered and queued
30M+sites with pages in the index
0bytes of visitor data collected. Ever.

Fresh by design

A snapshot is stale the day it ships. A crawler that keeps going is not.

Free web datasets are monthly snapshots. T2 keeps re-visiting what it has, spends its budget where pages actually change, and records every change it sees — so the freshest data and its history come from the same place.

24 h · robots.txtdaily · fast pagesweekly · headmonthly · body

Cadence follows change

A page that changed is re-checked within days. A page that keeps not changing backs off to monthly, then quarterly. robots.txt is re-read at least every 24 hours.

Dated on every record

Search results, pages and domain profiles carry fetched_at, first_seen and last_seen, so freshness is visible per record.

Change is a product

Material page changes, sites that went dark and newly seen domains arrive as a feed you can page through, filter by domain or category, or receive by webhook.

History you can diff

Each time a page changes we keep the new version. Ask for a page's history and a unified diff between any two versions.

Products

One key, five kinds of web data

Every product is an endpoint on the same API and the same credits. Start free, pay as you grow.

T2 Search

Ranked web results with snippets — and, if you ask, the clean text of each page in the same call.

Agents, apps, research tools

T2 Enrich

One call per domain: what the site is, its categories, technology stack, published business contacts, popularity and security headers.

CRM enrichment, lead scoring, due diligence

T2 Categories

Category with confidence for up to 1,000 domains per call: news, shopping, gambling, adult, parked and 30 more.

DNS filters, brand safety, ad verification

T2 Changes

Pages that materially changed, sites that went dark, newly seen domains — plus monitors and webhooks for the domains you care about.

Security, brand protection, monitoring

T2 Opt-Out Registry

Which sites block GPTBot, ClaudeBot, CCBot, Google-Extended and nine more crawlers, with history and blocking statistics.

AI compliance and legal teams

Built for agents

Give your agent the web, not a scraper

Connect any MCP client — Claude, Cursor, your own agent — to https://api.t2ind.com/mcp with your key and it can search, read pages, profile domains and watch for changes. Same credits as the REST API. Or call the REST API directly; every response is plain JSON with the credits it cost.

  • Clean main text, boilerplate removed, with title, headings and language
  • Results re-ranked by site popularity; adult sites filtered by default
  • /llms.txt and an OpenAPI description agents can read on their own

Connect an agent API docs

t2 search api
$ curl -s https://api.t2ind.com/v1/search?q="rack+cooling+standards" \
     -H "Authorization: Bearer $T2_KEY"
{
  "query": "rack cooling standards",
  "took_ms": 41,
  "results": [{
    "url": "https://example.org/guides/rack-cooling",
    "title": "Rack cooling: ASHRAE classes explained",
    "lang": "en",
    "fetched_at": "2026-10-21T04:12:09Z",
    "content_hash": "sha256:9f2c…e1a0",
    "text": "Data-centre racks are rated against ASHRAE A1–A4 thermal envelopes…"
  }]
}

How it works

Crawl. Index. API.

  1. 01

    Crawl

    T2Bot fetches publicly served HTML from published IP addresses with matching reverse DNS, one request at a time per host, honouring robots.txt exactly.

  2. 02

    Index

    Each page is reduced to its facts — URL, title, headings, main text, links, structured data, language — and each site gets a profile: categories, technologies, popularity, crawler policy.

  3. 03

    Serve

    Search, pages, profiles, categories, change feeds and the opt-out registry, over one API with one key, metered in credits.

How the T2 Index is built

For site owners

An honest crawler

Running a website? T2Bot identifies itself, honours robots.txt and publishes its IP list. It never logs in, never submits forms, never sets a cookie, and T2 data may not be used to train AI models. Opting out removes your site from every product.

T2Bot identity page Opt out

Get your key in a minute

Sign up, confirm your email, and start with 1,000 free credits a month. Upgrade when you need more.

Get a free API key See pricing