ToolixLab.

Research Operations

Research Freshness and Verification Queue

A public refresh calendar for ToolixLab research datasets. It shows what is seeded, what needs a source refresh, what is pending benchmark or survey work, and what evidence is required before a row should be treated as citation-grade.

Research HubDownload Audit JSONDownload Manifest

Datasets tracked

22

P0 refresh items

6

Seeded datasets

4

Pending datasets

18

Quality Gates

Rows should pass these checks before they are cited as verified records.

Do not mark a row verified unless the source URL, source accessed date, verification method, evidence status, data quality, and confidence notes are present.

Do not assign benchmark scores above zero until raw outputs, screenshots, prompt set, and scoring notes are archived.

Do not make legal, privacy, or commercial-use claims stronger than the vendor source supports.

Keep pending datasets public only when the page clearly labels the record status and next refresh plan.

Refresh Calendar

Dataset version 2026-07. Hub updated July 22, 2026.

P0Seeded, needs source refreshMonthly

AI Tool Trust Index

ai-tool-trust-index

Source Requirements

  • Official pricing page
  • Terms or commercial-use docs
  • Privacy policy or data controls docs
  • Billing/cancellation docs
  • Hands-on reliability check

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P0Seeded, needs source refreshMonthly

AI Tool Pricing Tracker

ai-tools-pricing

Source Requirements

  • Official pricing page
  • Plan comparison table
  • Billing basis confirmation
  • Team and enterprise plan documentation

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P0Seeded, needs source refreshMonthly

AI Free Tier Limits Tracker

ai-tools-free-tiers

Source Requirements

  • Official free-plan docs
  • Hands-on free account check
  • Watermark/export test
  • Commercial-use terms

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P0Seeded, needs source refreshMonthly

Real Free AI Tool Index

real-free-ai-tools

Source Requirements

  • Official free-plan docs
  • Hands-on account check
  • Export test
  • Usage limit check

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P1Pending first refreshMonthly

AI Tool Volatility Index

ai-tool-volatility

Needs first full vendor-by-vendor source pass.

Source Requirements

  • Official pricing page or vendor docs
  • Source accessed date
  • Per-record citation ID
  • Visible changelog entry

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P1Pending first refreshMonthly

AI Tool Lock-In Risk Score

ai-tool-lock-in-risk

Needs first full vendor-by-vendor source pass.

Source Requirements

  • Official pricing page or vendor docs
  • Source accessed date
  • Per-record citation ID
  • Visible changelog entry

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P0Pending first refreshMonthly

AI Commercial Use Rights Tracker

ai-commercial-use-rights

Needs first full vendor-by-vendor source pass.

Source Requirements

  • Official pricing page or vendor docs
  • Source accessed date
  • Per-record citation ID
  • Visible changelog entry

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P1Pending first refreshMonthly

AI Data Privacy and Terms Tracker

ai-tool-data-privacy

Needs first full vendor-by-vendor source pass.

Source Requirements

  • Official pricing page or vendor docs
  • Source accessed date
  • Per-record citation ID
  • Visible changelog entry

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Pending first refreshMonthly

AI Watermark and Disclosure Tracker

ai-watermark-tracker

Needs first full vendor-by-vendor source pass.

Source Requirements

  • Official pricing page or vendor docs
  • Source accessed date
  • Per-record citation ID
  • Visible changelog entry

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P1Pending first refreshMonthly

AI Billing Trap and Cancellation Tracker

ai-billing-trap-tracker

Needs first full vendor-by-vendor source pass.

Source Requirements

  • Official pricing page or vendor docs
  • Source accessed date
  • Per-record citation ID
  • Visible changelog entry

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Pending first refreshMonthly

AI Tool Graveyard

ai-tool-graveyard

Needs first full vendor-by-vendor source pass.

Source Requirements

  • Official pricing page or vendor docs
  • Source accessed date
  • Per-record citation ID
  • Visible changelog entry

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Pending first refreshMonthly

AI Feature Cemetery

ai-feature-cemetery

Needs first full vendor-by-vendor source pass.

Source Requirements

  • Official pricing page or vendor docs
  • Source accessed date
  • Per-record citation ID
  • Visible changelog entry

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P1Pending first refreshWeekly

AI Tool Reliability Monitor

ai-tool-reliability

Needs first weekly test run and raw output archive.

Source Requirements

  • Same prompt per category
  • Timestamped run
  • Speed measurement
  • Export result
  • Quality pass/fail note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P0Benchmark pendingQuarterly

AI SEO Tools Benchmark

benchmarks/ai-seo-tools

Needs raw benchmark artifacts before scores should be non-zero.

Source Requirements

  • Prompt set
  • Raw outputs
  • Screenshots
  • Scoring sheet
  • Limitations note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Benchmark pendingQuarterly

AI Writing Tools Benchmark

benchmarks/ai-writing-tools

Dataset shell exists; benchmark run is not started.

Source Requirements

  • Prompt set
  • Raw outputs
  • Screenshots
  • Scoring sheet
  • Limitations note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Benchmark pendingQuarterly

AI Image Generators Benchmark

benchmarks/ai-image-generators

Dataset shell exists; benchmark run is not started.

Source Requirements

  • Prompt set
  • Raw outputs
  • Screenshots
  • Scoring sheet
  • Limitations note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Benchmark pendingQuarterly

AI Video Generators Benchmark

benchmarks/ai-video-generators

Dataset shell exists; benchmark run is not started.

Source Requirements

  • Prompt set
  • Raw outputs
  • Screenshots
  • Scoring sheet
  • Limitations note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Benchmark pendingQuarterly

AI Meeting Tools Benchmark

benchmarks/ai-meeting-tools

Dataset shell exists; benchmark run is not started.

Source Requirements

  • Prompt set
  • Raw outputs
  • Screenshots
  • Scoring sheet
  • Limitations note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Benchmark pendingQuarterly

AI Coding Tools Benchmark

benchmarks/ai-coding-tools

Dataset shell exists; benchmark run is not started.

Source Requirements

  • Prompt set
  • Raw outputs
  • Screenshots
  • Scoring sheet
  • Limitations note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Survey pendingQuarterly

AI Tool Usage Survey

surveys/ai-tool-usage-survey

Needs live survey collection before findings can be cited.

Source Requirements

  • Survey instrument
  • Sample size
  • Collection dates
  • Anonymized CSV
  • Methodology note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Survey pendingQuarterly

AI Tool Usage Survey Q3 2026

surveys/ai-tool-usage-survey-q3-2026

Needs live survey collection before findings can be cited.

Source Requirements

  • Survey instrument
  • Sample size
  • Collection dates
  • Anonymized CSV
  • Methodology note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.
P2Survey pendingQuarterly

AI Tool Usage Survey Q4 2026

surveys/ai-tool-usage-survey-q4-2026

Needs live survey collection before findings can be cited.

Source Requirements

  • Survey instrument
  • Sample size
  • Collection dates
  • Anonymized CSV
  • Methodology note

Acceptance Criteria

  • Every row has source_url, source_accessed_at, verification_method, evidence_status, data_quality, and confidence_notes.
  • Source links are official vendor pages, policy pages, docs, changelogs, help centers, or clearly labeled first-party tests.
  • Any unclear legal, privacy, or billing claim is marked unclear or needs-refresh instead of overstated.