How We Evaluate & Score AI Tools
Our Approach
Every tool on The Phil Collective is scored using a weighted algorithm across 6 dimensions. Scores are computed from verified data — not opinions, not vendor claims. We re-verify pricing and features every 14 days.
Scoring Dimensions
| Dimension | Weight | What We Measure |
|---|---|---|
| Pricing | 20% | Cost per user, plan flexibility, hidden fees, annual vs monthly savings |
| Features | 25% | Core feature coverage, unique capabilities, feature depth per plan tier |
| Ease of Use | 15% | User review scores for usability, onboarding time, learning curve |
| Customer Support | 15% | Support channels, response times, user satisfaction ratings |
| Integrations | 10% | Number of native integrations, API availability, third-party connectors |
| Value for Money | 15% | Feature-to-price ratio, comparison against alternatives at same price point |
Data Sources
We aggregate data from multiple sources to reduce bias:
- Pricing: Verified directly from vendor pricing pages. We check monthly.
- Features: Tested against actual product capabilities, cross-referenced with documentation.
- User Reviews: Aggregated from G2, Capterra, and TrustRadius. We weight by review count to prevent manipulation.
- Integrations: Verified from vendor docs, marketplace listings, and API documentation.
Database Stats
| Metric | Count |
|---|---|
| Tools tracked | 32 |
| Pricing plans | 109 |
| Feature data points | 404 |
| Head-to-head comparisons | 50 |
| Price changes tracked | 0 |
What We Don't Do
- We don't accept payment for higher rankings.
- We don't let affiliate relationships influence scores.
- We don't use AI-generated "reviews" — our analysis is based on structured data.
- We don't hide pricing — if a vendor won't publish prices, we note it.
Confidence Scores
Every data point in our database has a confidence score (0.0 to 1.0):
- 0.8+ — Verified from primary source (vendor pricing page, official docs)
- 0.5–0.8 — Cross-referenced from secondary sources (review sites, third-party reports)
- Below 0.5 — Estimated or outdated — flagged for re-verification
Questions about our methodology? See our analyst profile or reach out via the contact info in the footer.