How we evaluate
What our scores mean here, exactly: the protocol, the rubric, the re-verification schedule, and the honest disclosure of where every number comes from.
What our scores mean, honestly
Our scoring is research-verified, and we label it that way everywhere it matters. Each product's specs and claims are extracted from primary sources (the live Amazon listing, manufacturer documentation, and dealer spec sheets) into a verified research record, then cross-checked against independent lab measurements and long-term owner reports. A claim only its manufacturer makes is labeled as manufacturer-stated. We compare; we do not run a test bench. If we ever put hands on a machine, the page will say so, with the tester named.
We do not fabricate hands-on claims, because a fake lab is worse than an honest desk. What we can promise is that every number traces to a verified source, every score comes from one fixed rubric, and every weakness we can document is printed before the strengths.
The numbered protocol
- Build the record from primary sources: every spec value is claim-backed, and each claim's source and extraction date live in the post's machine-readable record.
- Corroborate performance claims across independent reviews and owner communities; label manufacturer-only claims as such.
- Score the category's fixed criteria, 0 to 100, straight-averaged to the overall score.
- Write the limitations before the praise; rejected products get the honest reason and no buy link.
- Re-verify the money pages quarterly.
The scoring criteria and weights
Every product in a category is scored on the same criteria, and the overall score is the straight average:
The Vacuum Cleaners rubric
- Suction and carpet deep cleaning: measured pickup of embedded debris and crevices across floor types and power modes.
- Filtration and allergen capture: how completely the sealed HEPA system traps fine dust and allergens instead of exhausting them.
- Weight and ergonomics: how the machine carries up stairs, steers around furniture, and converts for above floor cleaning.
- Runtime and battery economics: real minutes per mode, recharge time, and whether the battery swaps cheaply at home.
- Bin capacity and emptying hygiene: how much debris the bin or bag holds before suction drops and how cleanly it empties.
The Vacuum Sealers rubric
- Seal strength and consistency: how completely the machine pulls a vacuum and how repeatably it seals across bag types and thicknesses.
- Wet-food handling: whether the machine seals liquids and moist foods without failed seals or workarounds.
- Bag and roll economics: the real cost per seal in bags, rolls, or chamber pouches at a typical preservation pace.
- Reliability and build quality: pump durability, seal bar wear, and how the machine survives regular use.
- Versatility and value: jar and container sealing, accessory support, and what the purchase price buys against the use.
One rubric, one math, one number per product: the roundup, the single review, and the spec database all render the same single-sourced score. A niche publishes its rubric with its first scored roundup and re-verifies it on the same cadence as the money pages.
The re-verification cadence
Money pages (roundups and reviews) re-verify quarterly. Mid-tier pages (comparisons, databases, worth-it math) re-verify twice a year. Long-tail pages (how-tos and fixes) re-verify annually. Re-verification re-checks the spec tables against live listings and adjusts scores when the evidence changes.
We never run scheduled mass rewrites: the compliant pattern is automatic data refresh plus surgical editorial attention. A page updates because the evidence changed, not because a cron job wanted fresh dates.
The update policy
Every article carries its verification date in the byline: Last verified, with the exact date our facts were re-checked. The writing itself stays evergreen (no date is ever typed into a sentence, so the prose never reads stale), and the byline stamp tells you precisely how fresh the research is, from the same machine record that engines read. A page updates because the evidence changed, not because a cron job wanted a fresh date, and material corrections follow the corrections policy.
The honest AI-use statement
AI assists drafting: drafts are assembled from the verified research record into the site's fixed templates, and nothing publishes without human review. Every fact must trace to a verified source; the scoring rubric and the page structures are fixed, and the drafting step never changes them. Every change is reviewed before it goes live.
That is the disclosure in full: AI-assisted drafting, human-reviewed publishing, facts that trace to sources, and a structure built and owned by code.
Per-category protocols
The protocol above applies to every category we cover:
- Vacuum Cleaners
Cordless sticks, corded uprights, and canisters scored on suction, filtration, and honest cost per year, plus each model's repair record.
- Vacuum Sealers
Chamber and edge vacuum sealers scored on seal strength, bag costs, wet-food handling, reliability, and value, with verified spec tables and honest verdicts.
- Freeze Dryers
Home freeze dryers scored on batch capacity, drying consistency, pump reliability, energy cost, and support, with verified spec tables and honest verdicts.
- Dehydrators
Home food dehydrators scored on airflow evenness, capacity, temperature control, noise, and value, with verified spec tables and honest verdicts.
- Canning Equipment
Pressure canners, water bath units, and canning tools scored on safety certification, capacity, heating control, build, and value.
- Storage & Packaging
Mylar bag kits, oxygen absorbers, bucket systems, and jar sealers scored on seal integrity, reusability, and cost per stored pound.
- Grain Mills
Home grain mills scored on grind consistency, flour texture range, noise, durability, and value, with verified spec tables and honest verdicts.
- Cast Iron Cookware
Cast iron skillets, dutch ovens, and griddles scored on machining quality, heat retention, seasoning behavior, weight, and value.
- Bulk Cooking Appliances
Stand mixers, high-power blenders, and roasting setups for batch cooking, scored on motor endurance, capacity, and repairability.
- Pantry Storage
Shelving, rotation racks, and airtight container systems scored on load rating, accessibility, pest resistance, and honest stack-up cost.
- Solar Generators
Portable solar generators and power stations scored on usable capacity, inverter surge behavior, charge speed, cycle life, and value.
- Power Inverters
Pure sine wave inverters and inverter chargers scored on waveform quality, continuous and surge output, idle draw, and honest sizing for real loads.
- Battery Banks
LiFePO4 and deep-cycle battery banks scored on cycle life, usable depth of discharge, cold charging behavior, and cost per kWh.
- Water Filtration
Home and small-farm water filtration systems scored on filtration stages, flow rate, filter costs, certification, and value.
- Water Storage
Storage tanks, barrels, and emergency containers scored on material safety, UV resistance, and refill practicality, plus the weight and space math.
- Water Pumps
Well pumps, transfer pumps, and 12V backup pumps scored on lift, flow, priming behavior, and durability, plus real power draw.
- Greenhouses
Home greenhouses and grow kits scored on wind and snow ratings, panel clarity, ventilation, assembly reality, and value.
- Compost Systems
Compost tumblers, bins, and worm systems scored on turnaround speed, pest control, capacity, durability, and value, batch after batch.
- Raised Beds
Raised bed kits and materials scored on rot resistance, assembly, soil volume, and multi-season structural honesty, plus the corner joints that fail first.
- Seed Starting
Grow lights, heat mats, and seedling trays scored on germination results, durability, and cost per healthy start, tray by tray.
- Irrigation
Drip kits, timers, and gravity-fed systems scored on water efficiency, clog behavior, and scaling to bed count, row by row.
- Chicken Keeping
Coops, runs, and flock gear scored on predator resistance, ventilation, cleaning access, capacity, and value, through winter and molt.
- Egg Incubators
Incubators and brooders scored on hatch consistency, temperature and humidity stability, and hands-on reality, from setup day to hatch day.
- Beekeeping
Hives, extractors, and protective gear scored on build quality, ventilation, harvest ergonomics, and starter-honesty, season by season.
- Livestock Fencing
Electric fence energizers, netting, and posts scored on containment reality, grounding needs, and predator deterrence, wet weather included.
- Chainsaws
Home and small-farm chainsaws scored on cutting power, weight balance, safety features, maintenance cost, and value, kickback behavior included.
- Hand Tools
Axes, splitting mauls, wheelbarrows, and daily drivers scored on steel quality, handle ergonomics, and repairability, plus the edge that actually holds.
- Meat Processing
Meat grinders, sausage stuffers, and vacuum packaging setups scored on throughput, cleaning reality, and durability, from trim to casing.
- Cheese Making
Presses, cultures kits, and milk processing gear scored on pressing consistency, batch sizes, and repeatable results, from curd to wheel.
The current flagship protocol steps are printed on the flagship roundup itself, where the scoring happens in public.