Baseline Comparison Audit
wanshuiyin/Anti-AutoresearchAudit whether a paper's baseline comparisons are COMPLETE, FAIR, and SIGNIFICANT: a required recent SOTA baseline is missing while 'best/SOTA' is claimed (HP-MISSING-BASELINE); a baseline is undertuned / given less compute-tuning-data, run at a mismatched config, or the equal-budget ablation-as-baseline is absent (HP-WEAK-BASELINE); 'outperforms' is asserted over overlapping error bars or with no variance/seeds (HP-SIG-OVERLAP); and a cross-row 'improves over baseline by X%' is arithmetically wrong (HP-DELTA-ERROR, cross-row form only). A versioned per-domain baseline profile + a live leaderbo...
At a glance
This skill is for Finance and helps you audit baseline comparisons in papers, identify missing sota baselines, and detect undertuned baseline configurations.
git clone --depth 1 https://github.com/wanshuiyin/Anti-Autoresearch
cp -r Anti-Autoresearch/skills/baseline-comparison-audit ~/.claude/skills/baseline-comparison-audit
Setup, runtime and requirements describe wanshuiyin/Anti-Autoresearch, the repo this skill ships in.
machine-learningbenchmarkingReproducibilitySotaStatistical ValidityResearch Methodology
Also in wanshuiyin/Anti-Autoresearch
View the repoSynthesize the single strongest EVIDENCE-BOUND reviewer case to reject a paper, built ONLY from the evidence ledger (claims.json) + the othe...
Transparent, itemized impressions of AI-generated WRITING STYLE — the repo's ONLY non-integrity track. Two passes: a deterministic defensive...
End-to-end substantive-integrity forensic sweep of a research paper (especially autoresearch / AI-Scientist-style output). Orchestrates the...
Citation-integrity forensics: is every reference real, correctly attributed, and used in a context the cited work actually supports? Catches...
Flagship intra-paper self-consistency forensics: does the paper contradict ITSELF across abstract/intro/tables/body/appendix, and does the m...
Audit whether a paper's EVALUATION DESIGN actually measures what it claims and whether its reporting is complete — the validity layer family...
Build the deterministic evidence ledger (artifact_manifest.json + claims.json) that every other Anti-Autoresearch auditor reads. One pass in...
Audit experiment integrity against the evidence ledger. At L2 (repo + result files present) a fresh cross-model reviewer reads the eval code...
MEMO-ONLY prior-work overlap advisory: surfaces the two ADVISORY taxonomy signals neither a tool nor a model can decide from the paper alone...
Checkable-ish surface presentation signals a reviewer notices first — duplicate/near-identical tables, leftover pipeline/template strings, t...
Family-G proof & derivation integrity forensics: does a THIRD PARTY's written proof/derivation actually establish its theorem, or does it sk...
Other Finance skills
Quarterly / monthly financial report — masthead with KPIs, revenue and burn charts, P&L summary table, top-line highlights, and an outlook p...
Discounted cash flow valuation and intrinsic value analysis for public companies. Use when the brief asks for DCF, fair value, intrinsic val...
A printable invoice page — sender + recipient block, line items table, tax breakdown, totals, and payment instructions. Use when the brief m...
Fetches real-time Azure retail pricing using the Azure Retail Prices API (prices.azure.com) and estimates Copilot Studio agent credit consum...
Pre-breach impact analysis: inventories sensitive data (PII, PHI, PCI-DSS, credentials), traces data flows, scores exposure vectors, and pro...
Defines service level objectives, creates error budget policies, designs incident response procedures, develops capacity models, and produce...