Market data is never clean. Can Muse catch it?

Muse Spark reads a CSV of market data, flags duplicates, gaps, bad prices and unadjusted splits, and explains each one in plain English. A deterministic scorer then checks its answer.

Built withMeta AIMuse models

Run a check

simulated responses · set mode to live to call Muse
Demo mode No Meta API key is configured on the server, so no model is called. Findings, timings, and scores below are simulated for illustration — set META_API_KEY on the server for live Muse Spark runs.
Benchmark · seed 42 · 25 easy + 25 hard tasks

Easy is close to solved. Hard separates the models.

A task passes only when the problem set is exactly right (F1 = 1.0) and the overall score is ≥ 0.8, with numeric fields within tolerance.

v4 run · 2026-10-26
Fixed-guess baseline: 17/25 easy, 2/25 hard Solver reference: 25/25 both tiers Total run cost: $4.48
Pass rate by task type
How it works

Generate, test, score

1generator.py

Generate messy data

A seeded random walk produces clean prices. Known problems are planted at recorded rows, which becomes the answer key.

2muse-spark · muse-glimmer

Test the model

The CSV goes to a Muse model, which returns each problem it finds with the affected rows and an explanation.

3scorer.py

Score it

The scorer counts caught, missed and falsely flagged problems against the answer key and returns one number.

score → training reward for fine-tuning Glimmer