Hi everyone,
I’ve been tracking the recent engineering developments around reasoning capabilities and symbolic logic. I wanted to share a benchmarking suite I recently built natively on the Hub to explicitly stress-test frontier models on multi-step analytical math and physics execution.
It programmatically targets structural failures where model gradients collapse or spatial constraints fail:
- Interactive Mechanics Playground: Mechanics Parametric Evaluation Suite - a Hugging Face Space by qurbi
- Interactive Calculus Playground: Calculus Parametric Evaluation Suite - a Hugging Face Space by qurbi
I’d love to know if anyone in the research community is interested in using these parametric JSON suites to stress-test your upcoming model iterations or logic pipelines!