We introduce CLEVER, the first curated benchmark for evaluating the generation of specifications and formally verified code in Lean. The benchmark comprises of 161 programming problems; it evaluates …

Jul 9, 2025 · We introduce ${\\rm C{\\small LEVER}}$, a high-quality, manually curated benchmark of 161 problems for end-to-end verified code generation in Lean. Each problem consists of (1) the task …

Sep 18, 2025 · This paper introduces CLEVER, a benchmark dataset designed to evaluate LLMs on formally verified code generation. It consists of 161 carefully crafted Lean specifications derived from …

579 In this paper, we have proposed a novel counter- factual framework CLEVER for debiasing fact- checking models. Unlike existing works, CLEVER is augmentation-free and mitigates biases on infer- …

Feb 21, 2026 · This survey on spurious correlations uses the Clever Hans metaphor to motivate the problem, formalizes a group-based setup g=(y,a) with core metrics (worst-group, average-group, bias …

Feb 15, 2018 · Our analysis yields a novel robustness metric called CLEVER, which is short for Cross Lipschitz Extreme Value for nEtwork Robustness. The proposed CLEVER score is attack-agnostic …

Jan 22, 2025 · Promoting openness in scientific communication and the peer-review process

Sep 14, 2024 · " This paper introduces a clever incorporation of knowledge graph operation for structured RAG " (Reviewer ifaQ). " The proposed method is straightforward, intuitive, and easy to …

While, as we mentioned earlier, there can be thorny “clever hans” issues about humans prompting LLMs, an automated verifier mechanically backprompting the LLM doesn’t suffer from these. We …

Sep 18, 2025 · The proposed Watermark Generator (WG), specifically designed to produce a secret image that is smooth after the shuffling operation (enforced by L T V), is a clever and novel solution …