mmBERT-32K Factcheck Classifier (Merged)

This is the merged version of the mmBERT-32K factcheck classifier model, ready for direct inference without PEFT.

Model Details

  • Base Model: vllm-sr/mmbert-32k-yarn
  • Task: Text Classification
  • Number of Labels: 2
  • Context Length: 32,768 tokens
  • Architecture: ModernBERT with YaRN RoPE scaling

Usage

from transformers import AutoModelForSequenceClassification, AutoTokenizer

model = AutoModelForSequenceClassification.from_pretrained(
    "vllm-sr/mmbert32k-factcheck-classifier-merged",
    trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained("vllm-sr/mmbert32k-factcheck-classifier-merged")

# Inference
inputs = tokenizer("Your text here", return_tensors="pt", truncation=True, max_length=32768)
outputs = model(**inputs)

Related Models

License

Apache 2.0

Downloads last month
7,083
Safetensors
Model size
0.3B params
Tensor type
F16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for vllm-sr/mmbert32k-factcheck-classifier-merged

Quantized
(27)
this model

Space using vllm-sr/mmbert32k-factcheck-classifier-merged 1

Collection including vllm-sr/mmbert32k-factcheck-classifier-merged