SaT Base Models
Collection
Base SaT (Segment any Text) models, to be used for sentence and paragraph segmentation. Easily adaptable via LoRA. • 6 items • Updated • 3
# Load model directly
from transformers import AutoModelForTokenClassification
model = AutoModelForTokenClassification.from_pretrained("segment-any-text/sat-12l", dtype="auto")Quick Links
sat-12l
Model for wtpsplit.
State-of-the-art sentence segmentation with 12 Transfomer layers.
For details, see our Segment any Text paper
- Downloads last month
- 1,220
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="segment-any-text/sat-12l")