Text Classification
Transformers
ONNX
Safetensors
multilingual
xlm-roberta
privacy
pii-detection
text-embeddings-inference
jordansren commited on
Commit
159f48c
·
verified ·
1 Parent(s): 833a946

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -21,7 +21,7 @@ datasets:
21
  ## Overview
22
  We present `Roblox/roblox-pii-classifier-v2`, an upgraded, context-aware PII (Personally Identifiable Information) detection model. Built on the [XLM-RoBERTa-Large](https://huggingface.co/xlm-roberta-large) architecture, v2 is designed to identify attempts to share or solicit personal information across complex, multi-user conversations.
23
 
24
- Unlike its predecessor and other NER models, **v2.0 evaluates text within its surrounding conversational context**, allowing it to detect sophisticated, adversarial bypass attempts (e.g., collaborative PII exchange, phonetic spelling, implicit references) while drastically reducing false positives. It is intended for use in casual conversations, ensuring freedom of speech while also maintaining safety.
25
 
26
  ## What’s New in v2.0?
27
 
@@ -66,7 +66,7 @@ emitted in this fixed index order:
66
 
67
  The table below illustrates best f1 performance across internal and open-source evaluation benchmarks (full conversational data used when possible):
68
 
69
- | Dataset / Benchmark | PII v2.0 | *PII v1.1 | *OpenAI Privacy Filter | *GLiNER2 | Qwen3Guard | LlamaGuard v3 1B | LlamaGuard v3 8B | LlamaGuard v4 12B | NemoGuard 8B | *Piiranha NER | Shieldstral
70
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
71
  | **roblox-pii-safety-for-chat** | **88.78%** | 64.74% | 58.10% | 54.42% | 66.15% | 27.80% | 56.06% | 54.30% | 56.35% | 58.34% | 57.66 |
72
  | **Roblox Internal Evaluation** | **90.52%** | 63.41% | 20.98% | 28.21% | 15.62% | 8.59% | 12.90% | 21.92% | 14.77% | 20.98% | 31.87 |
 
21
  ## Overview
22
  We present `Roblox/roblox-pii-classifier-v2`, an upgraded, context-aware PII (Personally Identifiable Information) detection model. Built on the [XLM-RoBERTa-Large](https://huggingface.co/xlm-roberta-large) architecture, v2 is designed to identify attempts to share or solicit personal information across complex, multi-user conversations.
23
 
24
+ Unlike its predecessor and other NER models, **v2 evaluates text within its surrounding conversational context**, allowing it to detect sophisticated, adversarial bypass attempts (e.g., collaborative PII exchange, phonetic spelling, implicit references) while drastically reducing false positives. It is intended for use in casual conversations, ensuring freedom of speech while also maintaining safety.
25
 
26
  ## What’s New in v2.0?
27
 
 
66
 
67
  The table below illustrates best f1 performance across internal and open-source evaluation benchmarks (full conversational data used when possible):
68
 
69
+ | Dataset / Benchmark | Roblox PII v2 | *Roblox PII v1 | *OpenAI Privacy Filter | *GLiNER2 | Qwen3Guard | LlamaGuard v3 1B | LlamaGuard v3 8B | LlamaGuard v4 12B | NemoGuard 8B | *Piiranha NER | Shieldstral
70
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
71
  | **roblox-pii-safety-for-chat** | **88.78%** | 64.74% | 58.10% | 54.42% | 66.15% | 27.80% | 56.06% | 54.30% | 56.35% | 58.34% | 57.66 |
72
  | **Roblox Internal Evaluation** | **90.52%** | 63.41% | 20.98% | 28.21% | 15.62% | 8.59% | 12.90% | 21.92% | 14.77% | 20.98% | 31.87 |