Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Duplicated from  cloverx-id/LuminaV-Optimizer-Paper

cloverx-id
/
LuminaV-Optimizer

PyTorch
Rust
English
optimizer
custom-optimizer
luminamoon
luminav
clm
td-clm
lso-eval
simd
avx512
vulkan
triton
memory-efficient
stochastic-rounding
low-vram
bf16
fp16
cuda
rocm
xpu
llm
transformer
deep-learning
research
Model card Files Files and versions
xet
Community
LuminaV-Optimizer / python /luminamoon /nn
92.7 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 13 commits
cloverxion's picture
cloverxion
sync(v1.6.0 / v1.0.9): synchronize full luminamoon monorepo, LSO-Eval v1.1.1 results, and LuminaV v1.6.0 bundle (part 2)
446b91f verified about 17 hours ago
  • __init__.py
    2.72 kB
    sync(v1.6.0 / v1.0.9): synchronize full luminamoon monorepo, LSO-Eval v1.1.1 results, and LuminaV v1.6.0 bundle (part 2) about 18 hours ago
  • _compat.py
    4.92 kB
    sync(v1.6.0 / v1.0.9): synchronize full luminamoon monorepo, LSO-Eval v1.1.1 results, and LuminaV v1.6.0 bundle (part 2) about 17 hours ago
  • activation.py
    10.5 kB
    sync(v1.6.0 / v1.0.9): synchronize full luminamoon monorepo, LSO-Eval v1.1.1 results, and LuminaV v1.6.0 bundle (part 2) about 17 hours ago
  • attention.py
    29.2 kB
    sync(v1.6.0 / v1.0.9): synchronize full luminamoon monorepo, LSO-Eval v1.1.1 results, and LuminaV v1.6.0 bundle (part 2) about 17 hours ago
  • norm.py
    14.8 kB
    sync(v1.6.0 / v1.0.9): synchronize full luminamoon monorepo, LSO-Eval v1.1.1 results, and LuminaV v1.6.0 bundle (part 2) about 17 hours ago
  • triton_kernels.py
    30.6 kB
    sync(v1.6.0 / v1.0.9): synchronize full luminamoon monorepo, LSO-Eval v1.1.1 results, and LuminaV v1.6.0 bundle (part 2) about 18 hours ago