sync(v1.6.0 / v1.0.9): synchronize full luminamoon monorepo, LSO-Eval v1.1.1 results, and LuminaV v1.6.0 bundle
aa0a6d0 verified |
Download docs/en/README.md from cloverx-id/LuminaV-Optimizer: direct link, hf CLI and curl.
- Browser
- Download file 4.8 kB
-
https://huggingface.co/cloverx-id/LuminaV-Optimizer/resolve/main/docs/en/README.md
- Command line
-
hf download hf://cloverx-id/LuminaV-Optimizer/docs/en/README.md
-
curl -L -o README.md https://huggingface.co/cloverx-id/LuminaV-Optimizer/resolve/main/docs/en/README.md
4.8 kB
Loomy (luminamoon) Documentation (English)
Loomy (luminamoon) is a deep learning optimization, rational neural architecture, and dataset text processing library built in Rust (Edition 2024) with a Python C-extension bridge (PyO3 0.30.1 abi3-py310 & abi3t). It includes:
- LuminaV Optimizer v1.6.0: Low-precision numerical optimization library with host CPU SIMD (
AVX-512,AVX2), Vulkan 1.3/1.4 UMA Wave32 compute shaders, Triton JIT/AOT GPU kernels, and direct buffer interoperability for NumPy and PyTorch. - LuminaMoon Data Engine v1.1.1.post2: Modular text preprocessing library with
AVX-512BW/AVX2/NEONCPU SIMD text normalization, dual-layoutStringTensor(16-byte CPUStringView16& contiguous GPU buffers), heuristic Shannon quality filtering, two-stagexxh3_64and MinHash LSH deduplication, PII masking, and 128-byte Ping-Pong (Slot A/Slot B) CRC32 checkpointing. - Ra-Family Neural Architecture v1.1.1.post2: Rational,
tanh-free and square-root-free neural components (RaNorm,RaBatchNorm2d,RaTanh,RaGELU,PosRaGLU,RaAttention,ra_attention,ra_softmax).
Documentation Map
| Document | Description |
|---|---|
| 01. Getting Started | System requirements, pip installation, source compilation via Maturin/Rust, hardware & SIMD ISA detection (LuminaV.detect_hardware(), lm.data_cpu_isa()), and quickstarts for NumPy, PyTorch, and Data Engine (FusedPipeline, StringTensor, StateTracker, ResumablePipeline). |
| 02. User Guide | Guide on Optimizer buffer modes (Dual-Buffer CLM, Single-Buffer TD-CLM, and Triangle Family T1/T2), mixed-precision & stochastic rounding, step bounding, FSDP distributed training, plus Data Engine FusedPipeline, StringTensor, 128B Ping-Pong StateTracker checkpoint recovery, StreamDeduplicator, MinHashDeduplicator, and PIIMasker. |
| 03. Configuration & API Reference | Constructor and function signatures, parameter tables, public methods, and validation rules for LuminaV, FusedPipeline, StringTensor, StateTracker, StreamCoordinate, TextCleaner, QualityFilter, StreamDeduplicator, MinHashDeduplicator, PIIMasker, and ResumablePipeline. |
| 04. Architecture & Hardware Acceleration | C4 dispatch flow, Optimizer Rust crates (luminav-core, luminav-simd, luminav-vulkan, luminav-dispatch, luminav-triton-aot), Data Engine Rust modules (coord, metadata, dedup, minhash, simd_cpu, postprocess, string_tensor, quality, serialize, py_bridge), buffer memory protocols, and free-threaded Python support (PEP 703). |
| Optimizer Developer Modular Docs | Internal developer documentation for the 7 Optimizer modules (core, simd, vulkan, triton_aot, dispatch, python_ffi, python_runtime). |
| Data Engine Architecture & User Guide | Internal developer documentation for the 7 Data Engine modules (coord_and_metadata, dedup, simd_and_postprocess, sources_and_streaming, preram, multimodal_and_hf_hub, python_ffi_and_runtime). |
| Ra-Family Neural Architecture | Rational neural network components (RaNorm, RaBatchNorm2d, RaTanh, RaGELU, PosRaGLU, RaAttention, ra_softmax) and Standalone Guide. |
| Theoretical References | Component mapping, mathematical derivations, and literature comparisons across the referenced papers. |
| Library Compatibility Notes | Version and compatibility documentation for Rust toolchain ABI, SIMD intrinsics, GPU drivers (CUDA/ROCm/Vulkan), PyO3/Maturin bindings, Apache Arrow/Parquet/IPC 60.0.0, rayon 1.12.0, xxhash-rust 0.8.19, hashbrown 0.17.1, and crc32fast 1.5.2. |
Overview
- Optional Framework Dependencies: The base wheel ships with
dependencies = [], allowing NumPy, PyTorch, or Triton to be installed as needed. - Dual-Buffer CLM, Single-Buffer TD-CLM & Triangle Family: Convex Lookahead Momentum (CLM), Triangle-Defect Convex Lookahead Momentum (TD-CLM), and
tanh-free Triangle Family (T1/T2) with the Triangle Inequality Envelope and optional 50% optimizer state memory reduction. - Dual-Layout
StringTensor& Resumable Checkpoints: 16-byte CPUStringView16& contiguous GPU offset/payload buffers, parallel Rayon preprocessing (FusedPipeline), two-stagexxh3_64WAL deduplication, and 128-byte Ping-Pong CRC32 checkpoints. - Free-Threaded Python Support: Compatible with Python 3.10 through 3.15+ via CPython Stable ABI (
abi3&abi3t/ PEP 703) withpy.detach()GIL release during Rust execution.