420 points by cobychapple 6 days ago | 66 comments | View on ycombinator
jacquesm 6 days ago |
evilelectron 6 days ago |
Wishing you unlimited power and may you never see a day of low battery. Respect and Love. Keep it up.
kodoman 6 days ago |
palad1n 6 days ago |
thisisauserid 6 days ago |
hizlikovboy27 6 days ago |
igravious 6 days ago |
"""
Description
The main goal of ggml is to be a simple, portable, and efficient tensor library for machine learning with minimal setup.
Plain C/C++ implementation without any dependencies
Cross-platform - x86, ARM, RISC-V, LoongArch, PowerPC, s390x, and WebAssembly
SIMD-optimized kernels for x86, ARM, and RISC-V
Broad backend support - CPU, GPU, NPU, and browser
2- to 8-bit integer quantization, plus MXFP4 and NVFP4 microscaling formats
Zero memory allocations during runtime
"""snvzz 6 days ago |
Congrats for 1.0.0.
perdy 6 days ago |
no1guangming 6 days ago |
owlmem 6 days ago |
oochernyshev 6 days ago |
happybox2016 6 days ago |
om8 6 days ago |
> GGML is a C library for machine learning (ML) - the "GG" refers to the initials of its originator (Georgi Gerganov).
https://github.com/rustformers/llm/blob/main/crates/ggml/REA...
toolssogood 6 days ago |
trilogic 6 days ago |
minimaxa 6 days ago |
edit: Just to verify: I had planned to upgrade today, ran my usual benchmark prior and after and the runtime went from 4:22 to 3:59. That's a really long prompt (50K tokens) so prefill is a good chunk of that and the rest is spent on token generation.