Is 4-Bit Quantization Truly Lossless?
Four bits are a storage budget, not a quality guarantee. Here is how asymmetric weights, MSE clipping, dynamic FP8 activations, and a purpose-built runtime make Tahoma’s W4A8 path both careful and fast.
Machine Learning
Making Compression Faster
Continuing my exploration of pair programming with AI agents, I grew pigzpp from a C++ gzip rewrite into a compression library for Python data prep, PNG, Docker layers, ZIP documents, Rust, and WebAssembly — then measured it against the tools people actually use.
A Field Guide for Sanity-Checking Your Training Pipeline
A practical guide to debugging new ML setups before wasting GPU-hours: make a realistic small set memorize, measure real generation, and keep dropout on.