Blog

We Forked Our Serialization Library. It Was 21% Slower Than It Needed to Be.
Engineering

We Forked Our Serialization Library. It Was 21% Slower Than It Needed to Be.

Arc serializes millions of records per second. When we profiled the hot path, msgpack was allocating memory on every single call. So we forked it, rewrote the internals, fixed 15 bugs the upstream had ignored for years, and shipped v6.0.0. Here's the full story.

Ignacio Van DroogenbroeckIgnacio Van Droogenbroeck··9 min read

Ready to handle billion-record workloads?

Deploy Arc in minutes. Own your data in Parquet. Use for analytics, observability, AI, IoT, or data warehousing.

Get Started ->