按年被提到
20222024 · 6 次2026
算法与数据结构›哈希、压缩与向量化·arXiv:2211.12799 · cs.SE

Benchmarking JSON BinPack

Juan Cruz Viotti, Mital Kinderkhedia · 2022
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2022-11-25 · 最近 2024-10-08
2不同的人
6活跃月份
6讨论串
9被引(OpenAlex)
arXiv 摘要(候选层不写导读)

In this paper, we present benchmark results for a pre-production implementation of a novel serialization specification: JSON BinPack. JSON BinPack is a schema-driven and schema-less sequential binary serialization specification based on JSON Schema. It is rich in diverse encodings, and is developed to improve network performance and reduce the operational costs of Internet-based software systems. We present benchmark results for 27 JSON documents and for each plot, we show the schema-driven and schema-less serialization specifications that produce the smallest bit-strings. Through extensive plots and statistical comparisons, we show that JSON BinPack in schema-driven mode is as space-efficient or more space-efficient than every other serialization specification for the 27 documents under consideration. In comparison to JSON, JSON BinPack in schema-driven mode provides a median and average size reductions of 86.7% and 78.7%, respectively. We also show that the schema-less mode of the JSON BinPack binary serialization specification is as space-efficient or more space-efficient than every other schema-less serialization specification for the 27 documents under consideration. In comparison to JSON, JSON BinPack in schema-less mode provides a median and average size reductions of 30.6% and 30.5%, respectively. Unlike other considered schema-driven binary serialization specifications, JSON BinPack in schema-driven mode is space-efficient in comparison to best-case compressed JSON in terms of the median and average with size reductions of 76.1% and 66.8%, respectively. We have made our benchmark results available at jviotti/binary-json-size-benchmark on GitHub.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论jviotti · 2023-07

“If you are interested in learning more about binary serialization (for Cap'n Proto and others), I wrote two free-to-read papers extensively looking at the scene from a space-efficiency point of view that people here might be interested in: - https://arxiv.org/abs/2201.02089 - https://arxiv.org/abs/2201.03051 Not something that aims to compete with Cap'…”

Cap'n Proto 1.0原评论 ↗
评论jviotti · 2024-05

“I'm currently building a Protocol Buffers alternative that uses JSON Schema instead: https://jsonbinpack.sourcemeta.com/. It was proven on research to be as or more space-efficient than any considered alternative (https://arxiv.org/abs/2211.12799). However, it is still heavily under development and not ready for production use. Definitely looking for Git…”

Demystifying the protobuf wire format原评论 ↗
评论jviotti · 2024-08

“Very cool! How are the balloons transferring telemetry back to earth for analysis, etc? Asking because my research at the University of Oxford was around hyper space-efficient data transfer from remote locations for a fraction of the price. The result was an award-winning technology (https://jsonbinpack.sourcemeta.com) to serialise plain JSON that was p…”

Launch HN: Sorcerer (YC S24) – Weather balloons that collect more data原评论 ↗
评论jviotti · 2024-08

“CBOR is a schema-less binary format. JSON BinPack supports both schema-less (like CBOR) and schema-driven (with JSON Schema) modes. Even on the schema-less mode, JSON BinPack is more space-efficient than CBOR. See https://benchmark.sourcemeta.com for a live benchmark and https://arxiv.org/abs/2211.12799 for a more detailed academic benchmark”

Launch HN: Sorcerer (YC S24) – Weather balloons that collect more data原评论 ↗
评论jviotti · 2024-08

“We do! See https://benchmark.sourcemeta.com for a live benchmark and https://arxiv.org/abs/2211.12799 for a more detailed academic benchmark. The TLDR is that is that if you use JSON BinPack on schema-less mode, its still more space-efficient than MessagePack but not by a huge margin (depends on the type of data of course). But if you start passing a JSO…”

Launch HN: Sorcerer (YC S24) – Weather balloons that collect more data原评论 ↗
评论jviotti · 2024-09

“I'm working on JSON BinPack (https://jsonbinpack.sourcemeta.com), a binary serialization format for JSON (think of it as a Protobuf alternative) with a strong focus on space-efficiency for reducing costs when transferring structured data over 5G and satellite transceivers for robotics, IoT, automotive, etc. If you work at any of those industries and pay …”

Ask HN: What are you working on (September 2024)?原评论 ↗
看全部 7 条 →
评论jviotti · 2024-10

“Great stuff! I'm starting to work a lot on the satellite space (https://www.sourcemeta.com), building a binary serialization format around JSON called JSON BinPack (https://jsonbinpack.sourcemeta.com) that is extremely space-efficient to pack more documents in the same Iridium uplink/downlink operation (up to 74% more compact than Protocol Buffers. See re…”

Show HN: I built a Iridium/LTE satellite GPS tracker and took it to the Arctic原评论 ↗
被提交为 story · 1 次