按年被提到
20152016 · 1 次2026
算法与数据结构›哈希、压缩与向量化·arXiv:1503.07387 · cs.IR

Vectorized VByte Decoding

Jeff Plaisance, Nathan Kurz, Daniel Lemire · 2015
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2016-03-07 · 最近 2026-05-29
2不同的人
2活跃月份
2讨论串
22被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We consider the ubiquitous technique of VByte compression, which represents each integer as a variable length sequence of bytes. The low 7 bits of each byte encode a portion of the integer, and the high bit of each byte is reserved as a continuation flag. This flag is set to 1 for all bytes except the last, and the decoding of each integer is complete when a byte with a high bit of 0 is encountered. VByte decoding can be a performance bottleneck especially when the unpredictable lengths of the encoded integers cause frequent branch mispredictions. Previous attempts to accelerate VByte decoding using SIMD vector instructions have been disappointing, prodding search engines such as Google to use more complicated but faster-to-decode formats for performance-critical code. Our decoder (Masked VByte) is 2 to 4 times faster than a conventional scalar VByte decoder, making the format once again competitive with regard to speed.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论jcr · 2016-03

“The 'PDF' link at the bottom is for the old version of the paper. The current version (v2) is available here: http://arxiv.org/abs/1503.07387”

MaskedVByte: SIMD-accelerated VByte原评论 ↗
评论arkenflame · 2026-05

“I researched many different varint encodings for a GraphQL-specific binary format (resulting in Argo: https://github.com/msolomon/argo ). I ended up choosing protobuf-style zig-zag varints, but I also found these interesting: vu128: https://john-millikin.com/vu128-efficient-variable-length-integers metric/imperial varint: https://dcreager.net/2021/03/a-…”

Bijou64: A variable-length integer encoding原评论 ↗