推荐ot · 2021-06
“which is indeed a very good survey of this stuff”
称它是这方面很好的综述,讲有序整数压缩
SIMD-BP128 等向量化整数压缩方案,解码速度近乎翻倍
针对搜索引擎和关系数据库中整数数组的压缩与解码开销,提出新的向量化方案 SIMD-BP128,在桌面处理器上几乎是此前最快方案(varint-G8IU 和 PFOR)的两倍快,同时每个整数最多省 2 比特。另一个新方案 SIMD-FastPFOR 压缩率与最先进的 Simple-8b 相差在 10% 以内,解码速度却快两倍。
HN 上的人把它当作有序整数压缩(如 PForDelta、二进制打包)的好综述和速度基线,也用来说明变长字节编码是最慢的做法。
“which is indeed a very good survey of this stuff”
“The word 'paper' is a link to Decoding billions of integers per second through vectorization”
“variable byte encoding is pretty much the slowest way to do it.”
“The baseline is based on the previous State-of-The-Art which happens to be x86-based”