Data Serialization Formats - bobbae/gcp GitHub Wiki

Data serialization refers to the process of translating data structures or object state into a different format capable of being stored (such as a memory buffer or file), or transmitted and reconstructed at a different point.

Apache avro

https://avro.apache.org/

Apache thrift

https://thrift.apache.org/

Apache parquet

https://parquet.apache.org/

Apache ORC

https://orc.apache.org/

Apache arrow

https://arrow.apache.org/

Messagepack

https://msgpack.org/index.html

BSON

https://bsonspec.org/

XDR

https://en.wikipedia.org/wiki/External_Data_Representation

Example use case

https://stellar.stackexchange.com/questions/271/why-did-the-project-settle-on-xdr-for-external-data-serialisation

ASN.1, BER, DER

https://luca.ntop.org/Teaching/Appunti/asn1.htm

JSON

https://en.m.wikipedia.org/wiki/JSON

XML

https://en.m.wikipedia.org/wiki/XML

YAML

https://en.m.wikipedia.org/wiki/YAML

TOML

https://en.m.wikipedia.org/wiki/TOML

Comparisons

https://en.m.wikipedia.org/wiki/Comparison_of_data-serialization_formats

Comparison of Avro, Thrift, Messagepack, Protocol buffers

https://www.igvita.com/2011/08/01/protocol-buffers-avro-thrift-messagepack/