At-Rest Integrity: Verify-on-Read, Checksums, and GC
CAS keys make verify-on-read free: central verification, x-amz-checksum echo, tombstone GC, and corruption surfacing.
CAS keys make verify-on-read free: central verification, x-amz-checksum echo, tombstone GC, and corruption surfacing.
S3 integrity checksums moved from a surface-level adapter into the storage/ingest core via a protocol-agnostic ChecksumProvider seam β every write path verified, replicas re-verify on receive.
x-amz-checksum-CRC32/SHA256 echo on PUT; integrity surfaced to clients so dirty bytes never masquerade as clean. Teaches: client-verifiable integrity, Bolt zero-allocation on read path, Sentinel honesty guarantee.
Threshold-OPRF lets E2EE cas blobs dedup without revealing content hashes β plus adaptive failed-auth backoff and lockout.
Multipart upload support plus a rigorous 501 strategy for unsupported S3 subresources β honest breadths over silent misbehavior.
The S3 gateway turned HTTPS-or-explicit-insecure into the default: no silent plaintext for the gateway or inbound tcp/quic.
Query-string SigV4 for presigned URLs, mandatory X-Amz-Date freshness, and decoupling gateway access/secret keys from the native auth token.
The S3 gateway: SigV4, S3-compliant XML errors, Head/List/Copy, pagination, ranges, and metadata β a compatible API surface for real clients.
Envelope encryption with a client-held key: the server stores ciphertext and canβt read it β across S3 and native transports.
SigV4 signed payload verification for S3 PUT/POST and Server-Sent Events for async operation notifications.