Edge HTTP to S3, now with schema-aware Parquet

Show HN: Edge HTTP to S3, now with schema-aware Parquet

Edge HTTP to S3, now with schema-aware Parquet is a company in show hn launch.

Profile

Hi HN,TL;DR: POST JSON to an HTTP endpoint. Get Parquet and compressed segments in your S3 bucket. No Kafka, no Kinesis, no glue code.EdgeMQ ingests newline delimited JSON from one or more global endpoints (dedicated vm's). Data is delivered to your S3 with commit markers in one or more formats of your choosing: * Compressed WAL segments (.wal.zst) for replay i.e. raw bronze * Raw/opaque Parquet (keeps the original payload in a payload column + ingest metadata). * Schema-aware Parquet - materialized views defined in YAMLFeedback request:The platform is now open for public beta (there are a number of current live users) and I am keen to collect further feedback and explore use cases.I would b

Edge HTTP to S3, now with schema-aware Parquet is positioned in show hn launch, a segment that rewards a clear, focused offering.

It is recorded at the Show HN launch stage.

Website: edge.mq/docs/materialized-views