BitVanes – A zero-trust RAG pipeline engine in Rust, WASM, and Arrow

Show HN: BitVanes – A zero-trust RAG pipeline engine in Rust, WASM, and Arrow

BitVanes – A zero-trust RAG pipeline engine in Rust, WASM, and Arrow is a business in show hn launch.

Profile

Most RAG pipelines ship raw, sensitive documents over the wire to cloud services just to get them parsed, scrubbed of PII, chunked, and vectorized. BitVanes is a zero-trust, local-first ETL engine designed to solve this. It’s written in Rust, spits out Apache Arrow RecordBatches, and compiles to both a native CLI and WebAssembly so you can run the entire pipeline directly in a browser sandbox. I've got the wasm version at the posted url. Core and cli are on github.I'd love to get your thoughts on the architecture, particularly around using Arrow (it's my first time using AA, I'm coming from capnp), or the Rust-to-JS design for pdfs to keep the wasm package reasonable.I'd like to crates the p

As a business in show hn launch, BitVanes – A zero-trust RAG pipeline engine in Rust, WASM, and Arrow is listed here with the public details available about it.

The company is listed at the Show HN launch stage of development.

Website: www.bitvanes.com