Lightweight data analytics using SQLite, Bash and DuckDB

Show HN: Lightweight data analytics using SQLite, Bash and DuckDB

Lightweight data analytics using SQLite, Bash and DuckDB is active in the show hn launch space.

Profile

Over the last 12 months, in parallel to using Google BigQuery, I have built my own processing pipeline using SQLite and DuckDB.What amazes me is that it works surprisingly well and costs much less than using BigQuery.Roughly speaking, here's what I do: A SQLite database receives IoT sensor data via a very simple PHP function. I currently use the FlightPHP framework for this. The data is written to a table within the SQLite database (WAL mode activated) and states are updated by the machines using triggers.Example of a triggerCREATE TRIGGER message_added AFTER INSERT ON messages BEGIN INSERT OR REPLACE INTO states VALUES ( new.id, new.status, new.time_stamp, new.current_present, new.voltage_p

Its activity falls under show hn launch; the profile below is assembled from public directory data.

It is recorded at the Show HN launch stage.

Website: myapi/sse_realtime_json