This repository was archived by the owner on Aug 18, 2026. It is now read-only.
Repository navigation
This repository was archived by the owner on Aug 18, 2026. It is now read-only.
Sink for BigQuery #86
Description
This issue tracks the implementation of a Sink that writes data to Google BigQuery.
The goal is to allow the SDK to persist decoded on-chain data directly into BigQuery tables for analysis, indexing, and integration with other Google Cloud tools.
✅ Tasks
- Implement
Sinkinterface for BigQuery - Support dynamic schema generation based on
table.Columns - Support
Flush()that inserts rows to BigQuery using streaming inserts - Handle dataset/table creation if they don’t exist
- Ensure batching is efficient and avoids quota limits
- Add configuration options:
projectIDdatasetIDtablePrefixortableName
- Add authentication support using Application Default Credentials or service account
- Write unit tests for the sink
- Write integration test using test project or emulator (if available)
- Add usage example in documentation
Activity
GabrielCartier commentedon Aug 18, 2026
This repository is deprecated (see #133). The SQL sink now lives in the main
substreamsCLI assubstreams sink postgres/substreams sink clickhouse, shipped in substreams v1.20.2. No new features land here.Closing as won't-fix in this repo. If you still want this, please open it against streamingfast/substreams.