BigQuery

• Own your web analytics pipeline for €0.02 per day: Snowplow, Terraform, dbt, BigQuery and Docker Running Snowplow for your (web) analytics pipeline to expensive? Here's a €0.02/day minimal, serverless version of Snowplow open source that you can deploy for your blog or website with Terraform (on GCP/BigQuery) in 5 minutes giving you full ownership of a web and app analytics pipeline from data collection to custom data models (👋 goodbye Google Analytics). Continue reading...
  snowplow GA4 gcp BigQuery Terraform dbt Docker

  29 min read
• Using Search Console BigQuery data with NLP to extract and group by the most important topics With the recent update to Google Search Console (GSC) allowing exports to BigQuery we can now leverage some power features of BigQuery to do text processing and extract topics from our search queries with a simple JavaScript UDF. Continue reading...
  NLP BigQuery SEO javascript

  6 min read
• Mastering Time in dbt: Incremental Merging of Estimates and Actuals for large datasets Managing incrementality (change over time) in a large database is hard. Dbt can help us alleviate some of the pain by making the selection of incremental strategies we have easier to choose from. Lets look at updating an example sales table with actuals and estimates over time. Continue reading...
  dbt BigQuery incrementality

  8 min read
• Create your own API from BigQuery data in minutes with SQL exports and Cloudflare Workers Want to have data from BigQuery publicly available? Create a simple API with BigQuery scheduled queries, JSON exports and a Cloudflare Worker to map the right URL to the right data. Continue reading...
  SQL BigQuery javascript

  4 min read
• Dbt In a Box: Using Google Cloud Run and BigQuery to run your dbt SQL models from a Docker container Dbt is a great tool for data transformation. Snowplow is great for collecting web analytics data. What if you could harvest the power of both for just a few cents a day by running dbt in a Docker container on Google Cloud Run Jobs? Continue reading...
  dbt snowplow BigQuery Docker gcp cloudbuild

  13 min read
• Language Detection in SQL with BigQuery Remote Functions Over the last few years SQL has really started embracing its second adolescence. That's cool, but what if you could easily extend your queries beyond the SQL domain and add in Python and Javascript based serverless functions to get real time stock information, enrich location data or: build a language detection function!? That's what we'll do. Continue reading...
  NLP BigQuery language gcp

  4 min read