- Mastering Time in dbt: Incremental Merging of Estimates and Actuals for large datasets Managing incrementality (change over time) in a large database is hard. Dbt can help us alleviate some of the pain by making the selection of incremental strategies we have easier to choose from. Lets look at updating an example sales table with actuals and estimates over time. Continue reading...
- Create your own API from BigQuery data in minutes with SQL exports and Cloudflare Workers Want to have data from BigQuery publicly available? Create a simple API with BigQuery scheduled queries, JSON exports and a Cloudflare Worker to map the right URL to the right data. Continue reading...
- Dbt In a Box: Using Google Cloud Run and BigQuery to run your dbt SQL models from a Docker container Dbt is a great tool for data transformation. Snowplow is great for collecting web analytics data. What if you could harvest the power of both for just a few cents a day by running dbt in a Docker container on Google Cloud Run Jobs? Continue reading...
- Language Detection in SQL with BigQuery Remote Functions Over the last few years SQL has really started embracing its second adolescence. That's cool, but what if you could easily extend your queries beyond the SQL domain and add in Python and Javascript based serverless functions to get real time stock information, enrich location data or: build a language detection function!? That's what we'll do. Continue reading...
- Check Cookie Consent with Playwright's browser automation in Python There's nothing like watching 20 browser windows pop-up on your screen to make you feel like a proper hacker. Let's write a Python script to do GDPR consent checks with Playwright and detect the consent manager, cookies set, and marketing and analytics trackers on a site. Continue reading...
- Analytics on the edge: server-side request tracking and cookie setting using Cloudflare Workers Server-side tracking is all the rage these days, but let me tell you about the uber-coolest kid on the blockchain: edge analytics. I'm kidding, there's no such thing as edge analytics (except maybe for IoT devices), but there is the possibility to intercept requests on the 'edge' of the network. Using Cloudflare Workers, you can send data to Google Analytics for all kinds of scenarios, even for users visiting pages THAT DON'T EVEN EXIST! Continue reading...
- How I got millions of credit card details using agencies’ Google Tag Manager (GTM) accounts If you've been around this blog before you might know that I know a thing or two about Google Tag Manager (GTM), the convenient tool that lets you run marketing and analytics scripts on your website. What you might not know is that I'm also a father of two young children, and I can tell you, kids are expensive! So, obviously, on sleepless nights, one starts to ponder all the ways to make a quick buck on the side: 'How to use one's knowledge of the interwebs to create a nice college fund for the kids?' Continue reading...
- DocTags: automatically generate documentation from the notes field in Google Tag Manager (GTM) GTM DocTags is a lightweight documentation generator for Google Tag Manager. It uses the notes field on tags, triggers and variables in Google Tag Manager —does anybody even use the note field?— and grabs that and some additional info through the GTM API to create a set of markdown files. The markdown files can be stored in Google Cloud Storage and rendered at runtime with Docsify to create a fully searchable, neat looking documentation site that you can serve your developers and other team members. Continue reading...
Beyond Measure
Hi! I’m Dumky, author of The Fundamentals of Analytics Engineering. I write about mostly technical topics related to analytics and data.
