Mark Terry – Medium

Published in

·Apr 17, 2022

Using Test Results For CI Optimisation

All modern tech teams use CI as part of their deployment process. Various SaaS providers and testing frameworks exist to allow CI processes to be constructed in minutes. This article addresses looking at CI results historically to highlight problem areas in CI builds. Once you have a functioning CI process…

Continuous Integration

4 min read

Continuous Integration

4 min read

Nov 4, 2021

Using Validation and Replay in a Data Pipeline

With any data pipeline there will be the problem of invalid data, this article suggests a way of dealing with this data and providing required features to aid its management. This approach can be applied to streaming or batch data ingestion equally. Classification of invalid data There are many ways in which a pipeline…

Data

6 min read

Data

6 min read

Published in

Nerd For Tech

·Apr 29, 2021

Deploying Javascript functions on Google Big Query

Google BigQuery supports user-defined functions (UDFs) written in Javascript as well as SQL, this opens up a whole new world of capabilities that UDFs could provide. Let’s start by running through some basics for using Javascript in UDFs in BigQuery. …

JavaScript

5 min read

JavaScript

5 min read