Published inHoliday Extras Tech Team·Apr 17, 2022Using Test Results For CI OptimisationAll modern tech teams use CI as part of their deployment process. Various SaaS providers and testing frameworks exist to allow CI processes to be constructed in minutes. This article addresses looking at CI results historically to highlight problem areas in CI builds. Once you have a functioning CI process…Continuous Integration4 min readContinuous Integration4 min read
Nov 4, 2021Using Validation and Replay in a Data PipelineWith any data pipeline there will be the problem of invalid data, this article suggests a way of dealing with this data and providing required features to aid its management. This approach can be applied to streaming or batch data ingestion equally. Classification of invalid data There are many ways in which a pipeline…Data6 min readData6 min read
Published inNerd For Tech·Apr 29, 2021Deploying Javascript functions on Google Big QueryGoogle BigQuery supports user-defined functions (UDFs) written in Javascript as well as SQL, this opens up a whole new world of capabilities that UDFs could provide. Let’s start by running through some basics for using Javascript in UDFs in BigQuery. …JavaScript5 min readJavaScript5 min read