Automating AWS Lambda Deployments with GitHub Actions

AWS Lambda Github Actions

A guide on how to automatically update your AWS Lambda functions when something changes in your GIT repository.

29 September 2023

Checking App Version on Google Play

C# Xamarin Mobile Development Android

A Step-by-Step Guide with C# Code Examples Using Static and Dynamic HTML in Xamarin Apps.

26 March 2023

How to Use the AWS Lambda Function in Python

Python AWS Lambda S3 Pillow

A Step-by-Step tutorial on how to create a thumbnail-generation for images uploaded to S3.

21 March 2023

Building our Data Platform: Rejecting an All-In-One Data Integration Tool

Architecture Data Engineering Software Engineering DeNexus

A detailed analysis of why we decided to not use these tools.

05 December 2022

Deploying a Sklearn Model on AWS Lambda

Python AWS Lambda Data Science

Deploy a pre-trained Linear Regression in AWS Lambda using Layers and scikit-learn (Python code examples).

20 August 2022

Data engineering daily problems-2

Data Engineering Python Spark

Improve your Implicit Knowledge with these double ration of use cases: a custom URL generator and the transformation of compressed XLSX files to Spark tables. Code examples in Python.

10 August 2022

Outcomes Over Output — A data engineering approach

Data Engineering Book

How to apply what’s described in the book Outcomes Over Output to the field of Data Engineering using a few magic questions..

21 June 2022

How to automate monkey-jobs with Python

Python Software Engineering Pywinauto

Example with a Windows GUI-based two-factor-authentication process.

12 May 2022

How to improve the monitoring of your Lambda functions with Telegram

Python AWS Lambda Data Engineering AWS Cloudwatch

Send Cloudwatch logs to Telegram using bots. Code examples of a Python web scraping process in AWS Lambda.

01 May 2022

Data Engineering daily problems-1

Data Engineering Python AWS Lambda SQLite

Improve your Implicit Knowledge with these double ration of Poltergeists using AWS Lambda.

25 March 2022

FluentD webhook with TLS Mutual Authentication

Architecture FluentD Certificates

Build your own HTTP callback with code examples!

12 February 2022

Building our Data Platform: Why we have chosen FluentD

Architecture FluentD DeNexus Software Engineering

A detailed analysis of why is the best solution for our needs.

10 February 2022

Create a Spark/Hive meta-store table using nested JSON with invalid field names

Data Engineering Spark Python Scala JSON

And not to die in the try. Python/Scala code.

19 December 2021

How to Deploy and Automate Projects with AWS Free Tier — Part 1

Architecture AWS Lambda S3 AWS Cloudwatch SQLite

AWS free tier allows us to use many of AWS services as 12 months free or always free categories. This article will focus on the latter, but we will also name some cases of the former where the monthly cost is near to 0$.

28 November 2021

Building our Data Platform: Why we have chosen Databricks over Snowflake

Architecture Data Engineering Software Engineering DeNexus Databricks

A detailed analysis of why is the best solution for our needs.

18 November 2021

Event-driven architecture with Azure Eventgrid (Databricks-Azure Data Factory)

Architecture Azure Databricks Azure Data Factory Azure Eventgrid

A step by step guide on how to build an Event-driven architecture in Azure.

05 October 2021

Why you should store custom logs of your data pipelines and how to build a Data Catalog with them

Azure Data Engineering Databricks Azure Data Factory SQL Server

A step by step guide on how to do it with Azure Data Factory, Databricks and SQL Server.

05 October 2021

How to orchestrate Databricks jobs from Azure Data Factory using Databricks REST API

Data Engineering Azure Databricks Azure Data Factory

A better (and cheaper) way of controlling your jobs than using Azure Data Factory official Databricks notebook connector..

04 October 2021