AA_Collage_02 (2)

engineering

Thanks for reading. Here you will find a huge range of information in text, audio and video on topics such as Data Science, Data Engineering, Machine Learning Engineering, DataOps and much more. The show notes for “Data Science in Production” are also collated here.

pattern
Vector (44)
border-traingle

Recent Blogs

Engineering
Filter By Author
Data Engineering DevOps
Author vector
Ed Oldham
Fake It Till You Make It: Generate Fake Data Quickly with Faker
Why Fake Data is Useful for Data Engineers One thing that is sometimes really difficult as a...

19th December, 2024

Read More
Data Engineering Advancing Spark
Author vector
Jordan Witcombe
Liquid Clustering 101 - How you should be storing & optimising your...
Liquid Clustering (LC) was designed to replace table partitioning and the ZORDER command, to...

18th October, 2024

Read More
Engineering DevOps Infrastructure As Code
Author vector
Connor Quinn
Up your CI/CD game with Databricks Asset Bundles and Automated Testing
Why should I care about automated testing? Automated testing is one of the most impactful...

1st October, 2024

Read More
Data Engineering Analytics
Author vector
Johnny Winter
When is an Aggregate not an Aggregate?
I am irked. As a father of two high school aged children, this is not uncommon, but for once...

11th December, 2023

Read More
Data Engineering
Author vector
Falek Miah
Using Databricks SQL in VSCode
Recently, I had the opportunity to explore the Databricks SQL extension for VSCode, and I was...

11th May, 2023

Read More
Data Engineering
Author vector
Falek Miah
Introduction to Databricks SQL
Databricks SQL is a powerful tool for querying and analysing data in Databricks Lakehouse. It...

11th May, 2023

Read More
Chief Data Officer Engineering
Author vector
Simon Whiteley
Has the Data Engineer replaced the Business Intelligence Developer?
It seems these days that every person I talk to is either a scientist, engineer or architect,...

22nd January, 2023

Read More
Engineering
Author vector
Chris Williams
Tips for the Databricks Certified Associate Developer for Apache...
After diving in to (and passing!) the Associate Developer for Apache Spark 3.0 exam...

7th June, 2022

Read More
Engineering
Author vector
Chris Williams
Tips for the Databricks Certified Associate Developer for Apache...
Following on from my previous post I wanted to cover off some more key topics that can really...

7th June, 2022

Read More
Engineering
Author vector
Falek Miah
Writing a Single JSON File in Databricks
When writing to a JSON destination using the DataFrameWriter the dataset is split into...

24th March, 2022

Read More
All posts
Search Here
    Popular Blogs

    10 Incredibly Useful Time Series Forecasting Algorithms

    What's in a name? Naming your Fabric artifacts

    10 Incredibly Useful Clustering Algorithms

    Vector (45)
    Vector (46) dise