Data Pipelines: The Hammer for Every Nail

Data Pipelines: The Hammer for Every Nail

For big data and complex data processing, data pipelines have emerged as a popular solution for …

Friends don't let friends build data pipelines

Friends don't let friends build data pipelines

Building data pipelines can offer strategic advantages to the business. It can be used to power new …

ETL Workflow Modeling

ETL Workflow Modeling

Developing Extract–transform–load (ETL) workflow is a time-consuming activity yet a very important …

5 data integration trends that will define the future of ETL in 2018

5 data integration trends that will define the future of ETL in 2018

ETL refers to extract, transform, load and it is generally used for data warehousing and data …

Kubernetes for Big Data Workloads

Kubernetes for Big Data Workloads

Kubernetes has emerged as go to container orchestration platform for data engineering teams. …

How machine learning is accelerating data integration?

How machine learning is accelerating data integration?

Data integration generally requires in-depth domain knowledge, a strong understanding of data …

A case for ELT

A case for ELT

Cheap storage and on-demand compute in the cloud coupled with the emergence of new big data …

For next wave of innovation organisations will need internal data services

For next wave of innovation organisations will need internal data services

To unlock the true value of data, organisations will need internal data services. Data services …

Amazon Redshift : Avoid data redistribution

Amazon Redshift : Avoid data redistribution

When using Amazon Redshift, distribution style plays an important role in optimising the table …