With Machine Learning
In airflow we can easily execute external scripts using BashOperator and PythonOperator. This provides flexibility in writing scalable data pipelines. In this post we will discuss on how to execute external script written in Python to perform a simple data
Read moreIn apache airflow a Directed Acyclic Graph (DAG) is a collection of all tasks ready to run and organized according to their relationships and dependencies. This post assumes that you have installed, configured and tested airflow if not visit our
Read moreAirflow is a powerful and flexible data engineering tool for programmatically authoring, scheduling, monitoring and managing data pipelines and workflows. It is open source hence freely available to use and extend to fit the business use-case. There are various ways
Read moreMicrosoft Windows 10 version 2004 and higher (Build 19041 and higher) allows users to natively run Linux on Windows 10 through Windows subsystem for Linux (WSL). To check windows version press Windows logo key + R. Currently WSL comes in
Read moreApache Airflow is a platform for authoring, scheduling and monitoring workflows/data pipeline programmatically. Airflow is primarily written in Python and uses Directed Acyclic Graphs (DAGs) to manage workflow orchestration. It’s an open source data-pipeline orchestration tool that allows you to
Read moreData integration is the process of consolidating data from various source systems to a target system where the business can have a holistic view of what’s happening to the organisation. To enable data integration in an organisation we need data
Read moreFor an organisation to be competitive in this data-driven era it needs a proper data management structure as a strategy for digital transformation. Data Integration is the process of consolidating data from different sources (heterogeneous data sources) to a single
Read moreData collection is an important phase in Data science and Machine learning project development. This phase assumes that the business problem is statement well stated, the project goal and success criteria is clearly defined, and you have structured the project
Read moreData has become the backbone of many if not all businesses. Through data we can get insights on how to increase revenue, reduce cost and minimise risk. data2ml is a place where you learn how to apply data principles and techniques to get valuable insights from your data.
Read more