- Tubelator AI
- >
- Videos
- >
- Science & Technology
- >
- Part 6- Creating the Continuous Deployment Pipeline - CI/CD in Azure Databricks in Tamil
Part 6- Creating the Continuous Deployment Pipeline - CI/CD in Azure Databricks in Tamil
#databricks #azuredatabricks #azuredataengineer #azureintamil #azuretutorialforbeginners #databricksintamil #cicd #azuredevops #devops
In this Part 6 video of CI/CD in Azure Databricks, I have discussed about the Continuous Deployment part where it deploys changes from DEV to PROD databricks workspace
The next parts will be uploaded soon, stay tuned!
Part #7.Complete End to End CI/CD Pipeline Testing
Chapters
TimeStamp:
0:00:00 - Intro
0:01:32 - Continuous Deployment changes in the YAMl code
0:07:44 - Variable Group, Environment and Service connection creation
0:14:07 - Pipeline permissions for PROD
0:15:36 - Testing the Continuous Deployment changes
0:18:45 - Depends on property
0:23:00 - Outro
Please like, share and subscribe if you like the content and leave your comments below.
For contact,
Email: [email protected]
Instagram: mrk_talkstech_tamil
#AzureDatabricks #ApacheSpark #Sparkcompute #clusters #notebooks #magiccommands #machinelearning #ETL #CICD
Install Tubelator On Chrome
Video Summary & Chapters
No chapters for this video generated yet.
Video Transcript
Now we have completed 3 sections
CACD, Setting up the repos and finally
how to create a continuous integration pipeline
In this section, we will see how to create a continuous deployment pipeline
So far, what we have done is
When our continuous integration pipeline is running
First, we take the latest code from the main branch and deploy it in the dev workspace in a folder called live.
So this is the continuous integration pipeline.
In the live folder, all the latest codes are stored.
So, after putting all the changes in the live folder,
the continuous deployment pipeline will run.
So, what does the continuous deployment pipeline do?
It copies the latest data in the live folder
We will copy the latest notebooks in the database and create a live folder in the production workspace
and we will deploy the latest code in the dev folder
This is what the continuous deployment pipeline is going to do
Now let's see how to create the continuous deployment pipeline
Now I am in Visual Studio Code
Here we have to make some changes for continuous deployment pipeline
It is a very simple change, let's see what it is
First we can create a new branch
What I am going to do for that is
On the left side, there is a CI pipeline branch
I can make changes in this branch
But I am going to create a branch for continuous deployment
I am going to create a branch
I am going to click on it
After clicking I am going to choose the main branch
As soon as we choose the main branch
It shows some errors
What is this?
We have latest changes in the main branch
The changes in the main branch are not in the local
Visual Studio code
not in local
so if you are updating a change in a branch
you have to pull the changes when you are using the same branch locally
so let's see how to pull the changes
so for that I am going to source control
and after that there will be three dots
so I am clicking on it
after clicking there will be a pull option
so I am clicking on it
Now it will pull the changes in the devops
You can see the error message
The latest changes in the devops will be in the visual studio code
Now we can create a branch for the continuous deployment pipeline
we can create a branch
for that I am going to click on the bottom left
the same main branch
