- Tubelator AI
- >
- Videos
- >
- Science & Technology
- >
- Part 5- Creating the Continuous Integration Pipeline (Part -3) - CI/CD in Azure Databricks in Tamil
Part 5- Creating the Continuous Integration Pipeline (Part -3) - CI/CD in Azure Databricks in Tamil
#databricks #azuredatabricks #azuredataengineer #azureintamil #azuretutorialforbeginners #databricksintamil #cicd #azuredevops #devops
In this Part 5 video of CI/CD in Azure Databricks, I have discussed about the actual creation of the CI/CD pipeline using the YAMl file we created in the previous session.
The next parts will be uploaded soon, stay tuned!
Part #6. Creating CD Pipeline and End to End Testing
Chapters
TimeStamp:
0:00:00 - Intro
0:01:33 - Creating Pipeline in Azure DevOps
0:03:54 - Assigning Pipeline Permissions
0:06:33 - Testing the CI Pipeline
0:11:25 - Pointing the Live location notebook in ADF
0:12:16 - Unit Test in CI Pipeline
0:12:50 - Outro
Please like, share and subscribe if you like the content and leave your comments below.
For contact,
Email: [email protected]
Instagram: mrk_talkstech_tamil
#AzureDatabricks #ApacheSpark #Sparkcompute #clusters #notebooks #magiccommands #machinelearning #ETL #CICD
Install Tubelator On Chrome
Video Summary & Chapters
No chapters for this video generated yet.
Video Transcript
Before creating the pipelines, we can merge the changes we made to the main branch.
In case you create the pipeline and merge it, the CICD pipeline will get triggered.
I am going to create the pipeline after merging it to the main branch.
For that I am giving the create a pull request.
now I am giving the changes
after that you can check the files
you can see the changes
so now
in this overview
tab, you can check the title
and click on create
after giving the changes
I am going to approve the changes
I am going to complete it now.
I am going to uncheck the delete future branch.
Because if there are any failures in the pipeline we created, we can use the same branch to update the changes.
Although it is not a recommended practice, I am not deleting it for the demo purpose.
I am not deleting it for the purpose of reposting
So now after unchecking it
If I merge it
Changes will be merged to main branch
But the future branch
Will still be existed
So now
The changes we made are merged
So if I go back to repost
If I switch to main branch
Then
We can see our CACD code
So now
here we can see all the changes we have done in main branch
ok
there is only one more step
pending
we have to create pipelines based on this master file
so for that what we have to do is
we can click on this pipelines
after clicking we can see
here we have an option called create your first pipeline
here we have a button called create pipeline
so we can click on this
we have the option of yaml file
so this is
we already have a yaml file
main file
so we are going to create a pipeline
using that file
so we can use this option
and choose the file
in case you are
