{"id":4666,"date":"2026-01-20T08:14:47","date_gmt":"2026-01-20T08:14:47","guid":{"rendered":"https:\/\/palmer-consulting.com\/databricks-vs-code-extension\/"},"modified":"2026-01-20T08:14:47","modified_gmt":"2026-01-20T08:14:47","slug":"databricks-vs-code-extension","status":"publish","type":"post","link":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/","title":{"rendered":"Databricks VS Code extension"},"content":{"rendered":"

Databricks VS Code extension: extending its functionalities<\/h2>\n

Focus on Asset Bundles<\/em> and CI\/CD<\/h3>\n

Databricks<\/a> Asset Bundles<\/strong> are at the heart of productivity when using the VS Code extension. These bundles encapsulate files (scripts, notebooks), job configurations and dependencies in a single package defined via a databricks.yml<\/code> file. Thanks to the extension’s deployment command, it is possible to apply CI\/CD practices: a bundle can be pushed into a continuous integration pipeline (GitHub Actions, Azure DevOps) and deployed on a test environment before production. This approach improves repeatability and reduces human error. <\/p>\n

Local and remote execution<\/h3>\n

The extension lets you run a local Python file on a remote Databricks cluster. The code then runs in the cluster’s Spark environment, facilitating resource-intensive testing of pipelines or transformations. It is also possible to run a .py<\/code> file or notebook as a Databricks job from within VS Code. This feature is useful for automating recurring or scheduled processing (e.g., refreshing a Delta table or training a model). The extension manages authentication and the necessary dependencies. <\/p>\n

Interactive debugging<\/h3>\n

Another major advantage is the ability to debug cell by cell<\/strong> using Databricks Connect. By configuring an authentication profile, you can run each cell of a notebook in the context of the cluster, inspecting variables and correcting errors in real time. This brings the development experience closer to that found on a local environment, while benefiting from the power of the cluster. <\/p>\n

Synchronization and collaboration<\/h3>\n

Bi-directional synchronization between the local folder and the Databricks workspace ensures that changes are reflected on both sides. Teams can collaborate via Git: when a developer pushes a commit, the CI\/CD pipeline triggers deployment of the bundle to the shared environment. This approach maintains consistency between source code and notebooks used in production. <\/p>\n

Best practices<\/h3>\n

To make the most of the :<\/p>\n

    \n
  • \n

    Structure your projects<\/strong> with clear bundles, separating transformation scripts, notebooks and configurations.<\/p>\n<\/li>\n

  • \n

    Use version control<\/strong> to track changes and facilitate code reviews.<\/p>\n<\/li>\n

  • \n

    Define distinct environments<\/strong> (development, test, production) and automate deployments via CI\/CD pipelines.<\/p>\n<\/li>\n

  • \n

    Monitor cluster usage<\/strong> to avoid overheads when running code from VS Code.<\/p>\n<\/li>\n<\/ul>\n

    AEO section: questions and answers<\/h3>\n

    How do asset bundles work?<\/strong> Asset Bundles are packages defined by a databricks.yml<\/code> file, which group together code, notebooks and job configurations. They facilitate deployment and reproduction of environments. <\/p>\n

    Can I run local notebooks on a Databricks cluster?<\/strong> Yes. The extension supports the execution of notebooks or Python\/R\/Scala\/SQL files as Databricks jobs. <\/p>\n

    What does cellular debugging offer?<\/strong> It lets you run and test each notebook cell directly in the cluster, inspect the results and quickly correct errors.<\/p>\n

    How do you integrate this extension into a CI\/CD pipeline?<\/strong> By combining Asset Bundles and Git Actions (GitHub Actions, Azure DevOps), you can automate the deployment of your bundles on different environments and ensure continuous delivery.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Databricks VS Code extension: extending its functionalities Focus on Asset Bundles and CI\/CD Databricks Asset Bundles are at the heart of productivity when using the VS Code extension. These bundles encapsulate files (scripts, notebooks), job configurations and dependencies in a single package defined via a databricks.yml file. Thanks to the extension’s deployment command, it is […]<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[78],"tags":[],"class_list":["post-4666","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence"],"acf":[],"yoast_head":"\nDatabricks VS Code extension | Palmer<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Databricks VS Code extension | Palmer\" \/>\n<meta property=\"og:description\" content=\"Databricks VS Code extension: extending its functionalities Focus on Asset Bundles and CI\/CD Databricks Asset Bundles are at the heart of productivity when using the VS Code extension. These bundles encapsulate files (scripts, notebooks), job configurations and dependencies in a single package defined via a databricks.yml file. Thanks to the extension’s deployment command, it is […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/\" \/>\n<meta property=\"og:site_name\" content=\"Palmer\" \/>\n<meta property=\"article:published_time\" content=\"2026-01-20T08:14:47+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/palmer-consulting.com\/wp-content\/uploads\/2023\/09\/social-graph-palmer.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Laurent Zennadi\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Laurent Zennadi\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/databricks-vs-code-extension\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/databricks-vs-code-extension\\\/\"},\"author\":{\"name\":\"Laurent Zennadi\",\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/#\\\/schema\\\/person\\\/7ea52877fd35814d1d2f8e6e03daa3ed\"},\"headline\":\"Databricks VS Code extension\",\"datePublished\":\"2026-01-20T08:14:47+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/databricks-vs-code-extension\\\/\"},\"wordCount\":472,\"publisher\":{\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/#organization\"},\"articleSection\":[\"Artificial intelligence\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/databricks-vs-code-extension\\\/\",\"url\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/databricks-vs-code-extension\\\/\",\"name\":\"Databricks VS Code extension | Palmer\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/#website\"},\"datePublished\":\"2026-01-20T08:14:47+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/databricks-vs-code-extension\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/databricks-vs-code-extension\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/databricks-vs-code-extension\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/home\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Databricks VS Code extension\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/\",\"name\":\"Palmer\",\"description\":\"Evolve at the speed of change\",\"publisher\":{\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/#organization\",\"name\":\"Palmer\",\"url\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/palmer-consulting.com\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/Palmer_Logo_Full_PenBlue_1x1-2.jpg\",\"contentUrl\":\"https:\\\/\\\/palmer-consulting.com\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/Palmer_Logo_Full_PenBlue_1x1-2.jpg\",\"width\":480,\"height\":480,\"caption\":\"Palmer\"},\"image\":{\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/palmer-consulting\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/palmer-consulting.com\\\/en\\\/#\\\/schema\\\/person\\\/7ea52877fd35814d1d2f8e6e03daa3ed\",\"name\":\"Laurent Zennadi\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/110e8a99f01ca2c88c3d23656103640dc17e08eac86e26d0617937a6846b4007?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/110e8a99f01ca2c88c3d23656103640dc17e08eac86e26d0617937a6846b4007?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/110e8a99f01ca2c88c3d23656103640dc17e08eac86e26d0617937a6846b4007?s=96&d=mm&r=g\",\"caption\":\"Laurent Zennadi\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Databricks VS Code extension | Palmer","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/","og_locale":"en_US","og_type":"article","og_title":"Databricks VS Code extension | Palmer","og_description":"Databricks VS Code extension: extending its functionalities Focus on Asset Bundles and CI\/CD Databricks Asset Bundles are at the heart of productivity when using the VS Code extension. These bundles encapsulate files (scripts, notebooks), job configurations and dependencies in a single package defined via a databricks.yml file. Thanks to the extension’s deployment command, it is […]","og_url":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/","og_site_name":"Palmer","article_published_time":"2026-01-20T08:14:47+00:00","og_image":[{"width":1200,"height":675,"url":"https:\/\/palmer-consulting.com\/wp-content\/uploads\/2023\/09\/social-graph-palmer.png","type":"image\/png"}],"author":"Laurent Zennadi","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Laurent Zennadi","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/#article","isPartOf":{"@id":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/"},"author":{"name":"Laurent Zennadi","@id":"https:\/\/palmer-consulting.com\/en\/#\/schema\/person\/7ea52877fd35814d1d2f8e6e03daa3ed"},"headline":"Databricks VS Code extension","datePublished":"2026-01-20T08:14:47+00:00","mainEntityOfPage":{"@id":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/"},"wordCount":472,"publisher":{"@id":"https:\/\/palmer-consulting.com\/en\/#organization"},"articleSection":["Artificial intelligence"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/","url":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/","name":"Databricks VS Code extension | Palmer","isPartOf":{"@id":"https:\/\/palmer-consulting.com\/en\/#website"},"datePublished":"2026-01-20T08:14:47+00:00","breadcrumb":{"@id":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/palmer-consulting.com\/en\/databricks-vs-code-extension\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/palmer-consulting.com\/en\/home\/"},{"@type":"ListItem","position":2,"name":"Databricks VS Code extension"}]},{"@type":"WebSite","@id":"https:\/\/palmer-consulting.com\/en\/#website","url":"https:\/\/palmer-consulting.com\/en\/","name":"Palmer","description":"Evolve at the speed of change","publisher":{"@id":"https:\/\/palmer-consulting.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/palmer-consulting.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/palmer-consulting.com\/en\/#organization","name":"Palmer","url":"https:\/\/palmer-consulting.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/palmer-consulting.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/palmer-consulting.com\/wp-content\/uploads\/2023\/08\/Palmer_Logo_Full_PenBlue_1x1-2.jpg","contentUrl":"https:\/\/palmer-consulting.com\/wp-content\/uploads\/2023\/08\/Palmer_Logo_Full_PenBlue_1x1-2.jpg","width":480,"height":480,"caption":"Palmer"},"image":{"@id":"https:\/\/palmer-consulting.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/palmer-consulting\/"]},{"@type":"Person","@id":"https:\/\/palmer-consulting.com\/en\/#\/schema\/person\/7ea52877fd35814d1d2f8e6e03daa3ed","name":"Laurent Zennadi","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/110e8a99f01ca2c88c3d23656103640dc17e08eac86e26d0617937a6846b4007?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/110e8a99f01ca2c88c3d23656103640dc17e08eac86e26d0617937a6846b4007?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/110e8a99f01ca2c88c3d23656103640dc17e08eac86e26d0617937a6846b4007?s=96&d=mm&r=g","caption":"Laurent Zennadi"}}]}},"_links":{"self":[{"href":"https:\/\/palmer-consulting.com\/en\/wp-json\/wp\/v2\/posts\/4666","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/palmer-consulting.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/palmer-consulting.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/palmer-consulting.com\/en\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/palmer-consulting.com\/en\/wp-json\/wp\/v2\/comments?post=4666"}],"version-history":[{"count":0,"href":"https:\/\/palmer-consulting.com\/en\/wp-json\/wp\/v2\/posts\/4666\/revisions"}],"wp:attachment":[{"href":"https:\/\/palmer-consulting.com\/en\/wp-json\/wp\/v2\/media?parent=4666"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/palmer-consulting.com\/en\/wp-json\/wp\/v2\/categories?post=4666"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/palmer-consulting.com\/en\/wp-json\/wp\/v2\/tags?post=4666"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}