Training course · Windsurf · Data Engineering

Windsurf for Data Engineers

Develop with the Windsurf AI IDE and its Cascade agent: flows, memories, rules, workflows and safe use across the team.

Duration
2 days (14 hrs)
Format
Online or on-site
Language
German or English
Participants
open dates or exclusive for your team
Certificate
Certificate of attendance

Overview

“Windsurf for Data Engineers” is a hands-on course for roles such as Data engineers and analytics engineers, BI developers responsible for ETL and the data warehouse and Platform teams running lakehouse and streaming infrastructure. Rather than learning Windsurf in the abstract, you work on tasks from your daily routine – with examples, exercises and templates from Data Engineering.

Windsurf is an AI-powered development environment built around its agent, Cascade. Cascade understands the structure of your project, follows your actions in the editor and terminal, and works with you according to the flow principle: you and the agent take turns on the same task without having to re-explain context over and over. In this two-day course you will learn how to use Cascade effectively for features, debugging and refactoring, and how to make the most of intelligent completion in your daily development work.

To keep results consistent across a team, you steer Cascade with global and workspace rules, rely on memories for lasting project knowledge and automate recurring procedures with workflows that run from a slash command. You will connect external tools through MCP, control how terminal commands are executed and decide which data Cascade is allowed to see. Finally, you will define rules for code review, security and data protection so that Windsurf can be used responsibly within your organisation and its existing processes.

Data engineers build and run the pipelines that reporting, analytics and AI applications depend on: ingestion from source systems, transformations in dbt or Spark, orchestration with Airflow or Dagster, and data quality and governance in the warehouse or lakehouse. Much of the work involves SQL, Python, YAML and a great deal of detailed knowledge about schemas and dependencies. AI coding assistants and agents accelerate this work considerably: they write dbt models with tests and documentation, optimise slow queries, create Airflow DAGs, migrate legacy ETL and explain complex lineage. Because data is often sensitive, handling schemas, sample data and credentials responsibly is at the heart of this course.

The course is delivered live – either online in a virtual classroom or on-site in our training rooms in Munich, Salzburg, Berlin, Augsburg, Hanover, Bremen, Stuttgart and Kaiserslautern. We can also run it exclusively for your team.

Who is this course for?

  • Data engineers and analytics engineers
  • BI developers responsible for ETL and the data warehouse
  • Platform teams running lakehouse and streaming infrastructure
  • Developers modernising legacy ETL processes

Typical challenges we address

  • Ageing ETL built on stored procedures or proprietary tools with no tests
  • Slow, expensive queries and inefficient Spark jobs
  • Missing data quality checks and unclear ownership of datasets
  • Patchy documentation of data models, lineage and business logic

What you will be able to do

  • You use Cascade productively in flow for features, debugging and refactoring.
  • You steer Windsurf’s context precisely and keep sensitive content protected.
  • You maintain memories and rules that reliably enforce your project conventions.
  • You automate recurring procedures with workflows and connect external tools via MCP.
  • Use AI agents productively for dbt models, pipelines and SQL optimisation.
  • Modernise legacy ETL with AI support and safeguard results with reconciliation tests.
  • Protect sensitive data by working with schemas, synthetic samples and minimal access rights.

Course outline

Day 1

Module 1 Getting to know Windsurf and Cascade
  • Installation, importing existing editor settings and basic configuration
  • Cascade in code and chat mode: when the agent edits and when it only advises
  • The flow principle: how Cascade takes your editor and terminal actions into account
  • Intelligent completion and inline commands in everyday development
Module 2 Steering context
  • Understanding codebase indexing and referencing relevant files or directories
  • Bringing documentation, web sources and terminal output into context
  • Excluding sensitive content from context with ignore files
  • Structuring sessions and starting afresh when the topic changes
Module 3 Memories and rules for consistent results
  • Reviewing and maintaining auto-generated and manually created memories
  • Creating and versioning global and workspace rules
  • Expressing architecture, style and testing guidelines as effective rules
  • Activating rules selectively by file pattern or occasion
Module 4 Workflows and automation
  • Defining recurring procedures as workflows and launching them via slash command
  • Building workflows for release preparation, testing or code maintenance
  • Connecting MCP servers for issue trackers, databases or internal services
  • Controlling terminal command execution with allow and deny lists

Day 2

Module 5 Quality, review and governance
  • Tracing Cascade’s changes, accepting them partially or reverting them
  • Using a test-driven approach and preview features for verification
  • Team settings, data protection options and handling of secrets
  • Defining review processes and accountability for AI-generated code
Module 6 Practice lab: Data Engineering
  • dbt models with tests
  • Optimising SQL queries
  • Airflow and Dagster pipelines
  • Migrating legacy ETL
  • Automating data quality
  • Analysing Spark jobs
Module 7 Data protection, quality & transfer to daily work
  • Data engineering prompts should contain schemas and synthetic sample data rather than real personal records, and database credentials or connection strings must stay out of context. Apply GDPR principles such as purpose limitation and data minimisation, document data flows transparently and check new Python packages and connectors for licensing and supply-chain risk.
  • Ground rules for safe AI use in your team
  • Checking results: facts, sources, tests and the four-eyes principle
  • Personal action plan for the next 30 days
  • Open questions, outlook and resources for further learning

Practical scenarios from your field

dbt models with tests

The agent writes staging, intermediate and mart models in dbt, adds schema tests, source definitions and descriptions, and runs dbt build iteratively until models and tests pass.

Optimising SQL queries

The AI analyses execution plans, spots expensive joins and missing partitioning or clustering, and rewrites queries so they scan less data and run measurably faster.

Airflow and Dagster pipelines

Requirements become DAGs or assets with a clean dependency structure, retries, sensors, alerting and backfill support, along with tests for the transformation logic. Existing naming conventions are respected.

Migrating legacy ETL

Stored procedures or graphical ETL jobs are analysed, the business logic documented and moved step by step into dbt or PySpark code, safeguarded by reconciliation queries comparing old and new.

Automating data quality

The assistant defines checks for completeness, uniqueness, value ranges and freshness, implements them with dbt tests or Great Expectations and sets up notifications for violations.

Analysing Spark jobs

Spark UI information and logs are interpreted, skew, shuffles and memory issues identified and optimisations such as broadcast joins, repartitioning or caching proposed. Every optimisation is backed by runtime comparisons.

Possible hands-on projects

Data quality dashboard

A small web app that reads results from dbt tests or data quality checks and presents trends, outliers and affected tables at a glance.

Ingestion pipeline for a REST API

A Python pipeline that loads data incrementally from an API, detects schema changes and writes the results as partitioned tables to the lakehouse.

Lineage explorer

A tool that parses the dbt manifest and displays dependencies between sources, models and dashboards as an interactive graph. The impact of changes becomes visible at a glance.

Prerequisites

You program regularly in at least one language and are familiar with Git and a modern IDE. Confident SQL and Python skills plus practical experience with a data warehouse, dbt, Spark or an orchestration tool.

Technical requirements

Your own laptop with the Windsurf editor, Git and your usual toolchain installed; a Windsurf account with access to Cascade is required.

Data protection & compliance

Data engineering prompts should contain schemas and synthetic sample data rather than real personal records, and database credentials or connection strings must stay out of context. Apply GDPR principles such as purpose limitation and data minimisation, document data flows transparently and check new Python packages and connectors for licensing and supply-chain risk.

Suggested dates

All dates are suggestions – your preferred date is always possible.

  • Thu, 26 November 2026 – Fri, 27 November 2026 Online Request
  • Thu, 10 December 2026 – Fri, 11 December 2026 Stuttgart Request
  • Mon, 11 January 2027 – Tue, 12 January 2027 Online Request
  • Tue, 26 January 2027 – Wed, 27 January 2027 Berlin Request
  • Mon, 8 February 2027 – Tue, 9 February 2027 Online Request
  • Thu, 25 February 2027 – Fri, 26 February 2027 Munich Request

Frequently asked questions

What does Windsurf mean by flows?

Flows describe the close collaboration between you and Cascade. The agent observes what you do in the editor and terminal and takes those actions into account in its next steps. As a result you do not have to keep explaining where you are, and you can move smoothly between doing the work yourself and delegating it to the agent.

How do memories, rules and workflows differ?

Memories store knowledge that Cascade has gathered while working or that you have explicitly recorded. Rules are guidelines you write that shape the agent’s behaviour permanently. Workflows are reusable sequences of steps for recurring tasks, launched with a slash command. Together they keep results consistent across the whole team.

Can I use Windsurf with my existing projects and languages?

Yes. Windsurf is language-agnostic and works with your existing toolchain, including build tools, package managers and test frameworks. Whether you work on back end, front end, data processing or infrastructure code, what matters is giving Cascade good rules and clear context. Each course variant adds the specific focus for your field.

Does the AI need access to our production data?

No, and it usually makes little sense. For the vast majority of tasks, schemas, metadata, execution plans and synthetic sample data are sufficient. On the course you learn to give the agent exactly this context, restrict read access to development environments and still obtain reliable results.

Will this work with our data warehouse?

The working methods are platform-independent and apply equally to Snowflake, BigQuery, Databricks, Redshift, Synapse or PostgreSQL. What matters is telling the assistant about the SQL dialect and platform specifics such as partitioning or clustering. We show you how to capture this in instruction files.

How much does “Windsurf for Data Engineers” cost?

The course costs a flat €949 plus VAT per participant – whether online or on-site. This includes 2 training day(s) with a live trainer, course materials, a lab environment and a certificate of attendance.

Can I suggest my own date?

Yes. Our suggested dates are just a guide. In the request form you can always describe your preferred date or period in free text – we check availability and confirm within one working day.

Is the course online or on-site?

Both are possible: live online in a virtual classroom or on-site in Munich, Salzburg, Berlin, Augsburg, Hanover, Bremen, Stuttgart or Kaiserslautern. We can also run the course exclusively for your team.

More courses for Data Engineers

More Windsurf courses

All 32 Windsurf courses