Training course · GitHub Copilot · Data Engineering

GitHub Copilot for Data Engineers

Use GitHub Copilot professionally: completions, chat, agent mode, the coding agent for issues and PRs, code review and enterprise policies.

Duration
2 days (14 hrs)
Format
Online or on-site
Language
German or English
Participants
open dates or exclusive for your team
Certificate
Certificate of attendance

Overview

“GitHub Copilot for Data Engineers” is a hands-on course for roles such as Data engineers and analytics engineers, BI developers responsible for ETL and the data warehouse and Platform teams running lakehouse and streaming infrastructure. Rather than learning GitHub Copilot in the abstract, you work on tasks from your daily routine – with examples, exercises and templates from Data Engineering.

GitHub Copilot has grown from simple code completion into a broad AI platform that supports the entire development lifecycle. In the editor you work with inline suggestions, next edit suggestions and Copilot Chat; in agent mode Copilot handles tasks across multiple files and runs commands. On GitHub itself, the coding agent picks up assigned issues and delivers pull requests. In this two-day course you will learn how to use each of these building blocks deliberately and fit them cleanly into your existing development process.

Beyond hands-on editor work, the course covers control and quality. Custom instructions and prompt files give Copilot the project knowledge it needs, MCP adds further tools, and Copilot code review complements human reviewers. For those responsible for teams and organisations, we look at policies at organisation and enterprise level, content exclusions, model availability and usage reporting. Together, these lay the groundwork for a secure, transparent and genuinely effective Copilot rollout across the entire company.

Data engineers build and run the pipelines that reporting, analytics and AI applications depend on: ingestion from source systems, transformations in dbt or Spark, orchestration with Airflow or Dagster, and data quality and governance in the warehouse or lakehouse. Much of the work involves SQL, Python, YAML and a great deal of detailed knowledge about schemas and dependencies. AI coding assistants and agents accelerate this work considerably: they write dbt models with tests and documentation, optimise slow queries, create Airflow DAGs, migrate legacy ETL and explain complex lineage. Because data is often sensitive, handling schemas, sample data and credentials responsibly is at the heart of this course.

The course is delivered live – either online in a virtual classroom or on-site in our training rooms in Munich, Salzburg, Berlin, Augsburg, Hanover, Bremen, Stuttgart and Kaiserslautern. We can also run it exclusively for your team.

Who is this course for?

  • Data engineers and analytics engineers
  • BI developers responsible for ETL and the data warehouse
  • Platform teams running lakehouse and streaming infrastructure
  • Developers modernising legacy ETL processes

Typical challenges we address

  • Ageing ETL built on stored procedures or proprietary tools with no tests
  • Slow, expensive queries and inefficient Spark jobs
  • Missing data quality checks and unclear ownership of datasets
  • Patchy documentation of data models, lineage and business logic

What you will be able to do

  • You use Copilot completions, chat and agent mode purposefully for your everyday development tasks.
  • You capture project knowledge in custom instructions and prompt files to improve output quality.
  • You delegate suitable issues to the coding agent and review its pull requests properly.
  • You integrate Copilot code review sensibly into your existing review process.
  • Use AI agents productively for dbt models, pipelines and SQL optimisation.
  • Modernise legacy ETL with AI support and safeguard results with reconciliation tests.
  • Protect sensitive data by working with schemas, synthetic samples and minimal access rights.

Course outline

Day 1

Module 1 Copilot in the editor: completions and chat
  • Accepting, rejecting and steering inline and next edit suggestions efficiently
  • Using Copilot Chat for explanations, debugging and test generation
  • Setting context precisely with files, selections, workspace and chat variables
  • Model selection and differences between VS Code, Visual Studio and JetBrains IDEs
Module 2 Agent mode and extensions
  • Planning multi-step tasks in agent mode and executing them under control
  • Feeding terminal commands, test runs and error output into the agent loop
  • Connecting MCP servers for additional tools and data sources
  • Reviewing changes, accepting them partially or rolling them back
Module 3 Project knowledge through custom instructions
  • Writing repository-wide instructions on architecture, style and testing
  • Creating path-specific instructions and reusable prompt files
  • Combining personal and organisation-wide guidance sensibly
  • Refining instructions continuously based on output quality
Module 4 Coding agent and code review on GitHub
  • Writing issues the coding agent can implement reliably
  • Reviewing, commenting on and iterating over the agent’s pull requests
  • Using Copilot code review as an additional check in the PR process
  • Configuring the agent’s development environment with setup steps and Actions

Day 2

Module 5 Administration, policies and security
  • Licence assignment and policies at organisation and enterprise level
  • Content exclusions, model availability and public code filters
  • Using audit logs and usage metrics to steer adoption
  • Clarifying security risks, secrets and accountability for AI-generated code
Module 6 Practice lab: Data Engineering
  • dbt models with tests
  • Optimising SQL queries
  • Airflow and Dagster pipelines
  • Migrating legacy ETL
  • Automating data quality
  • Analysing Spark jobs
Module 7 Data protection, quality & transfer to daily work
  • Data engineering prompts should contain schemas and synthetic sample data rather than real personal records, and database credentials or connection strings must stay out of context. Apply GDPR principles such as purpose limitation and data minimisation, document data flows transparently and check new Python packages and connectors for licensing and supply-chain risk.
  • Ground rules for safe AI use in your team
  • Checking results: facts, sources, tests and the four-eyes principle
  • Personal action plan for the next 30 days
  • Open questions, outlook and resources for further learning

Practical scenarios from your field

dbt models with tests

The agent writes staging, intermediate and mart models in dbt, adds schema tests, source definitions and descriptions, and runs dbt build iteratively until models and tests pass.

Optimising SQL queries

The AI analyses execution plans, spots expensive joins and missing partitioning or clustering, and rewrites queries so they scan less data and run measurably faster.

Airflow and Dagster pipelines

Requirements become DAGs or assets with a clean dependency structure, retries, sensors, alerting and backfill support, along with tests for the transformation logic. Existing naming conventions are respected.

Migrating legacy ETL

Stored procedures or graphical ETL jobs are analysed, the business logic documented and moved step by step into dbt or PySpark code, safeguarded by reconciliation queries comparing old and new.

Automating data quality

The assistant defines checks for completeness, uniqueness, value ranges and freshness, implements them with dbt tests or Great Expectations and sets up notifications for violations.

Analysing Spark jobs

Spark UI information and logs are interpreted, skew, shuffles and memory issues identified and optimisations such as broadcast joins, repartitioning or caching proposed. Every optimisation is backed by runtime comparisons.

Possible hands-on projects

Data quality dashboard

A small web app that reads results from dbt tests or data quality checks and presents trends, outliers and affected tables at a glance.

Ingestion pipeline for a REST API

A Python pipeline that loads data incrementally from an API, detects schema changes and writes the results as partitioned tables to the lakehouse.

Lineage explorer

A tool that parses the dbt manifest and displays dependencies between sources, models and dashboards as an interactive graph. The impact of changes becomes visible at a glance.

Prerequisites

You develop software regularly, work with Git and GitHub issues and pull requests, and use a modern IDE. Confident SQL and Python skills plus practical experience with a data warehouse, dbt, Spark or an orchestration tool.

Technical requirements

Your own laptop with VS Code or a JetBrains IDE, the Copilot extension installed and a GitHub account with an active Copilot licence; the coding agent requires a suitable plan.

Data protection & compliance

Data engineering prompts should contain schemas and synthetic sample data rather than real personal records, and database credentials or connection strings must stay out of context. Apply GDPR principles such as purpose limitation and data minimisation, document data flows transparently and check new Python packages and connectors for licensing and supply-chain risk.

Suggested dates

All dates are suggestions – your preferred date is always possible.

  • Wed, 25 November 2026 – Thu, 26 November 2026 Online Request
  • Mon, 7 December 2026 – Tue, 8 December 2026 Salzburg Request
  • Tue, 15 December 2026 – Wed, 16 December 2026 Online Request
  • Wed, 13 January 2027 – Thu, 14 January 2027 Online Request
  • Thu, 28 January 2027 – Fri, 29 January 2027 Bremen Request
  • Mon, 8 February 2027 – Tue, 9 February 2027 Online Request

Frequently asked questions

What is the difference between agent mode and the coding agent?

Agent mode runs inside your IDE: you work interactively with Copilot, see every step and approve commands. The coding agent, by contrast, works autonomously on GitHub once you assign it an issue, uses its own execution environment and opens a pull request that you then review just as you would a contribution from a colleague.

How can we make sure Copilot complies with our company policies?

At organisation and enterprise level you can enable or block specific features, models and extensions. Content exclusions keep sensitive files out of the context, and audit logs make usage traceable. During the course we show how to align these controls with data protection, information security requirements and your internal coding standards.

Is the course worthwhile if we already use Copilot?

Yes, especially then. Many teams rely on completions alone and barely touch chat, agent mode, custom instructions or the coding agent. The course shows how to use these features in a structured way, improve results with project knowledge and avoid common pitfalls. Experienced users benefit most from the sections on review and governance.

Does the AI need access to our production data?

No, and it usually makes little sense. For the vast majority of tasks, schemas, metadata, execution plans and synthetic sample data are sufficient. On the course you learn to give the agent exactly this context, restrict read access to development environments and still obtain reliable results.

Will this work with our data warehouse?

The working methods are platform-independent and apply equally to Snowflake, BigQuery, Databricks, Redshift, Synapse or PostgreSQL. What matters is telling the assistant about the SQL dialect and platform specifics such as partitioning or clustering. We show you how to capture this in instruction files.

How much does “GitHub Copilot for Data Engineers” cost?

The course costs a flat €949 plus VAT per participant – whether online or on-site. This includes 2 training day(s) with a live trainer, course materials, a lab environment and a certificate of attendance.

Can I suggest my own date?

Yes. Our suggested dates are just a guide. In the request form you can always describe your preferred date or period in free text – we check availability and confirm within one working day.

Is the course online or on-site?

Both are possible: live online in a virtual classroom or on-site in Munich, Salzburg, Berlin, Augsburg, Hanover, Bremen, Stuttgart or Kaiserslautern. We can also run the course exclusively for your team.

More courses for Data Engineers

More GitHub Copilot courses

All 32 GitHub Copilot courses

GitHub Copilot · MunichGitHub Copilot · SalzburgGitHub Copilot · BerlinGitHub Copilot · AugsburgGitHub Copilot · HanoverGitHub Copilot · BremenGitHub Copilot · StuttgartGitHub Copilot · KaiserslauternGitHub Copilot · Online