Training course · RAG & LLM Applications · Tech Leads & Engineering Managers

RAG & LLM Applications for Tech Leads and Engineering Managers

Develop RAG and LLM applications: embeddings, vector databases, chunking, retrieval, evaluation, cost control and data protection.

Duration
2 days (14 hrs)
Format
Online or on-site
Language
German or English
Participants
open dates or exclusive for your team
Certificate
Certificate of attendance

Overview

This course connects RAG & LLM Applications with the everyday processes of Tech Leads & Engineering Managers. Participants work on realistic scenarios and leave with prompts, workflows and checklists they can use straight away.

Retrieval-augmented generation connects language models to your own knowledge: manuals, contracts, tickets, wikis or product data are made searchable and handed to the model as context at runtime. The result is assistants that give grounded answers with citations instead of hallucinating. In this two-day course you build a complete RAG pipeline, from document preparation through embeddings and a vector database to answer generation, and you learn which levers actually determine quality.

Day two takes you from prototype to robust application. You compare chunking strategies, combine semantic and lexical search, apply reranking, metadata filters and query rewriting, and measure the effect with systematic evaluations. You also cover prompt caching, cost control, latency optimisation, document-level access control and privacy-compliant operation with an eye on GDPR and the EU AI Act. By the end you know when classic RAG is enough, when a large context window or agentic retrieval is the better option, and how to justify your architecture choices.

AI coding assistants and autonomous agents are changing how engineering teams work: tasks are sliced differently, effort shifts from writing code to reviewing it, and deciding which work can be delegated to agents becomes a leadership responsibility. Tech leads and engineering managers have to select tools, set policies, enable their teams and measure impact without losing sight of code quality, security and the growth of junior engineers. In this course you learn to plan the rollout of AI coding tools in a structured way, establish shared working practices and rule files for your team, choose meaningful metrics beyond raw speed and apply AI to leadership tasks such as planning, onboarding and technical communication. Deep programming skills are not required.

The course is delivered live – either online in a virtual classroom or on-site in our training rooms in Munich, Salzburg, Berlin, Augsburg, Hanover, Bremen, Stuttgart and Kaiserslautern. We can also run it exclusively for your team.

Who is this course for?

  • Tech leads and lead developers
  • Engineering managers and software team leads
  • Heads of engineering and CTOs in mid-sized companies
  • Delivery and project leads in IT organisations
  • Developer experience and enablement leads

Typical challenges we address

  • Unclear policies lead to a patchwork of tools and shadow AI within the team
  • More generated code increases review load and the risk of technical debt
  • Difficulty measuring the real benefit of AI tools in a credible way
  • Concerns about junior engineers’ skill development and team buy-in

What you will be able to do

  • You build a complete RAG pipeline from document preparation to answers with citations.
  • You choose embedding model, chunking strategy and vector database on solid grounds.
  • You improve retrieval quality with hybrid search, reranking and metadata filters.
  • You measure application quality with systematic evaluations and detect regressions.
  • Plan the rollout of AI coding tools in a structured way with clear policies, roles and guardrails.
  • Measure the impact on delivery, quality and satisfaction with credible metrics.
  • Use AI agents yourself for leadership tasks such as planning, onboarding and technical communication.

Course outline

Day 1

Module 1 Foundations of RAG and LLM applications
  • Anatomy of a RAG pipeline: ingestion, indexing, retrieval, generation
  • Understanding embeddings: semantic similarity, dimensions, model selection
  • Weighing RAG against fine-tuning and long context windows
  • Structured outputs, citations and dealing with hallucinations
Module 2 Document preparation and chunking
  • Reliably extracting PDFs, Office documents, HTML and tables
  • Chunking strategies: fixed size, structure-aware, semantic, with overlap
  • Enriching metadata and generating contextual summaries per chunk
  • Incremental updates and deletion of documents in the index
Module 3 Vector databases and retrieval strategies
  • Comparing vector databases and extensions such as pgvector, Qdrant, Weaviate or OpenSearch
  • Hybrid search combining vector and full-text search with BM25
  • Reranking, metadata filtering and query rewriting
  • Agentic retrieval: letting the model decide on search steps and tools
Module 4 Evaluation and quality assurance
  • Building and maintaining test sets from real user questions
  • Retrieval metrics such as recall and precision, and answer metrics such as faithfulness
  • Using and calibrating LLM-as-a-judge sensibly
  • Regression testing when chunking, model or prompt changes

Day 2

Module 5 Operations, cost and data protection
  • Prompt caching, batch processing and model choice to cut costs
  • Optimising latency and streaming responses
  • Document-level permissions, tenant isolation and protection against prompt injection
  • Data protection: data residency, processing agreements, deletion policies, GDPR and the EU AI Act
Module 6 Practice lab: Tech Leads & Engineering Managers
  • Writing a team AI policy
  • Rule files and team conventions
  • Measuring impact
  • Slicing work for agents
  • Faster onboarding
  • Technical communication
Module 7 Data protection, quality & transfer to daily work
  • As a leader you own the legal framework: you learn to address licensing and copyright questions around generated code, protection of source code and secrets, works council co-determination rights when measuring performance and obligations under the GDPR and the EU AI Act in your team policies.
  • Ground rules for safe AI use in your team
  • Checking results: facts, sources, tests and the four-eyes principle
  • Personal action plan for the next 30 days
  • Open questions, outlook and resources for further learning

Practical scenarios from your field

Writing a team AI policy

Draft a practical guideline that clearly defines approved tools, permitted data classes, review obligations for generated code, handling of secrets and accountabilities, illustrated with concrete examples.

Rule files and team conventions

Build shared context files for coding agents covering architectural principles, testing strategy, style rules and banned patterns, keep them under version control and ensure consistent output across the team.

Measuring impact

Collect metrics such as DORA measures, pull request cycle time, change failure rate and developer satisfaction before and after rollout, and prepare the analysis with AI support.

Slicing work for agents

Write and break down backlog items so they can be delegated to agents with clear acceptance criteria, and decide which tasks deliberately stay with people.

Faster onboarding

Prepare codebases, architecture decisions and operational knowledge for new team members, create guided exploration tasks and have questions about the codebase answered with source references.

Technical communication

Draft incident post-mortems, roadmap updates, decision papers for senior management and release notes from tickets and commits, structured and tailored to each audience. This frees up time for actual leadership.

Possible hands-on projects

Team metrics dashboard

A small web app that pulls data from your Git platform and shows cycle times, review duration and deployment frequency over time.

PR summariser

A bot that collects all merged pull requests each week and turns them into a readable status report for stakeholders.

Onboarding guide generator

A script that analyses repository structure, README files and ADRs and produces a structured onboarding plan with learning tasks. It adapts to role and seniority.

Prerequisites

Solid programming skills in Python (or TypeScript as an alternative), basic knowledge of databases and REST APIs, and some experience with LLM APIs. You lead a software team, either technically or as a line manager, and understand the development process; current hands-on coding is helpful but not required.

Technical requirements

A laptop with Python, Git, Docker and a code editor, plus API access to at least one LLM and embedding provider. Credentials for the exercises can be provided if needed.

Data protection & compliance

As a leader you own the legal framework: you learn to address licensing and copyright questions around generated code, protection of source code and secrets, works council co-determination rights when measuring performance and obligations under the GDPR and the EU AI Act in your team policies.

Suggested dates

All dates are suggestions – your preferred date is always possible.

  • Thu, 26 November 2026 – Fri, 27 November 2026 Online Request
  • Thu, 10 December 2026 – Fri, 11 December 2026 Stuttgart Request
  • Tue, 12 January 2027 – Wed, 13 January 2027 Online Request
  • Thu, 21 January 2027 – Fri, 22 January 2027 Berlin Request
  • Tue, 2 February 2027 – Wed, 3 February 2027 Online Request
  • Tue, 16 February 2027 – Wed, 17 February 2027 Munich Request

Frequently asked questions

When is RAG better than fine-tuning?

RAG is the right choice when a model needs access to current, extensive or frequently changing knowledge and should cite its sources. Fine-tuning mainly changes style, format or specialised behaviour. In many projects RAG is the faster, cheaper and more controllable route, sometimes complemented by fine-tuning for niche tasks.

Which vector database should we use?

That depends on data volume, existing infrastructure, filtering needs and operating model. If you already run PostgreSQL, pgvector often takes you a long way, while specialised systems shine with large datasets and hybrid search. In the course you compare several options hands-on and derive criteria for your own decision.

How can RAG be run in a GDPR-compliant way?

Key factors are choosing providers with suitable data residency and a data processing agreement, enforcing document-level permissions, having a deletion policy for the index and logs, and minimising personal data. For highly sensitive data, self-hosted models are also an option. We work through these choices using realistic architectures.

How do we tell whether AI coding tools are worth it?

Don’t count generated lines of code; look at outcomes: lead time from idea to production, change failure rate, review effort, defect rates and team satisfaction. A baseline before rollout and accompanying qualitative surveys are essential. In the course you design a lean measurement approach that fits your organisation and involves employee representatives.

Do junior engineers still learn enough when AI writes the code?

The concern is valid and can be managed. Proven practices include having engineers explain every generated section in review, deliberate practice phases without an assistant and pairing with experienced colleagues where AI acts as a learning partner. You learn to adapt learning paths and review culture so that skill building and productivity go hand in hand.

How much does “RAG & LLM Applications for Tech Leads and Engineering Managers” cost?

The course costs a flat €949 plus VAT per participant – whether online or on-site. This includes 2 training day(s) with a live trainer, course materials, a lab environment and a certificate of attendance.

Can I suggest my own date?

Yes. Our suggested dates are just a guide. In the request form you can always describe your preferred date or period in free text – we check availability and confirm within one working day.

Is the course online or on-site?

Both are possible: live online in a virtual classroom or on-site in Munich, Salzburg, Berlin, Augsburg, Hanover, Bremen, Stuttgart or Kaiserslautern. We can also run the course exclusively for your team.

More courses for Tech Leads and Engineering Managers

More RAG & LLM Applications courses

All 29 RAG & LLM Applications courses

RAG & LLM Applications · MunichRAG & LLM Applications · SalzburgRAG & LLM Applications · BerlinRAG & LLM Applications · AugsburgRAG & LLM Applications · HanoverRAG & LLM Applications · BremenRAG & LLM Applications · StuttgartRAG & LLM Applications · KaiserslauternRAG & LLM Applications · Online