Development & technology · AI Engineering & LLM Applications

AI training for AI Engineers

AI engineering is the discipline of turning language models into dependable products: chat assistants, document analysis, retrieval-augmented generation, agents with tool access and AI features inside existing applications. The code around the model is often more demanding than the model call itself, because prompt versioning, structured output, evaluation, cost control, latency, observability and protection against prompt injection decide success in production. AI coding assistants and agents accelerate exactly this work, from building evaluation pipelines and tool definitions to MCP servers and root-cause analysis in traces. In this course you learn to develop LLM applications systematically with AI support, make their quality measurable and run them securely, cost-effectively and in compliance with regulation.

Who is this course for?

  • Software developers integrating LLM features into products
  • AI engineers and machine learning engineers
  • Data scientists focusing on generative AI
  • Backend and platform teams providing AI infrastructure
  • Technical product owners for AI features

Typical challenges we address

  • Prototypes shine in demos but deliver inconsistent quality in production
  • Without systematic evaluation, changes to prompts and models are risky
  • Costs, latency and rate limits spiral as usage grows
  • New security risks from prompt injection, data leakage and over-privileged agents

Practical scenarios from your field

Building RAG pipelines

Implement ingestion, chunking, embeddings, vector search, hybrid retrieval and reranking, and generate answers with citations while honouring the access rights of source documents at retrieval time.

Automating evaluation

Create test sets with expected answers, define metrics for relevance, faithfulness and format, calibrate LLM-as-a-judge scoring and run evaluations in CI on every prompt or model change.

Developing agents and tools

Design tool definitions and MCP servers, implement agent loops with planning, tool calls and stop conditions, and build in permissions and human approval for consequential actions.

Securing structured output

Define JSON schemas for model responses, validate output, implement retry strategies on failure and make extraction tasks such as invoice or contract data robust. Faulty responses never reach downstream systems.

Observability and cost

Capture traces, token usage, latency and error rates, analyse problematic conversations and cut costs through caching, model routing and context reduction. Budgets and alerts per feature prevent surprises.

Defending against prompt injection

Test attack scenarios via manipulated documents, web pages or tool results, filter inputs and outputs, limit agent permissions and make red-teaming tests a fixed part of the pipeline.

Possible hands-on projects

Knowledge assistant with sources

A RAG chat over internal documents with citations, feedback buttons and an evaluation page that tracks answer quality across test questions.

Evaluation harness

A command-line tool that runs prompt variants against a test set, scores the results and clearly shows differences between versions.

Document extractor

A service that accepts PDFs, extracts structured data against a JSON schema, validates it and flags uncertain cases for manual review.

All 11 courses for AI Engineers

Vibe & agentic coding (11)

Data protection & compliance

LLM applications often process personal and confidential data: you learn to assess EU AI Act requirements on transparency and risk classes, design GDPR-compliant data flows with processing agreements and deletion policies, manage API keys securely and respect the licence terms of models and datasets.

Prerequisites

You have solid programming skills, ideally in Python or TypeScript, and experience with APIs; prior exposure to LLM APIs helps but is not required.

Frequently asked questions

How does AI engineering differ from classic machine learning?

In classic machine learning you train your own models on your own data. In AI engineering you usually work with pre-trained language models via APIs or self-hosted models and focus on context, retrieval, tools, evaluation and operations. Statistics and training know-how matter less, while software engineering skills matter all the more. That is precisely where this course comes in.

How do we know whether our LLM application is good enough?

With an evaluation set of realistic questions and expected results, a mix of rule-based checks, LLM-as-a-judge and human spot checks, plus monitoring in production. The key is running evaluations automatically on every change. In the course you build such a setup and learn to calibrate judge models.

Request without obligation

We will get back to you within one working day with a confirmation or an alternative suggestion.

Format *
Total €949 plus VAT