Jan Philip Göpfert

AI Engineer and Founding Technical Lead

Jan Philip Göpfert

PhD in machine learning. I build LLM systems with coding agents and run hands-on AI workshops.

About Me

I lead the technical side of an early-stage startup that produces companies' CSRD sustainability reports, and I build almost everything with coding agents. Before that I was principal machine learning engineer at a computer vision startup.

My PhD at Bielefeld University was on adversarial robustness. I lectured there from 2015 to 2022, and I run hands-on AI workshops in industry and academia.

Through GAIA (Göpfert AI Applications) I take on selected consulting and workshops.

Areas of Expertise

LLM Pipelines

Pipelines from document intake to finished report, in which every extracted claim traces back to its place in the source.

Data Engineering

Typed data flow through ML and LLM code, with Pydantic schemas, Parquet and Postgres.

Model Evaluation

Evaluations for choosing models and providers that plant confounders and degrade the documents, and show where on the page a value was found or missed.

AI System Architecture

ML and LLM systems in production: several model providers with failover, tracing on every call, data held in the EU.

Teaching & Workshop Facilitation

Lectures and tutorials at Bielefeld University from 2015 to 2022, and hands-on AI workshops for industry and academia.

Machine Learning Research

Adversarial robustness, uncertainty quantification and human-machine interaction. Papers at ICANN, ESANN and IDA.

Project Highlights

Healthcare-Tech Review

Security & architecture review for a healthcare-tech startup

Reviewed mirasu GmbH's hospital-sustainability platform before launch (access control, multi-tenancy, observability), then built its LLM reporting pipeline, with every figure cited to its source.

AI Training

AI literacy training for business and public administration

Hands-on AI training, from an AI Essentials Masterclass for IT consultancies to multi-session fundamentals courses for public administration. Topics: capabilities and limits, data protection, and the AI literacy duties of the EU AI Act.

E-commerce Search

Multimodal semantic search for e-commerce

Built a multimodal semantic search engine on CLIP embeddings, from first prototype to production, with FastAPI, SQLAlchemy and Python, and demoed it live to enterprise prospects.

Model Training Speedup

Training pipeline rewrite, 200x faster

Rewrote the training pipeline for fine-tuning contrastive loss models. It ran 200x faster than the one it replaced.

Community Engagement

Community engagement assistants for content creators

Built assistants that help content creators manage community interactions, using Graph APIs, Firebase, Serverless, NoSQL, Vue.js, Python and JavaScript.

LLMs for Pharmacology

AI applications in pharmacology research

Talk at a PHUSE event on applying Large Language Models and Generative AI in pharmacology, including LLMs with RAG for analyzing Clinical Trial Applications (CTAs).

E-commerce Recommendations

Visual-based recommendations for fashion e-commerce

Developed a visual recommendation system for fashion e-commerce using distributed computing, Vision Transformers, Large Language Models, Semantic Segmentation and Python.

Lead Conversion Prediction

Predict lead conversion with customer journey analysis

Analyzed digital customer journeys to predict lead conversion.

Montessori Malvorlagen

Free Montessori-inspired coloring pages

Built and run montessori-malvorlagen.de, a free collection of over 500 Montessori-inspired German coloring pages, generated with an AI-assisted pipeline in Python and offered as print-ready PDFs.

montessori-malvorlagen.de ↗

Digitization Pipeline

Automated digitization pipeline for scanned documents

Automated cleaning and information extraction for scanned documents using morphological image processing, neural networks for character recognition, and LLMs.

Selected Publications

Artistic interpretation of the publication “Robustness in Machine Learning: Adversarial Perturbations, Explanations & Intuition”

Robustness in Machine Learning: Adversarial Perturbations, Explanations & Intuition

Jan Philip Göpfert

2022 | Bielefeld University

PhD thesis on adversarial robustness, explanations, and intuition in machine learning.

PDF
Artistic interpretation of the publication “Deep Learning for Understanding Satellite Imagery: An Experimental Survey”

Deep Learning for Understanding Satellite Imagery: An Experimental Survey

Sharada Prasanna Mohanty, Jakub Czakon, Kamil A. Kaczmarek, ..., Jan Philip Göpfert, …

2020 | Frontiers in Artificial Intelligence

We explore automated satellite image analysis using deep learning and present five approaches based on U-Net and Mask R-CNN models, achieving impressive results in building detection.

PDF DOI
Artistic interpretation of the publication “Intuitiveness in Active Teaching”

Intuitiveness in Active Teaching

Jan Philip Göpfert, Ulrike Kuhl, Lukas Hindemith

2020 | IEEE Transactions on Human-Machine Systems

We propose intuitiveness as a property of machine learning algorithms, largely impacting how easy it is for users to interact with a given algorithm without any explicit instruction or training.

arXiv