Niklas Paulig

Hi there, I am Niklas.
I build stuff that learns.

I'm (almost) a Machine Learning PhD who loves working with data. My research focused on making sense of datasets and teaching algorithms to make smarter decisions.

About Me

I love building machine-learning systems and the infrastructure around them. Everything from reinforcement-learning pipelines and large-scale simulations to the data platforms and services they run on. I worked with noisy real-world datasets, sequential decision-making problems, and environments where models influence physical systems, where robustness and edge-case handling aren't optional.

Beyond transport AI, I've also deployed full technical stacks for a rail startup: data ingestion pipelines, analytics layers, distributed scrapers, and their deployments. I enjoy the full spectrum, from training agents on millions of samples to designing the systems that keep those models reliable, observable, and scalable.

If a problem involves dynamics, data at scale, or building intelligent ML systems from scratch, that's usually where you'll find me.

Expertise

Deep Learning 90%
Python / Torch 85%
Data analytics 70%
Ops & Deployment 60%
Infrastructure 50%
Documentation & TeX 70%

Selected Work

Nox Mobility
INDUSTRY

Nox Mobility: Founding Engineer & Tech Lead

2025

Shaped the technical foundation as founding engineer for a mobility startup from zero to investor-ready. Designed and implemented full-stack architecture: containerized microservices, data pipelines, multi-database systems, web scraping infrastructure, CI/CD, and analytics dashboards. Followed the ride for 9 months from zero to seed, defining architecture, security, DevOps strategy, and product-market-fit.

Python OpenAPI Docker PSQL Airflow Bare Metal CI/CD System Architecture
AIS Trajectory Extraction
RESEARCH

2-Level Reinforcement Learning Framework

2025

A modularized DRL framework for autonomous vessel control on inland waterways, featuring separate agents for high-level path planning (considering traffic rules and dynamic obstacles) and low-level path following. Outperforms traditional APF and PID controllers by 65% in obstacle avoidance while reducing control effort.

Deep RL Path Planning COLAV Autonomous systems Big Data Real-World Validation
AIS Trajectory Extraction
RESEARCH

AIS Trajectory Extraction Framework (α-method)

2024

An open-source Python framework for extracting clean ship trajectories from noisy AIS big data. Uses maneuverability-dependent α-quantile-based filtering to handle technical inaccuracies and compliance issues in raw AIS records. Robustly extracts long, uninterrupted trajectories for maritime domain awareness and algorithm testing.

Automatic Identification System Big Data Automatic Processing FOSS
AIS Trajectory Extraction
RESEARCH

Bootstrapped DRL for Robust Path Following

2024

A bootstrapped Deep Q-Network (DQN) controller for autonomous vessel navigation on restricted inland waterways. Handles challenging conditions like high flow velocities and shallow banks on the Rhine. Trained in diverse, realistic environments and validated against real-world data, demonstrating superior adaptability compared to vessel-specific PID controllers.

Deep RL Path Follwing Autonomous systems Real-World Validation

Publications

2-level reinforcement learning for ships on inland waterways: Path planning and following

Open Access

Martin Waltz, Niklas Paulig, Ostap Okhrin

Expert Systems with Applications, Volume 274, May 2025

An open-source framework for data-driven trajectory extraction from AIS data - The α-method

Open Access

Niklas Paulig, Ostap Okhrin

Ocean Engineering, Volume 312, Part 2, November 2024

Robust path following on rivers using bootstrapped reinforcement learning

Open Access

Niklas Paulig, Ostap Okhrin

Ocean Engineering, Volume 298, April 2024

Get In Touch

I'm always interested in discussing research collaborations, new opportunities, or interesting ML / CS problems.