Tobias Jacob
Artificial intelligence and machine learning researcher
Full-stack developer with experience in building award-winning deep learning, computer vision, natural language processing, and reinforcement learning models. Studied a mixture of electrical and mechanical engineering for the bachelor's and switched to computer science for the master's to develop a throughout understanding of technology.
Freelance
Prepare your business for the next wave of robotics and automation technology!
A modern system control solution has to do more than to just follow a SPS program from the 70s.
I offer development of modern interconnected control solutions based on ARM processors. You may know them from your smartphone. These processors are not just ideal for artificial intelligence, low energy consumption or fluid touch screens. They also have enough performacne for all commonly used industry protocols, esential for adaptive and interactive control.
Intuitive, high-resolution and fluid touchscreen control
Speaks all protocols
MQTT, EtherCat, CanBus, Modbus, Profinet, Profibus, BacNet, USB, UART, RS232, I2C, SPI, ...
Energy efficient
Small
No cooling necessary
Ready for artificial intelligence
Remote control
Cloud surveillance
A USB game controller for sim racing
A deep learning computer vision model to determine a vessels locationProjects
A humanoid robot controlled by a virtual reality headset
A STM32 based USB HID game controller with 10 analog inputs
Utilized reinforcement learning to obtain walking policies for Atlas
Developed a YoloV5 based object tracker to determine a vessels gps location from surveillance footage. This project was part of a competition and placed 3rd out of 41 participating teams and was awarded $35000.
A system control software implemented on a Raspberry Pi
A booking tool for a DJ Agency
Employment
Phd studentA renommated Institute for humanoid Robotics, particularily known for the ARMAR Series of Robots
- Firmware development for EtherCat Slaves
- Assembly of the new Armar 7 robot
- Teleoperation mode for Armar 6
- Research of Human Robot Collaboration using offline reinforcement learning, large language models and computer vision
Strategy AnalystMensch Cologne Capital is an investmentbanking startup that develops machine learnign based trading strategies for interest rate swaps.
- Researching machine learning based methods for interest swap rate prediction
Student researcherIHMC is one of the world's leading research institues for robotics.
- Trained a swarm of drones to work together in a decentralized team to win a capture the flag game
- Used reinforcement learning to train a walking model for the Atlas humanoid robot
Teaching assistantMy teaching assistance ship is tied to a student-fee waiver, which made it possible for me to study in the United States.
- Grading of multiple courses, including Artificial Intelligence, Discrete Mathematics and Java.
Student researchere.GO is an electric car start-up founded by professor Schuh, that innovates transportation using autonomous driving and traffic-on-demand.
- Utilized reinforcement learning for autonomous driving
Student researcherIKA researches new methods for the mobility of the future.
- Development of a Website for a dataset
- Implementing the V2X communation utilities for the test vehicle
Sport-EntertainerI worked in a hotel for TUI for half a year in Crete, Greece. Why? Before I started studying, I decided to work in something that is completely off my main career track and pushes me out of my comfort zone.
- Taking care of the well-being of the guests by organizing sport activities.
- Performing in the hotel's dance- and comedy-shows
- Supervising children in the kindergarten.
InternEdison Fathepour GmbH stamps parts for the car industry. Here I completed my pre-study internship required for studying business engineering at RWTH Aachen.
- Different activities for primary, forming, and thermal manufacturing processes.
Student researcherFKIE researches how to improve the ease of use of computers.
- Development of an augmented realtiy application to display the employee database in a more organized manner.
DeveloperSOVAmed GmbH developes computer vision software for hospitals.
- Development of the user interface components for the Mac OS application
- Optimizing the process of creating the medical documentation
Awards
ICPC Regionals Div. 2
3 / 33Competitive Programming competition
HackTheMachine (Data Science)
1 / 43- $15000Malware classification challenge, tabular data learning based on lgbm and gradient histogram boosting
HackTheMachine (Data Science)
5 / 20Natural language processing including sentiment classification and information extraction
AI tracks at sea
3 / 41- $35000Development of a new method to calibrate the camera from the ships' GPS coordinate and used YoloV5 for tracking
National Cyber Leauge
28 / 6011Cybersecurity challenges
Education
GPA 3.93 (best: 4.0 - worst: 1.0)
- President of the Artificial Intelligence and Data Analytics research group.
- Received the outstanding graduate student award.
- Curricular Practical Training (CPT) at IHMC.
GPA 2.5 (best: 1.0 - worst: 5.0)
- Thesis: Artificial intelligence for analyzing the workspace of robotic manipulators
GPA 2.0 (best: 1.0 - worst: 5.0)
- Thesis: Deep Learning for Analysis of Video Recordings of Mice in Open Field Experiments
- Received the Deans List Award for graduating within the best 5% of my class
Publications
Tobias Jacob, Daniel Duran, Trey Pfeiffer, Micael Vignati, Matthew Johnson (2023). Multi-agent Reinforcement Learning for Unmanned Aerial Vehicle Capture-The-Flag Game Behavior. Intellisys 2023.
Tobias Jacob, Raffaele Galliera, Muddasar Ali, Sikha Bagui (2021). Marine Vessel Tracking using a Monocular Camera. Delta 2021.
Marcin Kopaczka, Tobias Jacob, Lisa Ernst, Mareike Schulz, René Tolba, Dorit Merhof (2020). Robust Open Field Rodent Tracking Using a Fully Convolutional Network and a Softargmax Distance Loss. Bildverarbeitung für die Medizin 2020.