Julia Programming for ML

Welcome to the Julia Programming for Machine Learning course (JuML) offered by Prof. Klaus-Robert Müller's Machine Learning Group at TU Berlin.

Table of Contents

Goals

The goal of this course is to give you an introduction to the Julia programming language and its Machine Learning ecosystem. After taking this class, you should be able to write reproducible, unit-tested Julia code and do Machine Learning research in Julia.

Prerequisites

No knowledge of the Julia programming language is required: this course only assumes knowledge of common programming concepts like for-loops and arrays. Occasionally, differences and similarities to Python will be pointed out. If you don't know Python, you can safely ignore these.

Contents

Lectures

The first half of the course is taught in five weekly sessions of three hours. In each session, two lectures are taught:

The first three weeks focus on teaching the fundamentals of the Julia programming language. These weeks consist of longer lectures, followed up by shorter, "guided tours" of the Julia ecosystem, including plotting, data-frames and classical machine learning algorithms.

Week four is all about Deep Learning: A comprehensive lecture on automatic differentiation (AD) sheds light on differences between Julia's various AD packages, before giving a brief overview of Flux's Deep Learning ecosystem.

Finally, week five is all about starting your own Julia project, taking a look at the structure of Julia packages and different workflows for reproducible machine learning research. This is followed up by a demonstration of Julia's debugging and profiling utilities.

The lectures and the homework cover the following packages:

Homework

When learning a programming language, it helps to write code. The lectures from week 1 to 4 are accompanied by homework notebooks that test your understanding of the contents. These notebooks contain automated feedback in the form of tests that need to be passed.

For TU Berlin students, the homework will also be evaluated on a second, slightly different test suite to avoid cheating and hard-coded answers.

Designing homework exercises takes a lot of time, so please don't upload any answers to the homework to the internet.

Project work

In the second half of the course, after passing the homework, students work in groups on a small programming project of their choice, learning best practices for package development in Julia, such as:

• how to structure and develop a package

• how to write package tests

• how to write and host package documentation

During code review sessions, students give each other feedback on their projects before presenting their work in end-of-semester presentations.

Information for TU Berlin students

Starting in summer 2024, JuML is an stand-alone 6 ECTS / 6 LP course.

Homework assignments must be submitted every week. You must be enrolled on ISIS to submit homework. If you do not register on time, you cannot pass the course.

• Course Period: October 14th 2024 - February 14th 2025

  • Kick-off meeting: Tuesday, October 15th, 14:15-15:45, MA 042

  • Project meetings: Tuesdays, 14:15-15:45, H 3006

  • Office hours: Thursdays, 14:15-15:45, MAR 4.044

Attendance is mandatory on the following dates:

• Tuesday, 15.10.24

• Tuesday, 19.11.24

• Tuesday, 17.12.24

• Tuesday, 21.01.25

• Tuesday, 04.02.25

• Tuesday, 11.02.25

The date of the final examination will be determined on a group-by-group basis.

More information can be found on ISIS.

FAQ

Why should I learn Julia?

Paraphrasing the official website, Julia is:

• Fast: designed for high performance computing, compiles to LLVM

• Dynamic: dynamically typed, interactive REPL

• Reproducible: great package manager, reproducible environments and pre-built binaries

• Composable: uses multiple dispatch

• General: allows async I/O, metaprogramming, etc.

• Open source: open development, uses permissive MIT license

If these are features that sound appealing to you, you should learn Julia!

How can I run the notebooks?

Running notebooks is described in the "Opening lectures & homework" section of the Installation notebook.

Alternatively, you can open the notebook on Binder by clicking "Edit or run this notebook". However, Binder can take a prohibitively long time to load. Pluto notebooks show an estimate of the loading times above the "Run in Binder" button.

If you are familiar with Git, you can also clone the GitHub repository of this course. You can then open your local copy of the lectures and homework in Pluto. Just make sure to regularly pull to keep your copy of the course up to date.

I found an error or typo. What should I do?

Please help make this course better!

For small fixes, click the "Edit Julia source code" button on top of a notebook. This will open the source on GitHub, where you can then click the "Edit this file" button (shown with a pencil icon). This will create a pull request on GitHub.

Alternatively, write me on ISIS or open an issue on GitHub and tell me what needs to be fixed. Ideas and feedback are also more than welcome.

What does the symbol ⁽⁺⁾ in some slide titles mean?

This symbol indicates optional–often more advanced–content that can be skipped.

Acknowledgements

The format of this website as well as the contents of this course are influenced by the following lectures:

• Introduction to Computational Thinking at MIT by Alan Edelman, David P. Sanders, Charles E. Leiserson and Fons van der Plas

• Scientific Computing at TU Berlin by Jürgen Fuhrmann

Many thanks to

• Fons van der Plas for making Pluto and helping me build this website

• Niklas Schmitz for feedback on the AD lecture

• Janes Sanne, Dr. Andreas Ziehe and Philip Naumann for their help with teaching the course at TU Berlin

• Théo Galy-Fajou and Johnny Chen for their mentorship

• everyone who contributed to the packages covered in this lecture