News
Meeting Nov 25, 6pmWritten on 18.11.24 by Sebastian Stich Dear Students, Please note that I had to reschedule our discussion on November 25 to 6 PM (6:15-7:00 PM on Zoom). For those unable to attend, rest assured that the session will be recorded for later viewing (thanks for letting me know that the link was broken!).
Dear Students, Please note that I had to reschedule our discussion on November 25 to 6 PM (6:15-7:00 PM on Zoom). For those unable to attend, rest assured that the session will be recorded for later viewing (thanks for letting me know that the link was broken!).
|
|||||||||||||||
Latex TemplateWritten on 11.11.24 by Sebastian Stich Dear Students I have added the slides from today and a latex template for the review to the [Course Materials Tab].
|
|||||||||||||||
Next meeting: Monday, Nov 11Written on 04.11.24 by Sebastian Stich Dear Students, I have distributed the topics, allowing for choices 3 or 4 where possible. Based on your votes, Monday from 13:15 to 14:00 seems to be a convenient time for most of you to have short zoom meetings during the semester. Our first meeting will be on November 11, during which I will… Read more Dear Students, I have distributed the topics, allowing for choices 3 or 4 where possible. Based on your votes, Monday from 13:15 to 14:00 seems to be a convenient time for most of you to have short zoom meetings during the semester. Our first meeting will be on November 11, during which I will explain the first writing task. I will also post a video recording, but please attend the session if you have questions (in the following meetings, I will also give some general feedback on the writing tasks from the week before).
|
|||||||||||||||
Vote for TopicsWritten on 29.10.24 (last change on 29.10.24) by Sebastian Stich Dear Students, As announced in the kick-off meeting, please vote for your favorite topic by Nov 1 and also indicate your conflicts for meeting/presentation slots. Topic List: (for registered participants) The next meeting is planned for Nov 11 or 12 (depending on the survey outcome). |
|||||||||||||||
Kick-off meetingWritten on 23.10.24 (last change on 23.10.24) by Sebastian Stich There will be a kick-off meeting next Tuesday, 4.15-5pm on zoom. The link is available to registered participants.
|
Seminar: Topics in Optimization for Machine Learning
Optimization lies at the heart of many machine learning algorithms. This seminar teaches an overview of modern mathematical optimization methods for machine learning and data science applications. In particular, we will discuss the theoretical basics of stochastic optimization, the scalability of algorithms to large datasets, and challenges in distributed optimization, such as decentralized or federated machine learning. We will cover a set of foundational papers and a selection of recent publications.
Previous attendance at the summer term lecture "Optimization for Machine Learning" is recommended but not required (if you know the basic principles of optimization).
Organization
In this seminar, students will learn to present, discuss, and summarize papers in different areas of optimization for machine learning. Specifically, each student will get a topic assigned to them, consisting of two papers (a lead and follow-up paper). Each student will
- prepare a presentation on the topic assigned to them and present the paper to the other students;
- write a short seminar paper on the topic assigned to them, for which the two papers on the topic serve as the starting point;
- write 2-3 short paper reviews (and prepare questions about these papers that can be asked during the discussion)
We will have a few Zoom meetings during the semester where the writing exercises will be explained, discussed, and evaluated. The main presentations will occur towards the end of the semester (TBA) - participation is mandatory.
The final grade will depend on the presentation, the written deliverables, and the active participation in the discussions.
Important Dates
- Kick-off meeting 29.10.2024 (to be held online, via zoom).
- Voting for topics deadline: 1.11.2024
- Registration deadline in LSF: 25.11.2024
- The presentations will take place between January and February. Participation is mandatory.
- Mandatory feedback round/practice talk at least two weeks before the presentation (arrange exact time with the tutor/supervisor).
- Hand-in of report: TBA.
Meetings (zoom, start: 13:15h)
| Task | Meeting | Hand-in |
| Review 1 | Nov 11, 1.15-2pm | Nov 21 |
| Review 2 | Nov 25, 6.15-7pm | Dec 5 |
| Review 3 | Dec 9, 1.15-2pm | Dec 19 |
| Presentation/Final Report | Dec 23 1.15-2pm |
Deliverables
- 3 short paper reviews
- 1 presentation
- seminar paper (5-6 page summary of the paper you present)