News
Final presentations: July 4, 3-7pmWritten on 26.06.23 (last change on 26.06.23) by Sebastian Stich Thanks to all who voted already. I would like to confirm that we can have the first presentations on July 4, starting 3pm. Where? CISPA, room 0.07. We have already 3 confirmed speakers (Jose, Lucas, Marek - thanks!). I hope that some more can make it on this day.
Note that the second… Read more Thanks to all who voted already. I would like to confirm that we can have the first presentations on July 4, starting 3pm. Where? CISPA, room 0.07. We have already 3 confirmed speakers (Jose, Lucas, Marek - thanks!). I hope that some more can make it on this day.
Note that the second presentations can be slightly longer (25mins, with hard-cutoff at 30mins) but we will need less time for feedback/questions, so that it is possible to host all presentations on the same day. |
Final Presentation: scheduling (tentative: July 4 or 5)Written on 23.06.23 by Sebastian Stich Dear students Please use the attached link to vote for a date of the final presentation by Monday!
Seminar Organization Sheet - please enter your availability in the 'final presentation' tab My preferred day is July 4 (or June 5). |
Reminder: First presentation May 10, 3pm @ CISPAWritten on 05.05.23 by Sebastian Stich A reminder that the first round of talks are already scheduled for next week: we will meet at 3pm, in CISPA room 0.01. |
Topic Assignment, First Presentation: May 10Written on 20.04.23 by Sebastian Stich Dear students, I have now finalized the topic assignment based on your preferences (and time-availability). I would propose May 10, 3pm-6.30pm for the first round of presentations. It seems all of you can attend (partially). As a backup, please also keep May 11, 5pm-6.30pm blocked in your… Read more Dear students, I have now finalized the topic assignment based on your preferences (and time-availability). I would propose May 10, 3pm-6.30pm for the first round of presentations. It seems all of you can attend (partially). As a backup, please also keep May 11, 5pm-6.30pm blocked in your calendars. If the backup slot becomes necessary, I think it would be best to distribute the talks evenly over the slots; otherwise we will try to have all presentations on the same day (in the order of the chapters in the book).
|
Topic AssignmentWritten on 18.04.23 by Sebastian Stich Dear students, Please vote for your favorite topic by Thursday (noon), so that we can finalize the topic assignment. You find the link under the 'materials' tab.
|
Optimization Methods for Large-Scale Machine Learning
Optimization lies at the heart of many machine learning algorithms. This proseminar teaches how to give scientific presentations, and gives an overview of modern mathematical optimization methods for applications in machine learning and data science. We will closely follow the book "Optimization Methods for Large-Scale Machine Learning" by Bottou, Curtis and Nocedal. (available on arXiv: https://arxiv.org/abs/1606.04838).
Topics include (to be finalized in the kick-off meeting):
- Formal Machine Learning Procedure
- Formal Optimization Problem Statements
- Stochastic vs. Batch Optimization Methods
- Analyses of Stochastic Gradient Methods
- Noise Reduction Methods
- Second-Order Methods
- Other Popular Methods
- Methods for Regularized Models
Note that a particular focus will be put on the proof framework commonly used in this domain (e.g. assumptions on the stochastic noise, assumptions on the objective functions, convergence statements and proofs). Students are expected to (learn to) explain such technical concepts.
As a proseminar's primary purpose is to learn presentation skills, the seminar will feature two presentations from each student. The first presentation will be on a chapter/section of the book, and the second one on a paper of their choice that is related to the book section that they presented already. Both presentations will be graded.
The first presentation will count towards 30% of the overall grade, the choice of the second reference will count for 10% and the second presentation itself will count for 50% of the overall grade. 10% of the grade will be determined by oral participation in the sessions. Attendance in the proseminar meetings is mandatory.
The seminar will be organized in an online format (zoom), with a few hybrid sessions allowing for in-person presentations. The presentations will be scheduled in the middle and towards the end of the semester (similar to a block format - there is no regular weekly meeting).
Kick-off meeting (online): Tuesday, April 18, 5.15-6pm - I will send a zoom link to all assigned students.
Tentative slots for the presentations: Tuesday, 4-6pm, Thursday 4-6pm (not every week, I will propose some dates in the kick-off meeting)