News
Help us tailoring automated debugging to your needsWritten on 16.09.21 by Andreas Zeller Dear former course participants, Thank you for your interest in software testing and debugging! We're developing Alhazen, a tool that automatically finds out when and why your program fails. We are heavily relying on your opinion as professional developers. Please take part in our user study to… Read more Dear former course participants, Thank you for your interest in software testing and debugging! We're developing Alhazen, a tool that automatically finds out when and why your program fails. We are heavily relying on your opinion as professional developers. Please take part in our user study to help us tie our approach to your needs: https://tinyurl.com/debuggingstudy Thanks a lot! Andreas Zeller + Team |
Final ReportsWritten on 19.08.20 by Rafael Dutra Dear students, Reminder that the final reports for the seminar will be due in about 2 weeks, on 1st of September. You can send us the reports directly by email. Thank you! |
Presentation ScheduleWritten on 22.07.20 by Rahul Gopinath Hello Students,
The following students are scheduled to present their topics today:
1. Niklas Kempf 2. Joshua Renckens
3. Bachir Bendrissou
The remaining presentations are scheduled for tomorrow.
|
No Meeting TodayWritten on 15.07.20 by Rafael Dutra Hello, There will be no meeting today. All the presentations will be next week on 22 and 23. Good luck preparing you presentations! Feel free to send us any questions by email. |
Poll: Presentation DatesWritten on 10.07.20 by Rafael Dutra Hi, We're sending a poll so that we get more information to schedule the presentations. Can you please fill out this poll today by selecting one or two preferred presentation dates? Presentations will always start at 16:15 and can end no later than 18:00. We're expecting 10 min… Read more Hi, We're sending a poll so that we get more information to schedule the presentations. Can you please fill out this poll today by selecting one or two preferred presentation dates? Presentations will always start at 16:15 and can end no later than 18:00. We're expecting 10 min presentation + 10 min discussion for each student. Thank you! https://whenisgood.net/gtpk84z |
LSF registrationWritten on 08.07.20 by Rahul Gopinath Dear Students, In case any of you are yet to register with LSF, please contact the examination office immediately. In case of any problems, please contact one of the instructors for help. |
Presentation ScheduleWritten on 02.07.20 by Rafael Dutra Hi, all! Since most of the students wouldn't have everything ready to present next week, we are delaying the presentations for one more week. So the presentations should happen on 15 July and 22 July (possibly also 23 July if there is any overflow). If anyone wants to volunteer to present on… Read more Hi, all! Since most of the students wouldn't have everything ready to present next week, we are delaying the presentations for one more week. So the presentations should happen on 15 July and 22 July (possibly also 23 July if there is any overflow). If anyone wants to volunteer to present on the first day (15 July), just let us know. Otherwise we will choose next week who presents on which date. You should try to finish as many experiments as possible by 15 July so you can be ready to present. Presentations should be kept under 10 minutes so we have more time for discussion. |
Todays presentationsWritten on 17.06.20 by Rahul Gopinath Hello, As we discussed previously, we are scheduling these project proposal presentations today: Mortiz : Reducer These should be simple 10 min. presentation + 5 min. discussion about what you're… Read more Hello, As we discussed previously, we are scheduling these project proposal presentations today: Mortiz : Reducer These should be simple 10 min. presentation + 5 min. discussion about what you're planning to do for the project. See you there! |
Talk by Andreas Zeller "Learning the Language of Failure" on ThursdayWritten on 16.06.20 by Andreas Zeller Dear all, as we have talked a lot about current research in fuzzing and testing, let me announce one of my own talks taking place this Thursday at 13:30: https://casa.rub.de/en/news/distinguished-lectures The talk is all about automated testing and debugging techniques, and gives a nice… Read more Dear all, as we have talked a lot about current research in fuzzing and testing, let me announce one of my own talks taking place this Thursday at 13:30: https://casa.rub.de/en/news/distinguished-lectures The talk is all about automated testing and debugging techniques, and gives a nice overview on our latest and greatest recent research. And you may even see a few presentation ideas you haven't seen before. Enjoy! Andreas Zeller |
Project Proposal Presentations TomorrowWritten on 09.06.20 by Rafael Dutra Hello, We're scheduling these project proposal presentations tomorrow: Florian Bauckholt: Lang Fuzzer Bachir Bendrissou: Parser Directed Test Generation Niklas Kempf: Concolic vs. Grammar Fuzzing Tobias Lorig: Combining Generational and Mutational Fuzzing
These should be simple… Read more Hello, We're scheduling these project proposal presentations tomorrow: Florian Bauckholt: Lang Fuzzer Bachir Bendrissou: Parser Directed Test Generation Niklas Kempf: Concolic vs. Grammar Fuzzing Tobias Lorig: Combining Generational and Mutational Fuzzing
These should be simple 10 min. presentation + 5 min. discussion about what you're planning to do for the project.
See you there! |
Next seminar meeting (with talk on empirical work): Friday 17:00Written on 27.05.20 by Andreas Zeller Subject says it all – this is a replacement date for today's canceled meeting. See you on Friday! |
Project AssignmentsWritten on 19.05.20 by Rafael Dutra Dear students, We have assigned topics based on your preferences (more than half of students got their first choice). 1. Reducer : Moritz Dear students, We have assigned topics based on your preferences (more than half of students got their first choice). 1. Reducer : Moritz |
Choose Assignment PreferencesWritten on 13.05.20 by Andreas Zeller Dear all, as detailed in today's meeting, we would like to assign a topic to each of you. You can find the list of topics here: https://cms.cispa.saarland/fuzzing20/materials/ To express your preferences for an individual topic, please fill out this survey. Please use one "yes" vote… Read more Dear all, as detailed in today's meeting, we would like to assign a topic to each of you. You can find the list of topics here: https://cms.cispa.saarland/fuzzing20/materials/ To express your preferences for an individual topic, please fill out this survey. Please use one "yes" vote (green checkmark) for the topic that interests you most, and up to two "if need be" votes (yellow checkmark in parentheses; tick the checkbox twice for these) for up to two follow-up topics. For your name, initials will suffice. Please use this link to cast your vote: https://doodle.com/poll/5izamentcm5xcm3r Please cast your vote by Monday, May 18. Feel free to ask us any questions anytime! Stay safe, stay healthy, and see you next Wednesday, Andreas + Rafael + Rahul |
Initial meeting postponed to next week – please choose best date(s)Written on 05.05.20 by Andreas Zeller Dear all, Bad news: our co-instructor Rahul has fallen sick, and will be unavailable for the rest of the week. Hence, we cannot have our initial meeting this week as planned. Instead, we will have our first meeting next week. Please take a moment to pick the time that works best for you: Dear all, Bad news: our co-instructor Rahul has fallen sick, and will be unavailable for the rest of the week. Hence, we cannot have our initial meeting this week as planned. Instead, we will have our first meeting next week. Please take a moment to pick the time that works best for you: https://doodle.com/poll/shx2g8863gxae48k The time you indicate your availability will also hold for our recurring meetings in the next weeks, so check with your recurring (course) schedule. Please complete the schedule by Friday May 8 at the latest. We will send additional instructions on the first meeting together with the format and expectations before the meeting, and on Monday at the latest. We very much look forward working with you! Our apologies for the inconvenience, and see you next week, Andreas (+ Rahul) |
Initial meetingWritten on 30.04.20 by Andreas Zeller Welcome to the seminar on "Advanced Fuzzing Techniques"! We will have a first (virtual) seminar meeting on Wednesday May 6 at 16:00. Invites to the Zoom videoconference will be sent by mail before the meeting. Looking forward to see you, and best wishes, Rahul + Andreas |
RegistrationWritten on 31.03.20 by Andreas Zeller Please note that to register, you have to use the central system of the CS department. |
Advanced Fuzzing Techniques
In this seminar, we explore and evaluate automated test generation techniques (fuzzers) and related techniques for their effectiveness and efficiency. We discuss and design evaluation criteria and apply them on a number of techniques from the "Fuzzing Book" (https://www.fuzzingbook.org). Apart from reporting and presenting your results in the seminar, your evaluation results will be included in the book. If the results or techniques are novel (many of them are), we will also strive to publish them as a scientific paper, with you as co-author.
Group phase:
* Introduction to empirical techniques (all)
* Designing benchmarks (all)
* Defining common evaluation questions (all)
* Presenting empirical results (all)
Individual phase:
* Selecting an individual fuzzing technique for evaluation
* Defining individual evaluation questions and parameters
* Conducting the evaluation
* Producing an evaluation report
* Presenting and discussing evaluation results
The fuzzers are implemented in Python and come as Jupyter Notebooks. You will also use Jupyter Notebooks for conducting the evaluation and presenting the final results, both as report and as presentation.
Requirements: You should have passed the lecture "Generating Software Tests" or have sufficient knowledge from the course. Knowledge of Python and experience with Jupyter Notebooks is helpful, but can be acquired during the seminar.
Registration: To register, use the central system of the CS department.