News

Help us tailoring automated debugging to your needs

Written on 16.09.21 by Andreas Zeller

Dear former course participants,

Thank you for your interest in software testing and debugging! We're developing Alhazen, a tool that automatically finds out when and why your program fails. We are heavily relying on your opinion as professional developers. Please take part in our user study to… Read more

Dear former course participants,

Thank you for your interest in software testing and debugging! We're developing Alhazen, a tool that automatically finds out when and why your program fails. We are heavily relying on your opinion as professional developers. Please take part in our user study to help us tie our approach to your needs:

    https://tinyurl.com/debuggingstudy

Thanks a lot!

Andreas Zeller + Team

Final Reports

Written on 19.08.20 by Rafael Dutra

Dear students,

Reminder that the final reports for the seminar will be due in about 2 weeks, on 1st of September.

You can send us the reports directly by email.

Thank you!

Presentation Schedule

Written on 22.07.20 by Rahul Gopinath

Hello Students,
The following students are scheduled to present their topics today:
 

1. Niklas Kempf

2. Joshua Renckens
3. Bachir Bendrissou
 
The remaining presentations are scheduled for tomorrow.

No Meeting Today

Written on 15.07.20 by Rafael Dutra

Hello,

There will be no meeting today. All the presentations will be next week on 22 and 23.

Good luck preparing you presentations!

Feel free to send us any questions by email.

Poll: Presentation Dates

Written on 10.07.20 by Rafael Dutra

Hi,

We're sending a poll so that we get more information to schedule the presentations.

Can you please fill out this poll today by selecting one or two preferred presentation dates?

Presentations will always start at 16:15 and can end no later than 18:00.

We're expecting 10 min… Read more

Hi,

We're sending a poll so that we get more information to schedule the presentations.

Can you please fill out this poll today by selecting one or two preferred presentation dates?

Presentations will always start at 16:15 and can end no later than 18:00.

We're expecting 10 min presentation + 10 min discussion for each student.

Thank you!

https://whenisgood.net/gtpk84z

LSF registration

Written on 08.07.20 by Rahul Gopinath

Dear Students,

      In case any of you are yet to register with LSF, please contact the examination office immediately. In case of any problems, please contact one of the instructors for help.

Presentation Schedule

Written on 02.07.20 by Rafael Dutra

Hi, all!

Since most of the students wouldn't have everything ready to present next week, we are delaying the presentations for one more week.

So the presentations should happen on 15 July and 22 July (possibly also 23 July if there is any overflow).

If anyone wants to volunteer to present on… Read more

Hi, all!

Since most of the students wouldn't have everything ready to present next week, we are delaying the presentations for one more week.

So the presentations should happen on 15 July and 22 July (possibly also 23 July if there is any overflow).

If anyone wants to volunteer to present on the first day (15 July), just let us know. Otherwise we will choose next week who presents on which date.

You should try to finish as many experiments as possible by 15 July so you can be ready to present.

Presentations should be kept under 10 minutes so we have more time for discussion.

Todays presentations

Written on 17.06.20 by Rahul Gopinath

Hello,

As we discussed previously, we are scheduling these project proposal presentations today:

Mortiz : Reducer
David: Grammar Mining
Joshua: Symbolic & Concolic fuzzer
Matthias: Grammar based GUI fuzzing

These should be simple 10 min. presentation + 5 min. discussion about what you're… Read more

Hello,

As we discussed previously, we are scheduling these project proposal presentations today:

Mortiz : Reducer
David: Grammar Mining
Joshua: Symbolic & Concolic fuzzer
Matthias: Grammar based GUI fuzzing

These should be simple 10 min. presentation + 5 min. discussion about what you're planning to do for the project.

See you there!

Talk by Andreas Zeller "Learning the Language of Failure" on Thursday

Written on 16.06.20 by Andreas Zeller

Dear all,

as we have talked a lot about current research in fuzzing and testing, let me announce one of my own talks taking place this Thursday at 13:30:

    https://casa.rub.de/en/news/distinguished-lectures

The talk is all about automated testing and debugging techniques, and gives a nice… Read more

Dear all,

as we have talked a lot about current research in fuzzing and testing, let me announce one of my own talks taking place this Thursday at 13:30:

    https://casa.rub.de/en/news/distinguished-lectures

The talk is all about automated testing and debugging techniques, and gives a nice overview on our latest and greatest recent research. And you may even see a few presentation ideas you haven't seen before. Enjoy!

Andreas Zeller

Project Proposal Presentations Tomorrow

Written on 09.06.20 by Rafael Dutra

Hello,

We're scheduling these project proposal presentations tomorrow:

Florian Bauckholt: Lang Fuzzer

Bachir Bendrissou: Parser Directed Test Generation

Niklas Kempf: Concolic vs. Grammar Fuzzing

Tobias Lorig: Combining Generational and Mutational Fuzzing

 

These should be simple… Read more

Hello,

We're scheduling these project proposal presentations tomorrow:

Florian Bauckholt: Lang Fuzzer

Bachir Bendrissou: Parser Directed Test Generation

Niklas Kempf: Concolic vs. Grammar Fuzzing

Tobias Lorig: Combining Generational and Mutational Fuzzing

 

These should be simple 10 min. presentation + 5 min. discussion about what you're planning to do for the project.

 

See you there!

Next seminar meeting (with talk on empirical work): Friday 17:00

Written on 27.05.20 by Andreas Zeller

Subject says it all – this is a replacement date for today's canceled meeting. See you on Friday!

Project Assignments

Written on 19.05.20 by Rafael Dutra

Dear students,

   We have assigned topics based on your preferences (more than half of students got their first choice).
   Please find your topic assignments below.

1. Reducer : Moritz
2. Parser-Directed Test Generation (PDTG) vs uninstrumented : Bachir
3. Combining generational… Read more

Dear students,

   We have assigned topics based on your preferences (more than half of students got their first choice).
   Please find your topic assignments below.

1. Reducer : Moritz
2. Parser-Directed Test Generation (PDTG) vs uninstrumented : Bachir
3. Combining generational grammar-based fuzzing with mutational fuzzing : Tobias
4. Symbolic & Concolic fuzzer : Joshua
5. Lang fuzzer and plain grammar fuzzer : Florian
6. Grammar mining (string inclusion, taints, and mimid) : David
7. Concolic Fuzzing vs Grammar Fuzzing: Niklas
8. Grammar based GUI fuzzing : Matthias

Choose Assignment Preferences

Written on 13.05.20 by Andreas Zeller

Dear all,

as detailed in today's meeting, we would like to assign a topic to each of you. You can find the list of topics here:

    https://cms.cispa.saarland/fuzzing20/materials/

To express your preferences for an individual topic, please fill out this survey. Please use one "yes" vote… Read more

Dear all,

as detailed in today's meeting, we would like to assign a topic to each of you. You can find the list of topics here:

    https://cms.cispa.saarland/fuzzing20/materials/

To express your preferences for an individual topic, please fill out this survey. Please use one "yes" vote (green checkmark) for the topic that interests you most, and up to two "if need be" votes (yellow checkmark in parentheses; tick the checkbox twice for these) for up to two follow-up topics. For your name, initials will suffice. Please use this link to cast your vote:

    https://doodle.com/poll/5izamentcm5xcm3r

Please cast your vote by Monday, May 18. Feel free to ask us any questions anytime!

Stay safe, stay healthy, and see you next Wednesday,

Andreas + Rafael + Rahul

Initial meeting postponed to next week – please choose best date(s)

Written on 05.05.20 by Andreas Zeller

Dear all,

Bad news: our co-instructor Rahul has fallen sick, and will be unavailable for the rest of the week. Hence, we cannot have our initial meeting this week as planned. Instead, we will have our first meeting next week. Please take a moment to pick the time that works best for you:

   … Read more

Dear all,

Bad news: our co-instructor Rahul has fallen sick, and will be unavailable for the rest of the week. Hence, we cannot have our initial meeting this week as planned. Instead, we will have our first meeting next week. Please take a moment to pick the time that works best for you:

    https://doodle.com/poll/shx2g8863gxae48k

The time you indicate your availability will also hold for our recurring meetings in the next weeks, so check with your recurring (course) schedule. Please complete the schedule by Friday May 8 at the latest.

We will send additional instructions on the first meeting together with the format and expectations before the meeting, and on Monday at the latest. We very much look forward working with you!

Our apologies for the inconvenience, and see you next week,

Andreas (+ Rahul)

Initial meeting

Written on 30.04.20 by Andreas Zeller

Welcome to the seminar on "Advanced Fuzzing Techniques"!

We will have a first (virtual) seminar meeting on Wednesday May 6 at 16:00.  Invites to the Zoom videoconference will be sent by mail before the meeting.

Looking forward to see you, and best wishes,

Rahul + Andreas

Registration

Written on 31.03.20 by Andreas Zeller

Please note that to register, you have to use the central system of the CS department.

Show all

Advanced Fuzzing Techniques

In this seminar, we explore and evaluate automated test generation techniques (fuzzers) and related techniques for their effectiveness and efficiency. We discuss and design evaluation criteria and apply them on a number of techniques from the "Fuzzing Book" (https://www.fuzzingbook.org). Apart from reporting and presenting your results in the seminar, your evaluation results will be included in the book. If the results or techniques are novel (many of them are), we will also strive to publish them as a scientific paper, with you as co-author.

Group phase:
* Introduction to empirical techniques (all)
* Designing benchmarks (all)
* Defining common evaluation questions (all)
* Presenting empirical results (all)

Individual phase:
* Selecting an individual fuzzing technique for evaluation
* Defining individual evaluation questions and parameters
* Conducting the evaluation
* Producing an evaluation report
* Presenting and discussing evaluation results

The fuzzers are implemented in Python and come as Jupyter Notebooks. You will also use Jupyter Notebooks for conducting the evaluation and presenting the final results, both as report and as presentation.

Requirements: You should have passed the lecture "Generating Software Tests" or have sufficient knowledge from the course.  Knowledge of Python and experience with Jupyter Notebooks is helpful, but can be acquired during the seminar.

Registration: To register, use the central system of the CS department.

Privacy Policy | Legal Notice
If you encounter technical problems, please contact the administrators.