News

Help us tailoring automated debugging to your needs

Written on 16.09.21 by Andreas Zeller

Dear former course participants,

Thank you for your interest in software testing and debugging! We're developing Alhazen, a tool that automatically finds out when and why your program fails. We are heavily relying on your opinion as professional developers. Please take part in our user study to… Read more

Dear former course participants,

Thank you for your interest in software testing and debugging! We're developing Alhazen, a tool that automatically finds out when and why your program fails. We are heavily relying on your opinion as professional developers. Please take part in our user study to help us tie our approach to your needs:

    https://tinyurl.com/debuggingstudy

Thanks a lot!

Andreas Zeller + Team

Final submissions

Written on 15.10.19 by Rahul Gopinath

For those who haven't submitted their final notebooks, we would like to remind you to please send us the notebooks containing your final results, as well as the slides (that you presented) as soon as possible.

Regards,

Rahul Gopinath

Fuzzing Seminar -- Final Presentation Schedule -- October 8, 2PM - 6PM (updated)

Written on 16.09.19 by Rahul Gopinath

Dear all,

    Due to the Global Climate Strike taking place on 20th September, of which CISPA is a part of, we will have our main presentation on October 8th 2 PM to 6 PM. As before, we will have 20 minutes per presentation, with a few minutes for questions. For those who can't make it on October… Read more

Dear all,

    Due to the Global Climate Strike taking place on 20th September, of which CISPA is a part of, we will have our main presentation on October 8th 2 PM to 6 PM. As before, we will have 20 minutes per presentation, with a few minutes for questions. For those who can't make it on October 8th, please let us know in advance so that we may schedule a presentation on 20th September, during the morning hours. Please get in touch with us regarding the contents of the topic for the final presentation.

Regards,
Rahul & Andreas

Fuzzing Seminar -- Final Presentation Schedule -- September 20 and October 8, 2PM - 6PM

Written on 30.08.19 by Rahul Gopinath

Dear all,

     For the final presentation, the schedule will be September 20 from 2 PM to 6 PM, and October 8 2 PM to 6 PM. We will have 20 minutes per presentation, with a few minutes of questions.

Regards,
Rahul & Andreas

Fuzzing Seminar -- Final Presentation Schedule

Written on 22.07.19 by Rahul Gopinath

Dear all,

     For the final presentation, we are planning conducting all presentations on a single day. The schedule will be from 9 AM to 1 PM, and 2 PM to 6 PM, 20 minutes per presentation, with a few minutes of questions. Please indicate your availability in the doodle poll… Read more

Dear all,

     For the final presentation, we are planning conducting all presentations on a single day. The schedule will be from 9 AM to 1 PM, and 2 PM to 6 PM, 20 minutes per presentation, with a few minutes of questions. Please indicate your availability in the doodle poll below.

https://doodle.com/poll/7uhr2qabkfq4i2mv

Once we have a date that is acceptable to the majority, we will schedule individual presentation slots.

Regards,

Rahul & Andreas

Next seminar on 19th July (coming Friday) - plans for the final presentation

Written on 15.07.19 by Rahul Gopinath

Dear all,

Our next seminar meeting will take place on July 19 (13:30, as usual). In this seminar, we will discuss the current progress and tentative dates for presentation for each project (September).

Looking forward to see you, and best wishes,

Rahul and Andreas

Next seminar meeting: Friday, July 5 (with seminar evaluation)

Written on 02.07.19 by Andreas Zeller

Dear all,

Our next seminar meeting will take place on July 5 (13:30, as usual).  We will have one last project presentation (from last week) and can spend some time discussing open evaluation issues.  We're all still very excited about your last results!

In this meeting, we will also distribute… Read more

Dear all,

Our next seminar meeting will take place on July 5 (13:30, as usual).  We will have one last project presentation (from last week) and can spend some time discussing open evaluation issues.  We're all still very excited about your last results!

In this meeting, we will also distribute and fill out evaluation sheets for the seminar.  Should you not be able to join on Friday, and pass by CISPA anyway, you can also pick up a sheet in Rahul's office (CISPA, Room 206) and fill it out right away.

Looking forward to see you, and best wishes,

Andreas + Rahul

Your presentation of intermediate results on June 21 and 28

Written on 17.06.19 by Andreas Zeller

Dear all,

as announced in the last news and discussed on Friday:

  • On June 21 and June 28 (this Friday and the Friday after)we would like to see intermediate results from your work in a 5-minute presentation, followed by 5 minutes of joint discussion and feedback.  This will guide the next… Read more

Dear all,

as announced in the last news and discussed on Friday:

  • On June 21 and June 28 (this Friday and the Friday after)we would like to see intermediate results from your work in a 5-minute presentation, followed by 5 minutes of joint discussion and feedback.  This will guide the next steps of your work.
  • The preferred way to present would be right out of a Jupyter notebook, using the built-in slide generator.  As an alternative, you can submit your presentation as a PDF file via the CMS system the day before your presentation.

The schedule of talks is as follows (13:30, seminar room):

  • Friday, June 21: Marius, Canberk, Mirabdulla, Abilash, Banji
  • Friday, June 28: Johannes, Akbar, Annabelle, Sebastian.

Looking forward to your first results,

Andreas + Rahul

Seminar meeting June 14; present intermediate results on June 21 and 28

Written on 13.06.19 by Andreas Zeller

Dear all,

We hope all of you are doing well in your projects.  We have a series of upcoming seminar meetings to discuss progress and possible issues.

  • On June 14 (tomorrow), we meet for discussing potential problems with your respective projects. This is an optional service meeting; if you… Read more

Dear all,

We hope all of you are doing well in your projects.  We have a series of upcoming seminar meetings to discuss progress and possible issues.

  • On June 14 (tomorrow), we meet for discussing potential problems with your respective projects. This is an optional service meeting; if you don't have any problems, you don't have to come. Still, your presence will be appreciated as we will also talk about the next meetings.
  • On June 21 and June 28 (next week and the week after)we would like to see intermediate results from your work in a 5-minute presentation, followed by 5 minutes of joint discussion and feedback.  This will guide the next steps of your work.
  • The preferred way to present would be right out of a Jupyter notebook, using the built-in slide generator.  As an alternative, you can submit your presentation as a PDF file via the CMS system the day before your presentation.
  • We will schedule talk slots during tomorrow's meeting and announce them separately.

Looking forward to see you, and let us know if you have any questions,

Andreas + Rahul

Grammars for CSS and HTML

Written on 27.05.19 (last change on 27.05.19) by Rahul Gopinath

Hello Students,

We have updates on the CSS and HTML grammars. The CSS grammar is available at https://gist.github.com/vrthra/72cfafff238057a833ac13e12c37fe01 and the HTML grammar is available at https://gist.github.com/vrthra/f9392ab35751aa8960aeeb2de437f866 . These are meant to be… Read more

Hello Students,

We have updates on the CSS and HTML grammars. The CSS grammar is available at https://gist.github.com/vrthra/72cfafff238057a833ac13e12c37fe01 and the HTML grammar is available at https://gist.github.com/vrthra/f9392ab35751aa8960aeeb2de437f866 . These are meant to be over-approximations of the real grammar. That is, it should be able to parse a superset of valid HTML and CSS documents. However, there are some notable absences such as Unicode and non-printable characters. If you find that either of the grammars are missing any required part, please let us know (or even better: fix it, and send us a PR).

Regards,

Rahul

Room change for today's meeting: room 0.01

Written on 24.05.19 by Andreas Zeller

Due to increased interest, today's seminar meeting and talk on sound empirical research will take place in room 0.01 (CISPA).  See you!

Please summarize results of 1:1 meetings; first benchmarks ready on Friday

Written on 17.05.19 by Andreas Zeller

Dear all,

as of today noon, all of you should have had a 1:1 meeting regarding your particular evaluation / comparison task.  If you haven't done so already, please send us a mail describing your task in a handful of bullet points; this is to ensure we are all on the same boat.

As presented to… Read more

Dear all,

as of today noon, all of you should have had a 1:1 meeting regarding your particular evaluation / comparison task.  If you haven't done so already, please send us a mail describing your task in a handful of bullet points; this is to ensure we are all on the same boat.

As presented to most of you already, we will be preparing a set of evaluation subjects (HTML and CSS grammars and subjects) most of you can use in your evaluation; more on this on Friday.  If you have any questions, do not hesitate to ask us!

Looking forward to see you next week, and best wishes,

Andreas + Rahul

No seminar meeting today

Written on 17.05.19 by Andreas Zeller

Dear all,

our speaker for today, Sascha Just, has fallen ill.  Today's presentation (and seminar meeting) is therefore canceled.  We will postpone the presentation on evaluation techniques to our next meeting on May 24, 13:30.  See you soon!

Cheers,

Andreas + Rahul

Kick-off meeting Wed April 17, 17:00 at CISPA

Written on 12.04.19 by Andreas Zeller

Dear all,

Welcome to the seminar on "Comparing Fuzzing Techniques”!  In this seminar, we want to build on the techniques from the “Generating Software Tests” book, which you have worked with extensively in the last semester.  Our aim is to have all of you contribute to the book by evaluating some… Read more

Dear all,

Welcome to the seminar on "Comparing Fuzzing Techniques”!  In this seminar, we want to build on the techniques from the “Generating Software Tests” book, which you have worked with extensively in the last semester.  Our aim is to have all of you contribute to the book by evaluating some of the techniques and possibly even write a scientific paper about your results.  We very much look forward to this seminar and hope you are as excited as we are.
 
Our first task will be to have a kick-off meeting, such that we can plan what to do and find a common date for our regular meetings.  This kick off date will take place in CISPA at
 
    Wednesday, April 17, 17:00
 
In preparation for the meeting, it won't hurt to take a look at the latest version of the book (at https://beta.fuzzingbook.org/) and already check out whether there would be areas that you find of particular interest.  We are very open to suggestions regarding the subject of your particular task.
 
Did we say we are excited?  Oh yes, we are.  And we’re looking forward to see you soon!
 
Best wishes, and see you on Wednesday,
 
Andreas Zeller + Rahul Gopinath
Show all

Comparing Fuzzing Techniques

In this seminar, we evaluate automated test generation techniques (fuzzers) for their effectiveness and efficiency. We discuss and design evaluation criteria and apply them on a number of techniques from the book "Generating Software Tests" (https://www.fuzzingbook.org). Apart from reporting and presenting your results in the seminar, your evaluation results will be included in the book. If the results or techniques are novel (many of them are), we will also strive to publish them as a scientific paper, with you as co-author.

Group phase:
* Introduction to empirical techniques (all)
* Designing benchmarks (all)
* Defining common evaluation questions (all)
* Presenting empirical results (all)

Individual phase:
* Selecting an individual fuzzing technique for evaluation
* Defining individual evaluation questions and parameters
* Conducting the evaluation
* Producing an evaluation report
* Presenting and discussing evaluation results

The fuzzers are implemented in Python and come as Jupyter Notebooks. You will also use Jupyter Notebooks for conducting the evaluation and presenting the final results, both as report and as presentation.

Requirements: You should have passed the lecture "Generating Software Tests" or have sufficient knowledge from the course.

Knowledge of Python and experience with Jupyter Notebooks is helpful, but can be acquired during the seminar.

Privacy Policy | Legal Notice
If you encounter technical problems, please contact the administrators.