News
Help us tailoring automated debugging to your needsWritten on 16.09.21 by Andreas Zeller Dear former course participants, Thank you for your interest in software testing and debugging! We're developing Alhazen, a tool that automatically finds out when and why your program fails. We are heavily relying on your opinion as professional developers. Please take part in our user study to… Read more Dear former course participants, Thank you for your interest in software testing and debugging! We're developing Alhazen, a tool that automatically finds out when and why your program fails. We are heavily relying on your opinion as professional developers. Please take part in our user study to help us tie our approach to your needs: https://tinyurl.com/debuggingstudy Thanks a lot! Andreas Zeller + Team |
Final submissionsWritten on 15.10.19 by Rahul Gopinath For those who haven't submitted their final notebooks, we would like to remind you to please send us the notebooks containing your final results, as well as the slides (that you presented) as soon as possible. Regards, Rahul Gopinath |
Fuzzing Seminar -- Final Presentation Schedule -- October 8, 2PM - 6PM (updated)Written on 16.09.19 by Rahul Gopinath Dear all, Due to the Global Climate Strike taking place on 20th September, of which CISPA is a part of, we will have our main presentation on October 8th 2 PM to 6 PM. As before, we will have 20 minutes per presentation, with a few minutes for questions. For those who can't make it on October… Read more Dear all, Due to the Global Climate Strike taking place on 20th September, of which CISPA is a part of, we will have our main presentation on October 8th 2 PM to 6 PM. As before, we will have 20 minutes per presentation, with a few minutes for questions. For those who can't make it on October 8th, please let us know in advance so that we may schedule a presentation on 20th September, during the morning hours. Please get in touch with us regarding the contents of the topic for the final presentation. Regards, |
Fuzzing Seminar -- Final Presentation Schedule -- September 20 and October 8, 2PM - 6PMWritten on 30.08.19 by Rahul Gopinath Dear all, For the final presentation, the schedule will be September 20 from 2 PM to 6 PM, and October 8 2 PM to 6 PM. We will have 20 minutes per presentation, with a few minutes of questions. Regards, |
Fuzzing Seminar -- Final Presentation ScheduleWritten on 22.07.19 by Rahul Gopinath Dear all, For the final presentation, we are planning conducting all presentations on a single day. The schedule will be from 9 AM to 1 PM, and 2 PM to 6 PM, 20 minutes per presentation, with a few minutes of questions. Please indicate your availability in the doodle poll… Read more Dear all, For the final presentation, we are planning conducting all presentations on a single day. The schedule will be from 9 AM to 1 PM, and 2 PM to 6 PM, 20 minutes per presentation, with a few minutes of questions. Please indicate your availability in the doodle poll below. https://doodle.com/poll/7uhr2qabkfq4i2mv Once we have a date that is acceptable to the majority, we will schedule individual presentation slots. Regards, Rahul & Andreas |
Next seminar on 19th July (coming Friday) - plans for the final presentationWritten on 15.07.19 by Rahul Gopinath Dear all, Our next seminar meeting will take place on July 19 (13:30, as usual). In this seminar, we will discuss the current progress and tentative dates for presentation for each project (September). Looking forward to see you, and best wishes, Rahul and Andreas |
Next seminar meeting: Friday, July 5 (with seminar evaluation)Written on 02.07.19 by Andreas Zeller Dear all, Our next seminar meeting will take place on July 5 (13:30, as usual). We will have one last project presentation (from last week) and can spend some time discussing open evaluation issues. We're all still very excited about your last results! In this meeting, we will also distribute… Read more Dear all, Our next seminar meeting will take place on July 5 (13:30, as usual). We will have one last project presentation (from last week) and can spend some time discussing open evaluation issues. We're all still very excited about your last results! In this meeting, we will also distribute and fill out evaluation sheets for the seminar. Should you not be able to join on Friday, and pass by CISPA anyway, you can also pick up a sheet in Rahul's office (CISPA, Room 206) and fill it out right away. Looking forward to see you, and best wishes, Andreas + Rahul |
Your presentation of intermediate results on June 21 and 28Written on 17.06.19 by Andreas Zeller Dear all, as announced in the last news and discussed on Friday:
Dear all, as announced in the last news and discussed on Friday:
The schedule of talks is as follows (13:30, seminar room):
Looking forward to your first results, Andreas + Rahul |
Seminar meeting June 14; present intermediate results on June 21 and 28Written on 13.06.19 by Andreas Zeller Dear all, We hope all of you are doing well in your projects. We have a series of upcoming seminar meetings to discuss progress and possible issues.
Dear all, We hope all of you are doing well in your projects. We have a series of upcoming seminar meetings to discuss progress and possible issues.
Looking forward to see you, and let us know if you have any questions, Andreas + Rahul |
Grammars for CSS and HTMLWritten on 27.05.19 (last change on 27.05.19) by Rahul Gopinath Hello Students, We have updates on the CSS and HTML grammars. The CSS grammar is available at https://gist.github.com/vrthra/72cfafff238057a833ac13e12c37fe01 and the HTML grammar is available at https://gist.github.com/vrthra/f9392ab35751aa8960aeeb2de437f866 . These are meant to be… Read more Hello Students, We have updates on the CSS and HTML grammars. The CSS grammar is available at https://gist.github.com/vrthra/72cfafff238057a833ac13e12c37fe01 and the HTML grammar is available at https://gist.github.com/vrthra/f9392ab35751aa8960aeeb2de437f866 . These are meant to be over-approximations of the real grammar. That is, it should be able to parse a superset of valid HTML and CSS documents. However, there are some notable absences such as Unicode and non-printable characters. If you find that either of the grammars are missing any required part, please let us know (or even better: fix it, and send us a PR). Regards, Rahul |
Room change for today's meeting: room 0.01Written on 24.05.19 by Andreas Zeller Due to increased interest, today's seminar meeting and talk on sound empirical research will take place in room 0.01 (CISPA). See you! |
Please summarize results of 1:1 meetings; first benchmarks ready on FridayWritten on 17.05.19 by Andreas Zeller Dear all, as of today noon, all of you should have had a 1:1 meeting regarding your particular evaluation / comparison task. If you haven't done so already, please send us a mail describing your task in a handful of bullet points; this is to ensure we are all on the same boat. As presented to… Read more Dear all, as of today noon, all of you should have had a 1:1 meeting regarding your particular evaluation / comparison task. If you haven't done so already, please send us a mail describing your task in a handful of bullet points; this is to ensure we are all on the same boat. As presented to most of you already, we will be preparing a set of evaluation subjects (HTML and CSS grammars and subjects) most of you can use in your evaluation; more on this on Friday. If you have any questions, do not hesitate to ask us! Looking forward to see you next week, and best wishes, Andreas + Rahul |
No seminar meeting todayWritten on 17.05.19 by Andreas Zeller Dear all, our speaker for today, Sascha Just, has fallen ill. Today's presentation (and seminar meeting) is therefore canceled. We will postpone the presentation on evaluation techniques to our next meeting on May 24, 13:30. See you soon! Cheers, Andreas + Rahul |
Kick-off meeting Wed April 17, 17:00 at CISPAWritten on 12.04.19 by Andreas Zeller Dear all, Welcome to the seminar on "Comparing Fuzzing Techniques”! In this seminar, we want to build on the techniques from the “Generating Software Tests” book, which you have worked with extensively in the last semester. Our aim is to have all of you contribute to the book by evaluating some… Read more Dear all, Welcome to the seminar on "Comparing Fuzzing Techniques”! In this seminar, we want to build on the techniques from the “Generating Software Tests” book, which you have worked with extensively in the last semester. Our aim is to have all of you contribute to the book by evaluating some of the techniques and possibly even write a scientific paper about your results. We very much look forward to this seminar and hope you are as excited as we are.
Our first task will be to have a kick-off meeting, such that we can plan what to do and find a common date for our regular meetings. This kick off date will take place in CISPA at
Wednesday, April 17, 17:00
In preparation for the meeting, it won't hurt to take a look at the latest version of the book (at https://beta.fuzzingbook.org/) and already check out whether there would be areas that you find of particular interest. We are very open to suggestions regarding the subject of your particular task.
Did we say we are excited? Oh yes, we are. And we’re looking forward to see you soon!
Best wishes, and see you on Wednesday,
Andreas Zeller + Rahul Gopinath
|
Comparing Fuzzing Techniques
In this seminar, we evaluate automated test generation techniques (fuzzers) for their effectiveness and efficiency. We discuss and design evaluation criteria and apply them on a number of techniques from the book "Generating Software Tests" (https://www.fuzzingbook.org). Apart from reporting and presenting your results in the seminar, your evaluation results will be included in the book. If the results or techniques are novel (many of them are), we will also strive to publish them as a scientific paper, with you as co-author.
Group phase:
* Introduction to empirical techniques (all)
* Designing benchmarks (all)
* Defining common evaluation questions (all)
* Presenting empirical results (all)
Individual phase:
* Selecting an individual fuzzing technique for evaluation
* Defining individual evaluation questions and parameters
* Conducting the evaluation
* Producing an evaluation report
* Presenting and discussing evaluation results
The fuzzers are implemented in Python and come as Jupyter Notebooks. You will also use Jupyter Notebooks for conducting the evaluation and presenting the final results, both as report and as presentation.
Requirements: You should have passed the lecture "Generating Software Tests" or have sufficient knowledge from the course.
Knowledge of Python and experience with Jupyter Notebooks is helpful, but can be acquired during the seminar.