Selected Topics in Specification and Testing Dominic Steinhöfel + Andreas Zeller

News

03.05.2021

Presenters for May 17th and 31st -- One slot still free!

Dear all,

we already have three presenters for the aforementioned seminar sessions:

May 17th: Rutuja
May 31st: Johannes (QuickSpec) and Kevin (Summaries for String Loops).

Although we only have one paper for May 17th, we still need a second presenter! I... Read more

Dear all,

we already have three presenters for the aforementioned seminar sessions:

May 17th: Rutuja
May 31st: Johannes (QuickSpec) and Kevin (Summaries for String Loops).

Although we only have one paper for May 17th, we still need a second presenter! I apologize for not having mentioned this during the session just now.

If you would like to volunteer for May 17th, please write me an e-mail. Although I have mixed feelings about first-come-first-serve, I think it's acceptable for this occasion (and we've anyway already been practicing this throughout the seminar) ;) However, I will prefer volunteers not having presented so far. Remember that after the seminar, everybody needs to have given two short presentations.

Best Regards,
Dominic

03.05.2021

Papers for Seminar Sessions at May 17th and 31st

Dear all,

the papers for our sessions at May 17th and 31st are already set. Please note that May 24th is a public holiday, and our seminar consequently will not take place that week. This means that you have more time for reading and summarizing the two papers... Read more

Dear all,

the papers for our sessions at May 17th and 31st are already set. Please note that May 24th is a public holiday, and our seminar consequently will not take place that week. This means that you have more time for reading and summarizing the two papers for May 31st. I would recommend you to use that time, since one of the papers we'll discuss that week is quite lengthy (though not particularly dense).

The paper for May 17th is "Your Proof Fails? Testing Helps to Find the Reason" by Petiot et al. It is about the interesting use case of testing specifications that were not meant to be tested, but have been written for formal (deductive) verification. The authors propose a testing methodology that helps debugging failed proof attempts.

This concludes the first part of the seminar about testing specifications. Next, we will have a look at how to derive them.

The papers for May 31st are "Quick Specifications for the Busy Programmer" by Smallbone et al., and "Computing Summaries of String Loops in C for Better Testing and Refactoring" by Kapus et al. Both discover equational specifications, however using very different methodologies and for different use cases. The QuickSpec paper is a long journal paper, but quite easy to read and not very dense, while the paper about string loops is written in two-column layout and is somewhat more formal in my opinion. Due to the public holiday, you have one additional week for preparing the summaries for these papers.

Please submit your summaries before the day the respective seminar session takes place. Submission does not close before 10:00 AM at the day of the seminar, but this is only meant to counteract technical problems etc. Personally, I'd suggest you already submit the Fridays before, then you have a free weekend!

I have already uploaded all papers to the materials section and also updated the seminar program page.

Best Regards,
Dominic

28.04.2021

Please register in LSF for the Seminar before May 10

Dear all,

The CS examination office tells us that all students are asked to register for the exams for the summer semester 2021. For (pro)seminars, registration or cancellation is possible up to three weeks after the topic assignment or kick-off meeting. In our... Read more

Dear all,

The CS examination office tells us that all students are asked to register for the exams for the summer semester 2021. For (pro)seminars, registration or cancellation is possible up to three weeks after the topic assignment or kick-off meeting. In our case, this was April 19, 2021, which means that you have to register in LSF by May 10 at the latest.

In case of problems wih the exam registration, students of the MI faculty should contact: studium@cs.uni-saarland.de. Other students have to contact their examination office.

If you are not a student of Computer Science or Cybersecurity, please read on:

These students are not able to register in HISPOS:

  • Wirtschaftsinformatiker (Business Informatics)
  • VSIMint
  • Master IT und Recht
  • Bachelor-Plus MINT
  • Erasmusstudents
  • guest students

Currently the following students of the Computer Science department cannot register in HISPOS:

  • Bachelor of Computer Science, StO 2020
  • Bachelor Cyber Security, StO 2020
  • Bachelor Media Informatics, StO 2020
  • Master Media Informatics, StO 2020
  • Bachelor Mathematics and Computer Science, StO 2020
  • Teacher of computer science, StO 2020

If you fall into any of these categories, let us know, and we will forward your names and grades to the examination office after the seminar. We hope that the courses will be implemented in HISPOS by the start of the exam period and that exam registration will be possible then.

All the best,

Andreas Zeller

26.04.2021

Slides for "How to give a good research talk" now available...

... at https://dl.cispa.de/s/q9EfYZ5AqMrmSc7. Enjoy!

Andreas Zeller

19.04.2021

Papers for 4th Seminar Session at May 3rd

Dear all,

in our fourth seminar session (the second "regular" one) which takes place at May 3rd, 4:00 PM, we will again focus on property-based testing. This time, two papers will be discussed, which both propose approaches to steer random input generation for... Read more

Dear all,

in our fourth seminar session (the second "regular" one) which takes place at May 3rd, 4:00 PM, we will again focus on property-based testing. This time, two papers will be discussed, which both propose approaches to steer random input generation for property-based testing into the right directions.

The titles of these papers, which you find in the "Materials" section, are "Semantic Fuzzing with Zest" and "Coverage Guided, Property Based Testing".

This means that for May 3rd, you will have to submit two abstracts, and we will have two short talks on different papers (in contrast to our April 26th session, where we'll have two talks on the same paper). Please submit your abstracts before May 3rd.

We already have two volunteers for the short talks, which are Hannah and Florian.

Best Regards,
Dominic

15.04.2021

Presenters for April 26th

Hi everybody,

Johannes and Divesh were the first two volunteers for giving short presentations on QuickCheck during our April 26th seminar session. Looking forward to their 5-minute talks!

Brief reminder: We expect short summaries on QuickCheck by everybody,... Read more

Hi everybody,

Johannes and Divesh were the first two volunteers for giving short presentations on QuickCheck during our April 26th seminar session. Looking forward to their 5-minute talks!

Brief reminder: We expect short summaries on QuickCheck by everybody, not only Johannes and Divesh.

Best Regards,
Dominic

13.04.2021

Forum

Hi again,

of course, I found out how to create a forum directly after having told you that I don't know how to do it. You should fine a "Forum" link in the navigation bar for this course. Feel free to use the forum for any questions that in your opinion might be... Read more

Hi again,

of course, I found out how to create a forum directly after having told you that I don't know how to do it. You should fine a "Forum" link in the navigation bar for this course. Feel free to use the forum for any questions that in your opinion might be interesting also for the other participants. Otherwise, please write an e-mail to Andreas or myself.

Best Regards,
Dominic

13.04.2021

2nd & 3rd Seminar Sessions: Talk by Andreas / QuickCheck (2021/04/19 + 2021/04/26)

Hi all,

as discussed in our meeting today, our seminar will from now on regularly take place on Monday at 4:00 PM. The Zoom link will stay the same as for today's meeting.

Next week (April 19th), Andreas will give a talk on how to give a talk, so we start a... Read more

Hi all,

as discussed in our meeting today, our seminar will from now on regularly take place on Monday at 4:00 PM. The Zoom link will stay the same as for today's meeting.

Next week (April 19th), Andreas will give a talk on how to give a talk, so we start a little meta ;)

The week after, at April 26th, we will have our first "regular" seminar session. The topic of that session is Property-Based Testing, in particular the QuickCheck approach. I have already uploaded the paper, you should be able to access it in the materials section. If there are any problems with that, please let me know. Additionally, I added a link to the Fuzzing Book chapter about specification mining, and to the documentation of hypothesis, a package for quick checking python programs. I encourage you to have look at this chapter and to try out hypothesis, it's worth it!

We would like to ask each of you to provide a short abstract / summary of this paper until before Monday 26th. The length of the summary should be about half a page, and be no longer than one page (using some reasonable font settings). Please upload your summary using the CISPA CMS page as a PDF or text file; I just created a corresponding submission slot. If you are facing any problems with this, please also let me know.

So far, we have not chosen the two presenters for the April 26th session. If there are any volunteers, please send me a mail. The two quickest volunteers get the job. In case I don't receive at least two mails, you will get the chance to volunteer during our next session at April 19th. And yes, these will be two presentations on the very same paper ;) Each of these should take five minutes. As a reminder: Neither the summaries nor the short presentations will be graded! Notwithstanding, you should summarize papers for at least 8 out of 10 sessions, and give two short presentations.

If you have any other questions, concerns or ideas, just drop me a mail! I couldn't find a way to create some kind of forum within the CISPA CMS so far, so mails are the preferred way to communicate in between the seminar sessions, at least for now.

Apart from that, I'm very much looking forward to an interesting seminar!

Best Regards,
Dominic

12.04.2021

Kickoff Meeting on Tuesday, April 13, 17:00

Welcome to the seminar on "Selected Topics in Specification and Testing”! We’re happy you’re with us, and we look forward to an exciting and inspiring seminar.

We have a kick-off meeting on Tuesday, April 13, 17:00in which we will discuss details of the... Read more

Welcome to the seminar on "Selected Topics in Specification and Testing”! We’re happy you’re with us, and we look forward to an exciting and inspiring seminar.

We have a kick-off meeting on Tuesday, April 13, 17:00in which we will discuss details of the seminar. This will also likely be the recurrent meeting time of the seminar, so try to keep this space free of other events. Details of the meeting are sent to you by mail.

Looking forward to see you, and best wishes,

Dominic + Andreas

Show all
 

Selected Topics in Specification and Testing

Description: Wouldn't it be cool if one could teach computers to test and validate programs as thorough as never before? In this seminar, we will discuss current results and new problems bringing together the domains of _program specification_ and _automated testing_ based on relevant scientific papers. We will build on some of the techniques available in the Fuzzing Book (https://www.fuzzingbook.org), and discuss recent advances.

The general process will be as follows: Each week, you get 1-2 reading assignments and write an abstract about them. You may also be asked to give an (ungraded) five-minute mini presentation to kick off the discussion and improve your presentation skills. At the end of the seminar, you give a 15-20 minute presentation on one of the techniques, preferably including small experiments or demonstrations on how well they work; these will then be graded.

Requirements: Prior knowledge in formal methods and automated testing will be beneficial. For experiments and evaluations, programming knowledge will be helpful, too. We recommend doing experiments and evaluations in Jupyter Notebooks – so don't be afraid of them.

Useful (Internal) Links



Privacy Policy | Legal Notice
If you encounter technical problems, please contact the administrators