Summary of Review Instructions

1. Review to provide Advice and Guidance.

Reviewers will be asked to fill in a questionnaire prepared by the editorial board to provide better feedback to both the authors and the editorial board.

2. Review Constructively

Aim for detailed reviews, based on facts, ask for specific experiments, refer to specific related work, use professional language, report diversity and inclusion issues with regards to examples & writing

3. Novelty is not just radically new solutions but also new problems, implementations, & evaluations

4. Avoid

referring to simplicity of solution, short reviews based on personal (non technical) opinions, referring to a “quality bar”, rejecting a paper due to lack of time to make revisions, impolite language

5. Please be responsive

during Review Quality Week & Discussion Phase

Acknowledgements:
These instructions are adapted from ACM SIGMOD with contributions by Stratos Idreos and Divesh Srivastava, Arun Kumar and Avrilia Floratou, Sam Madden, Alexandra Meliou and Tim Kraska