fse-review-process

FSE Review Process

Model the pipeline before interpreting any single review. FSE's process is journal-style: papers are PACMSE articles, and Major Revision is a first-class decision, not a soft rejection. The most consequential mental shift for authors arriving from a plain accept/reject conference is that a Major Revision is a genuine revise-and-resubmit round with the same reviewers, closer to a journal R&R than to a rebuttal.

Process model

• Submission and review run on HotCRP with heavy double-anonymity: identities are hidden through all reviewing and discussion, and any Major Revision response must itself be anonymous.
• Each paper is read by at least three program-committee members (FSE 2027 call), who weigh the significance of the SE contribution, soundness of the method, quality and honesty of the empirical evidence, threats-to-validity reasoning, clarity, and open-science support.
• First decisions fall into Accept, Major Revision, or Reject. A Major Revision is re-reviewed — generally by the original reviewers — against the revision and its response letter.
• Accepted papers publish in PACMSE, so final metadata, camera-ready compliance, and artifact follow-through matter as much as the initial verdict.

Reading a decision against the categories

The strategic reading: write the initial submission so that whatever is weakest is revisable in a revision round (an analysis you can add, a threat you can bound) rather than structural (a study design you cannot redo in weeks). The process is built to reward repairable papers.

How FSE differs from its siblings

• vs. ICSE: ICSE has run its own cycle structure (a two-cycle model in some years, single in others) with an Accept/Major-Revision/Reject flavor too, but on the IEEE side. FSE's identity is the PACMSE journal framing and the SIGSOFT open-science defaults. Never assume the two share a calendar or template.
• vs. ISSTA: ISSTA has used multi-round reviewing within a cycle; FSE's revise-and-resubmit is a decision-driven round (you revise because you were told to), not a scheduled second read of every paper.
• vs. the FSE 2024 dual-deadline year: FSE once let a Major Revision resubmit to a later deadline within the same review year. Recent calls advertise a single annual deadline with the revision round inside it — confirm the current cadence rather than carrying either forward.

Who reads you

Expect three SE-empiricist reviewers. They look for the threats-to-validity section, check whether claims outrun evidence, ask whether subjects and baselines are real and fair, and often open the artifact. Because FSE spans techniques, empirical studies, and human factors, a paper is usually matched to reviewers from its own subarea — vague method descriptions get caught, not skimmed.

Where author leverage actually exists

[Before submission]  topic tags -> reviewer pool           (largest lever)
[Initial reviews]    factual corrections, targeted evidence, clarifying misreadings
[Major Revision]     the strongest lever: a tracked-change revision + point-by-point,
                     anonymous response letter re-read by the same reviewers
[After reject]       no appeal; reroute to a sibling flagship or an SE journal

A response moves borderline papers when it corrects a factual misreading or supplies a number a reviewer said was missing; it does not move papers when it argues taste. In a Major Revision, silent omissions — a requested change neither made nor explicitly declined with a reason — are what turn the second read into a rejection.

Reading a review packet

Weight reviews before answering. A review that cites your section numbers, tables, and threats was read closely and will be read closely again in the revision round — its author is your likely advocate if the response holds. A review that discusses only novelty has left soundness and verifiability to the others; answer each reviewer on the axis they raised. Reviewers often end with an explicit question list; the revision is scored heavily on whether each question got a direct, evidenced answer.

Misreadings to avoid

• Treating Major Revision as a guaranteed accept — the second read is real; budget the revision window like a deadline.
• Treating the response as a debate — the PC discussion decides; your text is evidence for an advocate, not a closing argument.
• Assuming unanimity is required — a champion with answers to the other reviews can carry a paper through the discussion.
• Projecting last year's cadence — deadline count and revision timing are decided per edition.

Output format

[Process stage] pre-submission / awaiting reviews / major revision / final / accepted
[Decision category] accept / major revision / reject, with the criterion driving it
[Criterion map] each review point -> significance | soundness | evidence | threats | clarity | open-science
[Leverage plan] the next-stage action that can actually change the outcome
[Forbidden moves] identity leak (incl. in the response letter) / unsupported new claims