Comment 061

next comment

Tags: * reviewer performance: track how much authors review * use same scale for meta/reviews * put resources into TACL

"I think it would be useful to know the recent stats on n.papers submitted during a 12 month period, 
how many unique authors are involved, and how many reviews each person needs to do per year for a fair 
distribution? If the infrastructure could support it, you could then track whether authors are contributing 
in a fair way over a 2 or 3 year period to the reviewing system they are adding load to. There's still 
a reference to ACL venue in the meta reviewer rubric -- score 1 makes a judgement whether a paper will 
ever be publishable at an ACL venue. Also the fact that reviewers and meta reviewers operate on different 
scales is confusing to authors. I think if resources are put into rolling review, they should be put 
into TACL too."