File Name: refguidelines_tepe.pdf
File Size: 97.58 KB
File Type: Application/pdf
Last Modified: 3 years
Status: Available
Last checked: 23 hours ago!
This Document Has Been Certified by a Professional
100% customizable
Language: English
We recommend downloading this file onto your computer
TEPE Spring 2019 TF: Andrea Passalacqua Guidelines to Write a Referee Report11 StructureThe most useful structure for a referee report is to order information from most important to leastimportant, as is the case with most technical writing. The aim is not to build to a conclusion, butto start with the conclusion, and then justify it with increasing granularity. In other words, give therecommendation, signpost your reasoning in the introduction, justify each individual argument in themain analysis, keep the minor suggestions to the end. Given that, the structure of the Referee Reportshould be the following: • Recommendation • Critical review of the paper • Analysis - Main Body of the Comments • Minor Comments1.1 Recommendation (10 words):Start with the conclusion. Are you recommending a revise and resubmit, rejection or acceptance? To helpwith context, there are around 6-7 times as many papers that will be recommended “revise and resubmit”as those which are “accepted”. In the context of an assignment, it’s probably better to say “revise andresubmit”, since it’s going to be very hard to hit 1200 words of doting praise upon the author
1.2 Critical review of the paper (300-500 words):Make an argument for whether the paper’s contribution to this literature is significant, in your opinion
The point is not to just summarize the paper - summarizing is easy, and well below the expertise of thereferee. The editor spent ten minutes skimming the paper before they sent it to you, so they alreadyhave a fairly good idea of what the author aims to do and how they executed this aim. It’s your job todetermine what they did which is of additional worth to the literature which already exists. You can startby summarize the outline of the paper in your own words. This will help you to understand the natureof the author’s contribution better. In the process you may discover whether you agree or not with theauthor’s view about specific aspect of the paper and want to recommend highlighting the significanceof a particular assumption or providing a different interpretation of the findings. Again, the goal is notmerely summarize the paper but highlight the main contribution of it. This is critical to eventually judgewhether the paper makes important contributions in the field and thus it is worth publishing it.Is theircontribution a theoretical model that is useful for understanding, a modelling toolkit that will be usefulto other authors, a new empirical strategy, a new dataset, a clever identification, or is it establishing itsown literature? In discussing the contribution, you will invariably end up providing some summary, butthe aim should always be to elucidate the contribution, not to retell
If you were asked to be a referee in the field, it is because you are an expert in the literature as itstands, and well placed to evaluate exactly what the contribution of the paper has been. Unless you getvery lucky, this probably won’t be true this time. You don’t have to try to become one - just take whatthe author wrote in the literature review as a fair representation of the status quo, and write it on thatbasis
1 These notes are inspired by material taught in EC2727 Empirical Methods in Financial Economics 1 TEPE Spring 2019 TF: Andrea Passalacqua For the sake of clarity, you can repeat specific equations or results - refer to the key intermediateequations or results of the theoretical model by restating them, write out the regression equation andwhich parameters were important to estimate, mention the most important table/empirical result
Towards the end of this section you can signpost what you will discuss in your analysis - what particularcontribution you find novel, or what you consider to be a key limitation and how it could be improved
1.3 Analysis (700-1000 words)Be specific about the strengths and weaknesses in the paper’s execution. This is the point to go into greatdetail with your concerns and comments. Since the author has spent a great deal more time than youthinking about the topic, they will probably only be convinced by a very incisive point
If it is a theory paper, start by listing all the assumptions (implied and otherwise) that you believewere necessary for the key results, and evaluate their plausibility and their importance. Does violating orgeneralizing the assumptions reverse their key result completely, or simply make the math more unwieldy? If it is an empirical paper, think carefully about the implied assumptions that lie behind every regres-sion being a valid test of causality, for the data sample itself (internal validity). Then think about whetherthis regression over the dataset itself answers the question for the world at large (external validity). Youshould be biased to giving comments that contain a suggestion for improvement, which in general meansyou’ll speak more about internal validity than external validity. You should think about the techniquesused. Are the results correct as stated? Could they be strengthened? Notwithstanding, do not succumb to the temptation to ask for additional extensions or robustnesschecks merely because you can. You should justify any extension or robustness check with at least aparagraph explaining why you would expect the results to change, the direction in which you believe theywould change, and what this would mean for the paper at large if it did. It is much better to ask forone or two robustness checks or extensions which are well justified than to ask for six or seven with glibreasons
You may want to divide your requests for revisions into two parts
• Some requests for changes are nonnegotiable: the model should be coherent; there should be no errors in the proof; proper credit should be given to previous contributors. The structure of the paper should be clear and its language should be free of unnecessary technical jargon
• Other suggestions for change are simply ideas for the author to think about. You leave them to the discretion of the author. You believe that they would improve the paper, but you also see why the author may disagree - they may give a different flavor to the results. Moreover certain features of the paper may not be to your taste and yet be quite legitimate. In these cases you can only suggest changes and try to convince the author of your reasons for wanting them. You cannot insist on them. These may include the style in which the paper is written - but you cannot force your own style on the author1.4 Minor Comments (0-200 words)Obvious mistakes the author made which they haven’t spotted. Have they used the wrong notation insome section, or have they explained a point in a way which does not make sense? Is there an error in aproof that doesn’t invalidate the paper, but needs correcting? Should a graph be presented in a differentway for clarity (e.g. a panel barplot switched to a time series line plot)? 2 TEPE Spring 2019 TF: Andrea Passalacqua2 Simple FAQs • Suggested length: 1200-1500 words • You do not need to include a cover sheet, or any of the formalities that would ordinarily accompany a referee report being sent to the journal
3 Benefits to You of Your Refereeing WorkTake your refereeing jobs seriously. It helps you to keep up with the literature. Next to presenting apaper in a class, there is nothing like refereeing it to become really familiar with it. This in-depth workwill be very useful to your own research
ReferencesEc2727 guidelines to write a referee report. 2017
Varanya Chaubey. The Little Book of Research Writing. CreateSpace Independent Publishing Platform, 2018
Daniel S Hamermesh. The young economist’s guide to professional etiquette. Journal of Economic Perspectives, 6(1):169–179, 1992
Daniel S Hamermesh. Facts and myths about refereeing. Journal of Economic Perspectives, 8(1):153–163, 1994
Donald McCloskey. Economical writing. Economic Inquiry, 23(2):187–222, 1985
William Thomson. A guide for the young economist. MIT press, 2001
Recommendation, signpost your reasoning in the introduction, justify each individual argument in the main analysis, keep the minor suggestions to the end. Given that, the structure of the …
How to cite a report in Harvard To cite a report in a reference entry in Harvard style include the following elements: Author or organization: Give the last name and initials (e. g. Watson, J.) of up to three authors with the last name preceded by 'and'.
Here is the basic format for a reference list entry of a report in Harvard style: Author or organization. ( Year of publication) Title of the report. Place of publication: Publisher. Take a look at our reference list examples that demonstrate the Harvard style guidelines in action:
Another cause for concern is the level of disagreement amongst referees, a pattern that suggests a high level of arbitrariness in the review process.
Here are several Harvarvard referencing rules for other source types: Refer to an edited book by putting ‘ (ed.)’ or ‘ (eds)’ after the editor name (s) If a book was translated, add ‘trans. I Lastname’ Refer to an article in any book or journal by adding an article name in quotation marks but not italicized