Two comparison tables showing J E L code assignments for economics articles by category across multiple methods.Top table (a): It has 15 rows and 8 columns, with rows 1 to 3 representing column headers. In row 1, columns 2 to 6 are merged for the header “Assigned J E L codes”, and columns 1, 7, and 9 are blank. In row 2, columns 1 and 2 are blank, and columns 3 to 8 are merged for the header “Based on abstract only”. In row 3, the column headers from left to right are “Article published in American Economic Review Volume 114 Issue 4 (April 2024)”, “Peer-reviewed American Economic Review publication, website”, “Chat G P T 3.5”, “Chat G P T 4”, “Copilot”, “Gemini”, “Average overlap with the final J E L categories”, and “Average difference in the number of J E L categories”. The data from the rows are as follows: Row 4: Column 1: Angelucci, Charles, and Andrea Prat. “Is Journalistic Truth Dead? Measuring How Informed Voters Are about Political News”; Column 2: D, L; Column 3: D (50 percent, negative 1); Column 4: D, Z (50 percent, 0); Column 5: D, Z, C (33.33 percent, positive 1); Column 6: Primary: D, Secondary: A, D (50 percent, 0); Column 7: 45.83 percent; Column 8: 0.00. Row 5: Column 1: Engelmann, Jan B., Maël Lebreton, Nahuel A. Salem-Garcia, Peter Schwardmann, and Joël J. van der Weele. “Anticipatory Anxiety and Wishful Thinking”; Column 2: C, D; Column 3: D, C (100 percent, 0); Column 4: C, D (100 percent, 0); Column 5: C, D (100 percent, 0); Column 6: Primary: D, Secondary: C, D (100 percent, 0); Column 7: 100.00 percent; Column 8: 0.00. Row 6: Column 1: Exley, Christine L., and Judd B. Kessler. “Motivated Errors”; Column 2: C, D; Column 3: D, C (100 percent, 0); Column 4: C, D (100 percent, 0); Column 5: C, D (100 percent, 0); Column 6: Primary: D, Secondary: C, D (100 percent, 0); Column 7: 100.00 percent; Column 8: 0.00. Row 7: Column 1: Grossman, Gene M., Elhanan Helpman, and Stephen J. Redding. “When Tariffs Disrupt Global Supply Chains”; Column 2: D, F, L, O, P; Column 3: F, L, D (60 percent, negative 2); Column 4: F, L, C (40 percent, negative 2); Column 5: F (20 percent, negative 4); Column 6: Primary: F, Secondary: D, L, O (80 percent, negative 1); Column 7: 50.00 percent; Column 8: negative 2.25. Row 8: Column 1: Baum-Snow, Nathaniel, Nicolas Gendron-Carrier, and Ronni Pavan. “Local Productivity Spillovers”; Column 2: D, G, L, R; Column 3: D, R (50 percent, negative 2); Column 4: R, L, D (75 percent, negative 1); Column 5: D, G, L (75 percent, negative 1); Column 6: Primary: R, Secondary: C, O (25 percent, negative 1); Column 7: 56.25 percent; Column 8: negative 1.25. Row 9: Column 1: Greenberg, Kyle, Parag A. Pathak, and Tayfun Sönmez. “Redesigning the US Army’s Branching Process: A Case Study in Minimalist Market Design”; Column 2: D, H, J; Column 3: D, H (66.67 percent, negative 1); Column 4: D, M, J, C (50 percent, positive 1); Column 5: D (33.33 percent, negative 2); Column 6: Primary: D, Secondary: D, J (66.67 percent, negative 1); Column 7: 54.17 percent; Column 8: negative 0.75. Row 10: Column 1: Cheremukhin, Anton, Mikhail Golosov, Sergei Guriev, and Aleh Tsyvinski. “The Political Development Cycle: The Right and the Left in People’s Republic of China from 1953”; Column 2: D, N, O, P; Column 3: O, P (50 percent, negative 2); Column 4: O, P, Q (50 percent, negative 1); Column 5: D, N, O, P (100 percent, 0); Column 6: Primary: O, Secondary: N, P (75 percent, negative 1); Column 7: 68.75 percent; Column 8: negative 1.00. Row 11: Column 1: Martínez-Marquina, Alejandro, and Mike Shi. “The Opportunity Cost of Debt Aversion”; Column 2: C, D, G; Column 3: D, G (66.67 percent, negative 1); Column 4: D, G (66.67 percent, negative 1); Column 5: C, D, G (100 percent, 0); Column 6: Primary: G, Secondary: D (66.67 percent, negative 1); Column 7: 75.00 percent; Column 8: negative 0.75. Row 12: Column 1: Alan, Sule, and Ipek Mumcu. “Nurturing Childhood Curiosity to Enhance Learning: Evidence from a Randomized Pedagogical Intervention”; Column 2: D, I, J, O; Column 3: I, O (50 percent, negative 2); Column 4: I, D, C (50 percent, negative 1); Column 5: D, I (50 percent, negative 2); Column 6: Primary: I, Secondary: O, C (50 percent, negative 1); Column 7: 50.00 percent; Column 8: negative 1.50. Row 13: Column 1: Average number of J E L categories; Column 2: 3.222; Column 3: 2.000; Column 4: 2.667; Column 5: 2.333; Column 6: 2.556; Column 7: Blank; Column 8: Blank. Row 14: Column 1: Average overlap with the final J E L categories; Column 2: Blank; Column 3: 65.93 percent; Column 4: 64.63 percent; Column 5: 67.96 percent; Column 6: 68.15 percent; Column 7: Blank; Column 8: Blank. Row 15: Column 1: Average difference in the number of J E L categories; Column 2: Blank; Column 3: negative 1.222; Column 4: negative 0.556; Column 5: negative 0.889; Column 6: negative 0.667; Column 7: Blank; Column 8: Blank. Bottom table (b): It has 15 rows and 5 columns, with rows 1 to 3 representing column headers. In row 1, columns 2 to 5 are merged for the header “Assigned J E L codes”, and column 1 is blank. In row 2, columns 1 to 3 are blank, and columns 4 and 5 are merged for the header “Based on whole article”. In row 3, the column headers from left to right are “Article published in American Economic Review Volume 114 Issue 4 (April 2024)”, “Working paper (presumably chosen by authors)”. “Peer-reviewed American Economic Review publication, website”, “Chat G P T 4, working paper”, and “Chat G P T 4, final article”. The data from the rows are as follows: Row 4: Column 1: Angelucci, Charles, and Andrea Prat. “Is Journalistic Truth Dead? Measuring How Informed Voters Are about Political News”; Column 2: L, D (100 percent, 0); Column 3: D, L; Column 4: D, L (100 percent, 0); Column 5: D, L (100 percent, 0). Row 5: Column 1: Engelmann, Jan B., Maël Lebreton, Nahuel A. Salem-Garcia, Peter Schwardmann, and Joël J. van der Weele. “Anticipatory Anxiety and Wishful Thinking”; Column 2: C, D (100 percent, 0); Column 3: C, D; Column 4: D, C (100 percent, 0); Column 5: C, D (100 percent, 0). Row 6: Column 1: Exley, Christine L., and Judd B. Kessler. “Motivated Errors”; Column 2: C, D (100 percent, 0); Column 3: C, D; Column 4: D, C (100 percent, 0); Column 5: D (50 percent, negative 1). Row 7: Column 1: Grossman, Gene M., Elhanan Helpman, and Stephen J. Redding. “When Tariffs Disrupt Global Supply Chains”; Column 2: F (20 percent, negative 4); Column 3: D, F, L, O, P; Column 4: F, D (40 percent, negative 3); Column 5: F, D (50 percent, negative 3). Row 8: Column 1: Baum-Snow, Nathaniel, Nicolas Gendron-Carrier, and Ronni Pavan. “Local Productivity Spillovers”; Column 2: Blank; Column 3: D, G, L, R; Column 4: R, D, C (50 percent, negative 1); Column 5: D, R (50 percent, negative 2). Row 9: Column 1: Greenberg, Kyle, Parag A. Pathak, and Tayfun Sönmez. “Redesigning the US Army’s Branching Process: A Case Study in Minimalist Market Design”; Column 2: D (33.33 percent, negative 2); Column 3: D, H, J; Column 4: C, D, J (66.67 percent, 0); Column 5: D, H, J (100 percent, 0). Row 10: Column 1: Cheremukhin, Anton, Mikhail Golosov, Sergei Guriev, and Aleh Tsyvinski. “The Political Development Cycle: The Right and the Left in People’s Republic of China from 1953”; Column 2: Blank; Column 3: D, N, O, P; Column 4: O, P, N (75 percent, negative 1); Column 5: D, N, O, P (100 percent, 0). Row 11: Column 1: Martínez-Marquina, Alejandro, and Mike Shi. “The Opportunity Cost of Debt Aversion”; Column 2: C, D (66.67 percent, negative 1); Column 3: C, D, G; Column 4: C, D (66.67 percent, negative 1); Column 5: C, D (66.67 percent, negative 1). Row 12: Column 1: Alan, Sule, and Ipek Mumcu. “Nurturing Childhood Curiosity to Enhance Learning: Evidence from a Randomized Pedagogical Intervention”; Column 2: N A, N A; Column 3: D, I, J, O; Column 4: I, C (25 percent, negative 2); Column 5: I, D, J (75 percent, negative 1). Row 13: Column 1: Average number of J E L categories; Column 2: 1.667; Column 3: 3.222; Column 4: 2.333; Column 5: 2.333. Row 14: Column 1: Average overlap with the final J E L categories; Column 2: 70.00 percent; Column 3: Blank; Column 4: 69.26 percent; Column 5: 76.85 percent. Row 15: Column 1: Average difference in the number of J E L categories; Column 2: negative 1.667; Column 3: Blank; Column 4: negative 0.889; Column 5: negative 0.889. Below the tables, a note reads, “The listed articles appeared in the April 2024 issue (Vol. 114 No. 4) of the American Economic Review which was the current issue as of April 2024, available at: h t t p s colon: slash slash w w w dot a e a w e b dot o r g slash issues slash 775. The first number in parentheses under assigned J E L categories is the overlap with the final J E L codes and the second number is the difference in the number of assigned J E L categories compared to the final ones. Used A I systems: Chat G P T, h t t p s colon: slash slash chat dot open a i dot com slash; Copilot, copilot dot microsoft dot com; Gemini, h t t p s colon: slash slash gemini dot google dot com slash. Data (incl. information about selected working papers) and full responses of A I systems are available in the Appendix slash Supplementary Material”. |
