| ASQA: Factoid questions meet long-form answers I Stelmakh, Y Luan, B Dhingra, MW Chang arXiv preprint arXiv:2204.06092, 2022 | 120 | 2022 |
| PeerReview4All: Fair and accurate reviewer assignment in peer review I Stelmakh, NB Shah, A Singh Algorithmic Learning Theory, 828-856, 2019 | 114 | 2019 |
| On testing for biases in peer review I Stelmakh, N Shah, A Singh Advances in Neural Information Processing Systems 32, 2019 | 56 | 2019 |
| A novice-reviewer experiment to address scarcity of qualified reviewers in large conferences I Stelmakh, NB Shah, A Singh, H Daumé III Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4785-4793, 2021 | 38 | 2021 |
| Prior and prejudice: The novice reviewers' bias against resubmissions in conference peer review I Stelmakh, NB Shah, A Singh, H Daumé III Proceedings of the ACM on Human-Computer Interaction 5 (CSCW1), 1-17, 2021 | 38 | 2021 |
| Catch me if i can: Detecting strategic behaviour in peer assessment I Stelmakh, NB Shah, A Singh Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4794-4802, 2021 | 37 | 2021 |
| Crowdspeech and voxdiy: Benchmark datasets for crowdsourced audio transcription N Pavlichenko, I Stelmakh, D Ustalov arXiv preprint arXiv:2107.01091, 2021 | 31 | 2021 |
| A large scale randomized controlled trial on herding in peer-review discussions I Stelmakh, C Rastogi, NB Shah, A Singh, H Daumé III Plos one 18 (7), e0287443, 2023 | 28 | 2023 |
| Debiasing evaluations that are biased by evaluations J Wang, I Stelmakh, Y Wei, NB Shah Proceedings of the AAAI Conference on Artificial Intelligence 35 (11), 10120 …, 2021 | 23 | 2021 |
| A gold standard dataset for the reviewer assignment problem I Stelmakh, J Wieting, G Neubig, NB Shah arXiv preprint arXiv:2303.16750, 2023 | 14 | 2023 |
| To ArXiv or not to ArXiv: A study quantifying pros and cons of posting preprints online C Rastogi, I Stelmakh, X Shen, M Meila, F Echenique, S Chawla, ... arXiv preprint arXiv:2203.17259, 2022 | 13 | 2022 |
| Cite-seeing and reviewing: A study on citation bias in peer review I Stelmakh, C Rastogi, R Liu, S Chawla, F Echenique, NB Shah Plos one 18 (7), e0283980, 2023 | 12 | 2023 |
| How do authors’ perceptions of their papers compare with co-authors’ perceptions and peer-review decisions? C Rastogi, I Stelmakh, A Beygelzimer, YN Dauphin, P Liang, ... Plos one 19 (4), e0300710, 2024 | 10 | 2024 |
| Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments A Goldberg, I Stelmakh, K Cho, A Oh, A Agarwal, D Belgrave, NB Shah arXiv preprint arXiv:2311.09497, 2023 | 8 | 2023 |
| A Randomized Controlled Trial on Anonymizing Reviewers to Each Other in Peer Review Discussions C Rastogi, X Song, Z Jin, I Stelmakh, H Daumé III, K Zhang, NB Shah arXiv preprint arXiv:2403.01015, 2024 | 5 | 2024 |
| Towards fair, equitable, and efficient peer review I Stelmakh Proceedings of the AAAI Conference on Artificial Intelligence 35 (18), 15736 …, 2021 | 5 | 2021 |
| VLDB 2021 Crowd Science Challenge on Aggregating Crowdsourced Audio Transcriptions. D Ustalov, N Pavlichenko, I Stelmakh, D Kuznetsov CSW@ VLDB, 1-7, 2021 | 3 | 2021 |
| No Rose for MLE: Inadmissibility of MLE for Evaluation Aggregation Under Levels of Expertise C Rastogi, I Stelmakh, N Shah, S Balakrishnan 2022 IEEE International Symposium on Information Theory (ISIT), 3168-3173, 2022 | 2 | 2022 |
| Causal Effect of Group Diversity on Redundancy and Coverage in Peer-Reviewing N Goyal, I Stelmakh, N Shah, H Daumé III arXiv preprint arXiv:2411.11437, 2024 | | 2024 |
| Debiasing Evaluations That Are Biased by Evaluations J Wang, I Stelmakh, Y Wei, N Shah Journal of Machine Learning Research 25 (315), 1-120, 2024 | | 2024 |
Nihar B. ShahML and CS departments, Carnegie Mellon University確認したメール アドレス: cs.cmu.edu
