Why Your Team Can't Write CHI Papers
<p><strong>How to Write CHI Papers with Jim Wallace - Episode Shownotes</strong></p><p><strong>Episode Overview</strong></p><p>Getting a paper into CHI (the top Human-Computer Interaction conference) is harder than ever. In this episode, Professor Jim Wallace from the University of Waterloo reveals the exact writing process, template, and mindset that gets papers accepted. We discuss the abstract-first method, the three-paragraph expansion technique, and why hard and fast iteration is the only way papers actually get written.</p><p><strong>Guest</strong></p><p><strong>Professor Jim Wallace</strong>Associate Professor, School of Public Health Sciences, University of Waterloo</p><p>Former CHI Associate Chair (Games and Play subcommittee)</p><p>CHI Science Jam organizer</p><p>Creator of the CHIzen LaTeX template</p><p><strong>Key Topics Covered</strong></p><p><strong>What Types of Papers Does CHI Want?</strong></p><p><strong>Harder to publish</strong>: Systems papers, bibliographical work, meta-reviews</p><p><strong>Growing trend</strong>: Reflective and meta papers about HCI research methods</p><p><strong>Exciting developments</strong>: Papers examining research practices, statistical methods, and theoretical foundations</p><p>The balance between artifact-driven research and methodological reflection</p><p><strong>The Abstract-First Writing Method</strong></p><p>Jim's recommended approach for writing CHI papers:</p><p><strong>Start with the abstract</strong></p><p>Address these key questions:</p><p></p><p>What problem are you solving?</p><p>What's your solution?</p><p>Who should care?</p><p>What are your contributions?</p><p><strong>Expand to introduction</strong></p><p>Turn each abstract sentence into a paragraph</p><p></p><p><strong>Develop related work</strong></p><p>Expand each paragraph into three paragraphs</p><p></p><p><strong>Iterate hard and fast</strong></p><p>Write, realize it needs work, revise, repeat</p><p></p><p><strong>The CHIzen Template</strong></p><p>Jim created a LaTeX/Overleaf template called <strong>CHIzen</strong> (meaning "continuous improvement") that includes:</p><p>Visualization wrappers and graphics tools</p><p>Transparency and best practices for sharing materials</p><p>Ethics materials templates</p><p>A comprehensive checklist for paper submission</p><p>Tips and tricks collected from working with many researchers</p><p><strong>Find it on GitHub</strong>: <a target="_blank" href="https://github.com/JimWallace/CHI-Zen">https://github.com/JimWallace/CHI-Zen</a></p><p><strong>CHI Paper Structure & Narrative</strong></p><p>CHI balances being both a <strong>scientific</strong> and <strong>design</strong> community</p><p>Unlike health sciences with rigid structure, CHI emphasizes <strong>storytelling and narrative</strong></p><p>Key framework: Problem → Solution → Who Cares?</p><p><strong>Persuasion is essential</strong></p><p>You must convince reviewers the problem is valuable</p><p><strong>Quality Criteria & Review Process</strong></p><p><strong>What reviewers look for:</strong></p><p><strong>Context</strong>: Is the problem valuable and well-positioned?</p><p><strong>Methods</strong>: Are methods appropriate and rigorously applied?</p><p><strong>Clarity</strong>: Is the writing clear and well-presented?</p><p><strong>The evolution of expectations:</strong></p><p>20 years ago: "The Wild West" - almost anything could be published</p><p>Today: Power analyses, rigorous methods, careful justification required</p><p>Risk: Expectation inflation may crush good ideas that aren't perfectly executed</p><p><strong>Being a Champion Reviewer</strong></p><p>Essential reading: <strong>Ken Hinckley's paper on being a champion</strong></p><p>Reviewers should champion good papers, not destroy them</p><p>Be constructive and focus on positives</p><p>Your job is to help papers succeed, not sink them</p><p>Students often think reviewers are out to destroy their work - this shouldn't be the mindset</p><p><strong>Advice for Junior Researchers</strong></p><p><strong>On writing your first paper:</strong></p><p>Pick a niche contribution - you can't please everyone</p><p>Small steps and iteration are essential</p><p>Learn from feedback from advisors and co-authors</p><p>Don't expect perfection on the first draft</p><p><strong>On reviewing papers:</strong></p><p>Get involved early to see behind the scenes</p><p>Be honest about what you don't know</p><p>It's okay to decline reviews for methods you haven't used</p><p>Focus on what you CAN comment on constructively</p><p><strong>On learning new methods:</strong></p><p>This is a career-long process, not something finished in a PhD</p><p>Be honest about expertise gaps</p><p>Reviewing helps calibrate your understanding</p><p><strong>Fairness in the Review Process</strong></p><p>Everyone in the process has the best intentions</p><p>Authors don't see all the work happening behind the scenes</p><p><strong>Consistency is a major challenge</strong></p><p>When is a power analysis required? For which methods?</p><p><strong>Revise and resubmit processes</strong> (like CHI Play, ISS, CSCW) are moving in the right direction</p><p>Second chances mean papers are only rejected for big, important reasons</p><p><strong>Current Trends & Future Directions</strong></p><p><strong>CHI Play's new rubric system</strong>: Separating methods expertise from domain expertise</p><p><strong>Revise and resubmit models</strong>: Gaining traction across HCI conferences</p><p><strong>Transparency and reproducibility</strong>: Growing emphasis on sharing materials</p><p><strong>Qualitative methods</strong>: Increased popularity, especially during COVID-19</p><p><strong>Key Papers & Resources Mentioned</strong></p><p><strong>Inter-rater reliability paper</strong> by Norm McDonald et al. (CSCW)</p><p><strong>Statistical methods and null hypothesis testing</strong> (CHI Play)</p><p><strong>"HARKing No More"</strong> (CHI)</p><p><strong>Ken Hinckley's "Being a Champion" paper</strong></p><p>Essential reading for reviewers and ACs</p><p><strong>Greenberg and Buxton's "Usability Studies Considered Harmful"</strong> (2008/2009) - Including Dan Olson's panel comments on value networks</p><p><strong>Workshop on challenges for qualitative research/transparency</strong> (CHI)</p><p><strong>CHIzen LaTeX Template</strong></p><p><a target="_blank" href="https://github.com/JimWallace/CHI-Zen">Available on GitHub</a></p><p><strong>Memorable Quotes</strong></p><p>"You could get almost anything published 20 years ago... you look at the types of rigor and the things that reviewers ask for today, and it's not even close."</p><p>"The abstract, the intro, the related work - they're all basically the same thing. It's just longer versions of the same piece of writing."</p><p>"You can't just write the whole paper and revise it. You've gotta focus on small pieces or small chunks that you can revise easily and then expand out as you go."</p><p>"Students going in today just think that reviewers are complete... they're just gonna tear papers apart... I actually think we need to ease up a little bit."</p><p>"Every single person in the process has the best of intentions... everyone really wants to have very constructive feedback and do the author's justice."</p><p><strong>Episode Notes</strong></p><p>This episode was originally recorded approximately 5 years ago and is being re-released as part of the relaunch of the podcast, now titled "How to Write Research Papers." The podcast is expanding its scope while maintaining its focus on helping researchers improve their academic writing.</p><p><strong>Host</strong>: Professor Lennart Nacke</p><p><strong>Production</strong>: How to Write Research Papers Podcast</p><p><strong>Episode Length</strong>: ~29 minutes</p><p><em>For more episodes and resources, visit </em><a target="_blank" href="https://lennartnacke.substack.com"><em>https://lennartnacke.substack.com</em></a></p><p></p><p><em>Or join me on YouTube: </em><a target="_blank" href="https://www.youtube.com/@lennartnacke"><em>https://www.youtube.com/@lennartnacke</em></a></p> <br/><br/>This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit <a href="https://lennartnacke.substack.com/subscribe?utm_medium=podcast&utm_campaign=CTA_2">lennartnacke.substack.com/subscribe</a>
