Methodical Snark critical reflections on how we measure and assess civic tech

field comment

Why No One Cares About Your Stupid Research

Recent reflections about the irrelevance of academic political communication research should help prompt the civic tech community to think critically about why no one is using all the research that gets produced these days. It's time for a frank conversation that's frankly overdue.

Evidence cultures in ICT4D and humanitarianism

@techladylaura argues for installing a culture for evidence in ICT4D and suggests that we look to the humanitarian sector for inspiration on doing so. I don't think that's helpful. We need better stories about how evidence actually helps.

The State of Formal Transparency Research, a Civic Tech Iceburg

@allvoicescount is having their final learning event this week, and starting to draw conclusions from some of their research outputs. This seems like a good time to be consistently be reminding ourselves about all the complementary research on the same issues. There’s a tremendous amount of research being produced behind the ivory curtain. Presumably, we don’t have time to read it, or...

Governance beyond elections: how considering US political crises helps bridge the gap between disciplines and methodologies

…it is critical that we look beyond the conventional focus on elections, campaign finance reform, and voting rights. There is no question that these are critical areas of concern, and necessary preconditions for meaningful democracy reform. But these areas are also well-studied and understood by many of us in the field. In this report, we hope to highlight some of the other dimensions that...

Click bait for accountability pundits: this month’s most misleading blog title

This blogpost describes an MAVC learning event, which in turn identified “7 streams of tech-enabled change that have proven to be effective in pursuing accountable governance.” Those seven streams are listed below, and while they represent a useful typology of tech for accountability programming, they do not represent activities that connect governments with their citizens.

Designing useful civic tech research at scale: why methods matter

The Hewlett Foundation has asked for help in crowdsourcing research design for citizen reporting on public services. This is great; it’s a fantastic way to design useful research, and shows that Hewlett is maintaining the strong commitment to evidence and rigorous question asking that is so important to this field. The post has already generated some useful discussion, and I’m sure that they are...

The (other) problem with scholarship on digital politics

Update: My review of Analytical Activism is up at Information, Communication & Society (gated). Here’s a free e-print and the preprint. One of the great dangers of the digital moment we currently are liveing through is that the discipline as a whole will succumb to a particularly virulent form of availability bias. It is easy to gather Twitter data. It is harder to navigate the Facebook...

Case by case: what development economics can teach the civic tech and accountability field about building an evidence base

Warning: long post, deep weeds. Last week saw some really interesting thinking in the development economics blogosphere, focused on design questions for external validity (the applicability of case-specific findings to other cases). This is a central question for research on civic tech and accountability programming, which talks a lot about wanting an evidence base, but remains dominated by case...

Crimes against data, talk by Andrew Gelman

Andrew Gelmen gives a great talk on how data gets abused in research and politics. He goes a bit into the statistical weeds at times with T & P values and the like, but he’s also a pleasure to listen to. And he gives some great examples of both academics and public figures that either “treat statistics as a means to prove what they already know, or as hoops to be jumped through...

Methodical Snark critical reflections on how we measure and assess civic tech


Get in touch

Suggest research to be reviewed or mini-lit reviews. Ask questions or tell me why I'm wrong.