Methodical Snark

critical reflections on how we measure and assess civic tech
This is a blog about how the civic tech and accountability field measures its work and its impact. It’s based on a critical perspective, but tries to be more productive than conference snark. It’s an effort to highlight how much work is being done in silos across the academic-NGO divide, to de-mystify important methods and findings, and to call out research that is sloppy or unhelpful. Scroll for the blog roll, or check out the core content types:
I READ THIS FOR YOU: summaries for those with more interest than time. 
MINI LIT REVIEWS: when I wonder about something, I check what the research says, and write it up.
RESEARCH ROUNDUP: review of recent research on topical issues.
RANDOM SNARK: reflections and questions about using evidence in civic tech design.

Latest stories

research links w 17-17

Findings Power users of civic reporting platforms tend to cluster geographically and disseminate use of platform use in their neighborhoods. This is the main finding of new research on 311 platforms in San Fransisco (surveys, n=5k over 5 yrs), though the title and abstract are misleading, promising insights on “co-production” more generally (the authors reference the distinction, but...

research links w 16-17

Findings Do international norms and evaluations influence country performance? New evidence on the Aid transparency Index suggests they do. Combination of original panel data and interviews gives some pretty fascinating insights into institutional processes in government. Community & Resources A couple of new (and arguably redundant) efforts to open data in the US this week: The US State...

research links w15-17

Findings Qualitative content analysis of 122 US cities suggests three main pathways through which police forces adopt and innovate transparency. Short version: it’s complicated, but policy and mandates matter a lot. New research from NewsWhip suggests that political news is the trick for news outlets to increase their Facebook engagement, but that partisan sites are outperforming mainstream...

research links w 14-17

The weeds are deep in this one. Findings All the findings: @3ieNews‏ has mapped out existing evidence on citizen-state relations, put together a linked matrix organized according to the interventions and outcomes measured, plus confidence levels. It includes “18 completed systematic reviews and two systematic review protocols, 305 completed impact evaluations reported in 280 papers, 60...

research links w 13-17

Findings @bbcmediaaction ‏ sums up research on social media in development, finds little evidence of impact, and notes that most researcher on the subject is focused on the Arab uprisings of 2011-2012. Community @GlobalIntegrity ‏ continues to set the standard for best practice in governance assessments. They’re about to release provisional 2016 African Integrity data for a 2 month peer...

research links w 12- 17

Findings Politically marginalized groups have less access to the internet, worldwide. This shocker based on network measurements over 8 years and identification of politically relevant groups as defined by the Ethnic Power Relations (EPR). The relationship between online and offline activism is messy, according to a survey of 1023 adolescents from five Balkan countries, while a year-long study in...

research links w 11-17

Findings Voice online: Twitter advocacy can bypass mainstream media that excludes non-elite voices, according to a study of how #IfTheyGunnedMeDown was used following 2014 police shootings in Ferguson, Missouri. That’s good news for digital advocacy innovators, but important to remember that people don’t feel safe online and don’t understand how their personal information gets...

research links w 9-17

Findings All the reports: A @datasociety report finds low trust in media among US youth, who often find news by accident, and demonstrate a variety of innovative verification strategies. Meanwhile, a University of London report finds that whistleblowing is more dangerous in the digital age and a new OECD report finds that the resurgence of single bidding significantly increases risks of...

Methodical Snark critical reflections on how we measure and assess civic tech

Tags