Methodical Snark

critical reflections on how we measure and assess civic tech
This is a blog about how the civic tech and accountability field measures its work and its impact. It’s based on a critical perspective, but tries to be more productive than conference snark. It’s an effort to highlight how much work is being done in silos across the academic-NGO divide, to de-mystify important methods and findings, and to call out research that is sloppy or unhelpful. Scroll for the blog roll, or check out the core content types:
I READ THIS FOR YOU: summaries for those with more interest than time. 
MINI LIT REVIEWS: when I wonder about something, I check what the research says, and write it up.
RESEARCH ROUNDUP: review of recent research on topical issues.
RANDOM SNARK: reflections and questions about using evidence in civic tech design.

Latest stories

research links w25 – 17

Findings From the duh desk:  A white paper from Cornell Law reviews e-government and rulemaking processes in the US, to find that an institutional “culture of risk adverseness” is much more obstructive to e-participation than is a lack of technological solutions. What difference does it make?: An article in Telecommunications Policy documents how mobiles have dramatically reshaped the...

research links w 23-24 / 17

Findings Research on nearly 3 decades of democratic innovation and e-participation in Latin America has some interesting findings (Brazil, Colombia, Mexico and Peru). According to an Open Democracy blogpost (the actual project’s website is down): civil society participation programming uses tech more often than not, smaller countries are less prolific than large countries in terms of tech...

New evidence on the domestic policy influence of global performance assessments

Using a multilevel linear model to account for the hierarchical structure of our survey data, we find evidence that performance assessments yield greater policy influence when they make an explicit comparison of government performance across countries and allow assessed governments to participate in the assessment process. This finding is robust to a variety of tests, including country-fixed and...

research links w 22 – 17

Findings An assessment of 100 Indian smart city initiatives supports previous findings regarding the lack of correlation between digital literacy, infrastructure citizen and participation in municipal e-government. A comparison of national log data with select case studies further suggests that national centralization of e-government services may have a negative consequence on citizen engagement...

Measuring women’s empowerment: pushing composite indicator frameworks on projects?

While the framework remains unchanged, the characteristics and indicators that make up the index change from context to context, aiming to capture the characteristics of an ‘empowered woman’ in the socio-economic context of analysis. The index provides a concise, but comprehensive, measure of women’s empowerment, while also allowing breakdown of the analysis by level of change or the individual...

Case by case: what development economics can teach the civic tech and accountability field about building an evidence base

Warning: long post, deep weeds. Last week saw some really interesting thinking in the development economics blogosphere, focused on design questions for external validity (the applicability of case-specific findings to other cases). This is a central question for research on civic tech and accountability programming, which talks a lot about wanting an evidence base, but remains dominated by case...

research links w 21-17

Findings E-government projects are more successful when formal decision-making processes include stakeholders and actively manage risk, according to a survey of  Swedish national government agencies and municipalities (N=550). Meanwhile, @timdavies is coauthor on a paper in Science & Technology Studies that tracks how data standards influence bureaucratic processes for opening government data...

research links w 19 & 20-17

Findings The University of Vienna has a new report on far-right attacks on the press, a concept they sketch to include legal action, abuse of power and online abuse. The report describes a delicate relationship between the rise of far-right nationalism/populism and declines in the quality of European democracy.  Meanwhile @datasociety‘s new report on Media Manipulation only describes the...

Methodical Snark critical reflections on how we measure and assess civic tech

Tags