#OpenData just got a teeny bit more open

A map showing real-estate development projects as of the end of 2012. Data visualization from the city's Open Data Portal.

We were disheartened when, after submitting some fairly innocuous questions to the Mayor’s Chief Innovation Officer, Jay Nath, we received zero answers. By the time the Guardian’s annual Freedom of Information issue hit stands yesterday, we were still out in the cold. (Shameless plug: Pick up a print edition of this week’s paper for our flow chart on how to file Sunshine requests, designed by our illustrious Art Director Brooke Robertson.)

Nath, who helped start the city's Open Data program, responded to our emails and tweets (apologetically) by saying he was awaiting the green light from the Mayor’s Office of Communications. Which begs the question: In a city so outwardly committed to transparency, why can’t the Mayor’s Office of Communications entrust a program expert to share information about information-sharing software?

Anyway, the day after we ran our story, Nath did respond in an email. The first objective of Open Data is to “increase transparency,” he told us.

Other goals are to “drive economic development” and “foster the creation of new services and analysis by our community.” The inspiration behind it came from President Barack Obama, who on his first day in office “issued a memo on open government that heralded their open data program Data.gov," Nath explained. "With this precedent, the city recognized an opportunity to share local data with the public.” 

Head over to the city's Open Data Portal and you can poke around for info on everything from real-estate development, to restaurant health inspection scores, to city salary ranges by job classification.

As Nath pointed out, there are also over 30 datasets around campaign finance. That’s a good thing – but there’s still room for improvement. Last year, after attending a city hackathon where transparency advocates hoped to spur creation of an app to track lobbying, campaign contributions and real-estate development, Adriel Hampton of the San Francisco Technology Democrats noted that this was impossible due to a lack of information. “Despite millions in spending on … online transparency measures, access to data in these areas is woefully lacking,” Hampton wrote.

Nath said the annual cost is $40,000 per year for software. He also shared his vision for future expansion. “In terms of new services, I see applications that mash up data from multiple public and private sources to create a seamless experience,” he said. “For example, imagine a tourism app that helps you navigate the city via public transit, taxis, car / bike sharing, biking, walking, etc.”

So how does Open Data affect public records requests under the San Francisco Sunshine Ordinance? “Government can use open data to reduce costs by pro-actively providing information that is often requested through FOIA,” Nath told us, referring to the Freedom of Information Act. “For example, by releasing real-time transit data, transit riders have dozens of ways to know when their next bus is coming. This new and immediate access to information has resulted in 21.7% fewer SF 311 calls – and at $2 per call – that yielded a savings of over $1 million a year.”

An interesting thing about data is that it can be totally neutral until it’s harnessed for a particular purpose, with clever visualization and presentation. Just ask the producer of this video on wealth distribution, which has been making the rounds.


So you support public sector corruption? I thought you hated the public sector.

Posted by marcos on Mar. 09, 2013 @ 7:20 pm

You love the public sector, and here they are screwing you over.


Posted by anon on Mar. 09, 2013 @ 7:42 pm

A public records request to the Clerk of the Board of Supervisors produces three-pages of information about how $1.1 million in slush funds has been spent since July:


Posted by MPetrelis on Mar. 11, 2013 @ 7:53 am

I just added your site to my favorites. I really enjoy reading your posts. Thanks!

Posted by http://termpapermonster.com/ on Jun. 09, 2013 @ 12:15 am

Your writting is really very good. Blog is fully stuffed with unique and good information. Good keep it up.

Posted by click here on Jun. 10, 2013 @ 7:42 am

Good job. All of them are useful.

Posted by buyessay.net on Jun. 11, 2013 @ 11:43 am

Useful info. Fortunate me I discovered your site unintentionally, and I_m shocked why this coincidence did not happened in advance! I bookmarked it.

Posted by http://essaydone.com/ on Jun. 13, 2013 @ 12:14 pm

Well done dude! Thanks for this!

Posted by essaydone on Jun. 14, 2013 @ 3:36 am

Thanks to share your experience with us, so you can re-examine their own personal bias and thinking habits. Great stuff, toogood to be true!

Posted by http://essayshelpers.co.uk/ on Jun. 25, 2013 @ 4:24 am

I would like to thank you for the efforts you have made in writing this article. I am hoping the same best work from you in the future as well.

Posted by perfectessaywriter.com on Jul. 02, 2013 @ 7:54 am

your website is good but i need your help regarding jont pain!

Posted by professional essay writing services on Jul. 27, 2013 @ 3:40 am

I will just say that the points you have made reflect our society. Good post and nice observation of the issue.

Posted by Jack the essay writer on Sep. 19, 2013 @ 2:44 am