User Tools

Site Tools


data:start

Data

The main Code for Hawaii One Stop Data Shop is currently maintained at this Google Sheets spreadsheet that contains backlinks to this wiki for specific datasets.

Tips

Reference

The City of Chicago Data Dictionary is a good example of the sort of site we wish to emulate. It is built on top of a website app named Metalicious.

Getting structured data out of a Socrata instance

To get the top N most viewed datasets in Hawaii Socrata, install JQ and json2csv and run the following command:

curl "http://data.hawaii.gov/api/search/views.json?sortBy=most_accessed&limit=100" | jq --arg url http://data.hawaii.gov/d/ '.results[] | {name: .view.name, description: .view.description, license: .view.licenseId, id: ($url + .view.id), author: .view.tableAuthor.displayName, category: .view.category, department: .view.metadata.custom_fields["Hawaii Line of Business"]["Department Agency short name"], division: .view.metadata.custom_fields["Hawaii Line of Business"]["Division name"], attribution:.view.attribution, last_updated: .view.rowsUpdatedAt }' -c | json2csv -k id,name,description,license,category,author,department,division,attribution,last_updated -p > top-100-data.hawaii.gov.csv

Getting data from the CfA API

To get a list of all the brigades in the CfA API, install JQ and json2csv and run the following command:

curl "http://codeforamerica.org/api/organizations?per_page=500&type=Brigade" | jq '.objects[] | {city: .city, name: .name, website: .website, projects_url: .projects_list_url, rss:.rss}' -c | json2csv -k city,name,website,projects_url,rss -p > `date +%Y-%m-%d`-brigades.csv
data/start.txt · Last modified: 2015/08/18 06:34 by mckaydavis