I have been tracking power outage data using a technique I learned about from Simon Willison called git-scraping. The outages are broken down by city, a stylized version of the data looks like:
1pm seattle: 300
2pm seattle: 200 tacoma: 150
3pm tacoma: 140 # implied seattle = 0 …git-history is a tool created by Simon Willison, that makes it easy to work with data collected via git scraping.
It expects data in a particular format - a flat JSON array. If your data isn't already there, you can use the --convert option to run any python code to make …
The Internet Archive's Wayback machine is a way to save a copy of a public webpage at a point in time. There is an API to submit URLs for them to crawl, but the documentation I found is fragmented and some is out of date. Here is what I have …
Inspired by Simon Willison's collection of sqlite tools, I created
a library for extracting information from a video, and storing it in an sqlite database. It's
called video-to-sqlite. You can also install it
via pip install video-to-sqlite.
You can use Simon's very nifty tool Datasette to explore the resulting DB …