Will Hopkins
Will Hopkins
Will Hopkins
I am a data and software engineer, photographer, and general nerd.
Latest Posts
The number one thing that keeps getting hammered home to me, by experience and the folks at work I'm responsible to, is that the point of data/analytics engineering is to generate value for the business.New pipelines and data sources...
I finally finished my albatross project: replicating all our Postgres shards to Databricks. This is great news.In broad strokes, we export our Postgres databases daily from the backup snapshot, then ingest those Parquet snapshots with...
Every morning I start the day by making coffee, feeding the cats, heating up a hot breakfast for myself, and then I sit with my coffee, a lap cat, and my happy light for 30-60 minutes. This trio of activities (coffee, food, light)...
It's Sunday, and I was able to get some downtime at work to do some upgrades behind the scenes. I've been working on this data pipeline for months, and today I finally got to enable the first bit of it in production. We still have quite...
I've been writing here for about a year and this is my 100th post. It's been quite a year for all of us, that much is certain.I went to IrelandI have been at my current employer for longer than I've been at any startup (though a fraction...
I can't argue with most of these picks! Hades II is my personal Game of the Year, but BALL x PIT was also spectacular. I tried Expedition 33 but it never really quite landed for me, and I got most of the way through Dragon Age: The...
Pablo recently added me to powrss[1], and wrote about reading the web seasonally[2]. When I first started using RSS, I thought I’d found this great tool for keeping tabs on news, current events, and stuff I should and do care about....
At this moment, I'm feeling exhausted. I've had a cold or something for last 15 days and am now on some antibiotics to try to clear up any bacterial infection. I've been making a sizable dent in a Costco-sized bottle of generic Mucinex...
Thanks to Pablo for adding me to the group! I love stuff like powRSS and indieblog, and it's how I find most of my quality reads other than Kottke. Long live the webring[1]! Technically neither is a webring based on Wikipedia's...
Catalog of Custom 3D Prints | Peter LyonsStaff Engineer, Back EndPeter LyonsPeter LyonsPeter made a catalog of his 3D prints. He's heavily on the side of functional 3D printing (as opposed to artistic or monetizable prints) which is...
I've been working remotely (or living at my office) since lockdowns first started in March 2020. That's 5.5 years of remote work, and I'm thriving. I can stim, pet my cats, sit weirdly, or fart without worrying what anyone will think. It'
A love letter to Markdown's footnotes.
Should you self-host? The answer is complicated, and I'll walk you through the questions I ask myself before deciding to self-host something. Hope it helps!
I've lately been entranced by synthesizers[1], and especially enjoying the kind of music Hélène makes here. I love that she goes to the trouble of making this setup work in an abandoned building, while making music I find enjoyable. My...
Blake Watson – ManuLet’s start from the basics: can you introduce yourself? Sure! I’m Blake. I live in a small city near Jackson, Mississippi, USA. I work for MRI …I enjoy reading Manuel's People & Blogs series when I want something low-key