R1D3 Learning More Python Lists and Exploring the Wordpress API
For Day 3 I continued to work more on my old_posts python script. My favorite part of 100 Days of Code is that I am taking the time to actually think through some of these problems, read documentation, and try to learn something.
Python Lists
Learned a ton about python lists thanks to this wonderful google developer guide. Specifically (after writing python for about 5 years) I learned aboutlist.extend() for the very first time. Came in handy in this particular use case because I was doing some very inefficient for loops to append to a list when it was more efficient to extend since it requires less operations.
The key differnce is that append will add a single to the end of a list, where extend will inject a list to the end of a list merging the two lists. This is particularly handy when you want to grab JSON from several requests and merge them together into a single JSON object for further processing which is what I am doing in this script.
Using Requests HEAD
I also explored more of the requests library and made an optimization that looks really silly in hindsight.In the script I was making a single request in order to grab the headers to see the total number of pages. Instea of using request.head which has a tiny payload of headers, I was using request.get which gets the headers along with the entire JSON payload. This was immediately thrown away since I did not use the response in later parts of the function.
Exploring the Wordpress API Filters
I also explored more of the WordPress API and started to use some API level filters to reduce the payload that I was receiving in an effort to reduce the overall time that the script takes to run. Specifically I am now usingcontext=embed which removes the text body (since I only need the title and the link), and before=(today - 1 year + 1 day) since I only care about posts that were written more than a year ago today.
JSON is Not SQL
I’ve been thinking about my very first forray into any sort of programming years ago. I primarily worked with Microsoft SQL Server and learned how to write efficient queries. I was thinking of how easy this problem would have been to solve if I had direct access to the database. The lesson here, that it is still taking me a while to fully wrap my head around, is that JSON is not a SQL database. You have to think about it differently. If an API offers the ability to do some filtering you should take advantage of it when you can.Thank you for reading! Share your thoughts with me on bluesky, mastodon, or via email.
Check out some more stuff to read down below.
Most popular posts this month
- 2024
- Reinstalling Windows at 1am
- SQLite DB Migrations with PRAGMA user_version
- My Custom Miniflux CSS Theme
- How to Disable Wayland in Debian Testing
Recent Favorite Blog Posts
This is a collection of the last 8 posts that I bookmarked.
- The Software Essays that Shaped Me from Refactoring English
- Give Your Spouse the Gift of a Couple's Email Domain from mtlynch.io
- Skip the Next iPhone from Articles on Jose M.
- Have smart glasses finally hit an inflection point? from The Torment Nexus
- The McPhee method from the jsomers.net blog
- Pluralistic: LLMs are slot-machines (16 Aug 2025) from Pluralistic: Daily links from Cory Doctorow
- Pluralistic: Bluesky creates the world's weirdest, hardest-to-understand binding arbitration clause (15 Aug 2025) from Pluralistic: Daily links from Cory Doctorow
- Just a Little More Context Bro, I Promise, and It’ll Fix Everything from Jim Nielsen’s Blog
Articles from blogs I follow around the net
Pluralistic: Carl Hiaasen's 'Fever Beach' (21 Oct 2025)
Today's links Carl Hiaasen's 'Fever Beach': If you didn't laugh, you'd have to cry. Hey look at this: Delights to delectate. Object permanence: Scary Godmother; Nightvale novel; The war on Worker's Comp; Cadillac's murdermo…
via Pluralistic: Daily links from Cory Doctorow October 21, 202510 pointless facts about me
Found on Kev’s blog and originally started by Dave, here are my answers to this fun blog challenge: Do you floss your teeth? Sometimes. I’d say maybe a few times a week? I’m terrible at being consistent, and that includes flossing regularly. Tea, co…
via Manuel Moreale — Everything Feed October 21, 2025Getting started with simple CSS View Transitions
There's (yet another) new piece of CSS to learn! Hurrah! Way back in 2011, jQuery mobile introduced the web to page-change animations. Clicking on a link would make your high-tech Nokia display a cool page-flip as you navigated from one page of a web…
via Terence Eden’s Blog October 21, 2025Generated by openring