I spent most of today banging my head against the wall trying to get some data out of a combination of Mongo and Redis using python. It paid off, because I got the data that I needed and in addition wrote a nice little script that spits out a tabular report using the wonderful and simple tabulate library in python.
Couple things to note:
- When working with Mongo or any other dictionary like data structure (i.e JSON) you will get a lot further if you learn how to use list comprehension in python.
- There is no real clean way to filter JSON from what I can tell in python. I need to figure out a better way to do this instead of checking if a key exists. I ran into a similar issue yesterday when trying to spit out a CSV from a JSON collection where some elements were missing.
- Redis is fast, powerful, and kind of a beast. Learning how to get the data that you want is worth investigating. Some especially helpful commands that I learned were related to pattern matching on keys, and pfcount.