38
I have a rather large dict (6 GB) with a structure along the lines of:
{((('word','list'),(1,2),(1,3)),(...)):0.0, ....}
and I need to do some processing on it. I'm trying out several document clustering methods, so I need to have the whole thing in memory at once. I have other functions to run on this data, but the contents will not change.
Currently, every time I think of new functions I have to write them, and then re-generate the dict.
I want to store the dict in a file, in such a way that I can easily load it into memory later, preserving the original structure and data types, instead of recalculating all its values.
How can I do this in Python, without manually parsing dictionary etc. syntax?