The future of the past

This is a story about a thing I made. I'm still not sure what to call it. Or what it's really for. But I like it. And I hope other people will too.

  1. This is what it looks like. Or what it looked like when I took this screenshot. It changes. Try for yourself
  2. Act I: Getting carried away with words

    It all began with a large collection of newspaper articles...
  3. First run at generating tf-idf values for 10,000 newspaper articles referring to 'the future' grouped by year. May take a while...
  4. What's TDF-IF
  5. The top words by tf-idf for each year of my sample are like some wonderful puzzle where you have to create a story that links them all… [+]
  6. 1896: sahara, transvaal, tuaregs, bread, polo, crayon, gympie, symons, caravans, flour, oxidised [+]
  7. 1884: alderney, kissing, parkes, littoral, clericalism, suez, tunnel, miracles, artisan, canal, turk. And I've still got 50 years to go! [-]
  8. So now I want to create an interface to 'the future' of the past using these wonderful words. Can I do it before my public lecture on 8 May?
  9. I mean, there's got to be a novel in: prince, pronunciation, keyboards, zulu, begged, unbend, diddle, candlesticks, virtuoso, highness, pots
  10. Aaand 'hitler' pops up in my tf-idf weighted words in 1937, along with 'mudguards', 'duchess', 'opossum', 'hollywood' and 'canberra'.
  11. I'm going to stop this now, but 1939: hitler, clydesdale, nicotine, trout...
  12. Finished generating tf-idf values after about 28hrs. Now to clean up the data some more and run it again...
  13. Act 2: Public performances

    Introduced to the world...
  14. I am making you something nice. It's made of words, and I think it's sort of mysterious and beautiful and intriguing. Next week...
  15. Join Harold White Fellow, Dr Tim Sherratt as he investigates what changes when historical newspapers go online: ow.ly/aH2Rt
  16. .@wragge in fine form at the NLA - on the playful and evocative as ways of doing history, and the virtues of screwing around.
  17. Future past: how the future seemed before; how we might do history differently. Expansive, entertaining talk by @wragge yfrog.com/od44ixwj
  18. Slides from my Harold White fellows talk 'Mining for meaning' @nlagovau: bit.ly/JblHnY (arrow keys to move). Text & audio to come.
  19. You can also play with my experimental tf-idf thingy (needs a name) here bit.ly/IHhWJI
  20. @seth_denbo Playing with using tf-idf weighted words to explore a collection of 10000 newspaper articles containing the phrase 'the future'.
  21. @seth_denbo But I really just like the evocative nature of the word combinations. Will write up some details shortly.
  22. Me and my suit 'mining for meanings' in @TroveAustralia at @nlagovau. Sound, slides and links included. bit.ly/K1YB1Z

Did you find this story interesting? or comment as 1 already did!

Liked!

Tim Sherratt

Digital historian, web tinkerer, cultural data hacker.

Total views
702

Storify

@Storify