Sho't left to data science

Tag: nlp

  • Representing text by counting

    —

    by

    shotlefttodatascience
    in

    Natural language processing algorithms work with numbers, not text. So how can we convert strings of text into numbers that are representative of the meaning of that text? Some of the simplest methods (which can be surprisingly effective for some applications) are those that count words in various ways. In this article I’ll unpack the…

  • Computational literary analysis

    —

    by

    shotlefttodatascience
    in

    Introduction The inspiration for this project (which I completed in early 2022), was a call for applications to UC Berkeley that I came across on the topic of NLP for computational literary analysis and specifically how one might develop computational models for the plot of a novel. The brief suggests that the concept of ‘plot’…

  • Finding relationships between words

    —

    by

    shotlefttodatascience
    in

    I’ve spent the past couple of weeks exploring how to find relationships between words with the skip-gram word2vec model so I was pretty fired up to share some of what I’d learned! Here are some of the intuitions I covered… What task have I been working on? I have a large number of news articles,…