Financial news as input for models
Slide 5 in the PDFA sentiment model maps a text \(x_{1:n}\) to a fixed-size representation \(\mathbf h\) and then to the probabilities of three classes, \(\hat{\mathbf p}=\operatorname{softmax}(W_o\mathbf h+\mathbf b_o)\); the whole lecture is about how to compute \(\mathbf h\). Our data are finance tweets labelled bearish, bullish or neutral: 9,543 for training and 2,388 for the test, of which 14.5 % bearish, 19.9 % bullish and 65.6 % neutral. Media pessimism predicts next-day returns and trading volume (Tetlock, 2007), so such a model is a measurement instrument.



NN_L7_context_lengths





