Former Google CEO Eric Schmidt, who has since moved on to greener and perhaps more dangerous pastures, told an audience of Stanford students recently that
Google built the first real neural language model (Word2Vec) and the first attention/transformer language model (Attention is all you need). Then they stopped innovating.
Google built the first real neural language model (Word2Vec) and the first attention/transformer language model (Attention is all you need). Then they stopped innovating.