The Dark Side of the Language: Pre-Trained Transformers in the DarkNet

    January 2023
    Leonardo Ranaldi, Aria Nourbakhsh, Arianna Patrizi, Elena Sofia Ruzzetti, Dario Onorati, Francesca Fallucchi, Fabio Massimo Zanzotto
    Image
    Studysummary This study suggests that pre-trained Transformers only outperform syntactic and lexical neural networks on unseen DarkNet sentences after extreme domain adaptation, indicating unexpected advantages from their massive pre-training corpora.
    Our plain-language summary. Not medical advice or a treatment recommendation. Consult a qualified healthcare professional before changing treatment. Full disclaimer
    Discuss this study in the Community โ†’