NLP3 Generative Multi-hop Retrieval Abstract What is Multi-hop retrieval? Task of retrieving a series of multiple documents that together provide sufficient evidence to answer a natural language query. Problems to solve Number of hops increases -> reformulated query (usually concatenation of previous retrieval & query) increasingly depends on the documents retrieved in its previous hops it further tigthens the embedding bottleneck.. 2022. 9. 12. Prompt Injection: Parameterization of Fixed Inputs 새 창에서 열기 2022. 8. 22. BART: Denoising Sequence-to-Sequence Pre-training for NaturalLanguage Generation, Translation, and Comprehension - BART BART: A Robustly Optimized BERT Pretraining Approach Paper : https://arxiv.org/pdf/1910.13461.pdf Abstract BART a denoising autoencoder for pretraining sequence-to-sequence models. BART is trained by corrupting text with an arbitrary noising function learning a model to reconstruct the original text uses a standard Tranformer-based neural machine translation architecture which, despite its simpl.. 2022. 4. 1. 이전 1 다음
