Veton Matoshi

Profile

Veton Matoshi Informatiker

Contact

Address Berner Fachhochschule
Business School
Institut Public Sector Transformation
Brückenstrasse 73
3005 Bern

You can find more information on the German profile page.

Projects

Projects at the BFH

Pretraining of a Swiss Long Legal BERT Model

We will scrape legal text in German, French and Italian to pretrain a Swiss Long Legal BERT model capable of performing NLP tasks better in the Swiss legal domain.
Institute(s) Institute for Public Sector Transformation

Research unit(s) Digital Sustainability Lab

Head of project Joel Niklaus
- See research project

Pretraining of a Swiss Long Legal BERT Model

We will scrape legal text in German, French and Italian to pretrain a Swiss Long Legal BERT model capable of performing NLP tasks better in the Swiss legal domain.
Institute(s) Institute for Public Sector Transformation

Research unit(s) Digital Sustainability Lab

Head of project Joel Niklaus
- See research project

Publications

Introduction

Katharina, B., Barberio, T., Huber, E., Lasch, S., & Matoshi, V. (2019). Introduction. JournaLIPP, 7(Language in Contact; Yesterday—Today—Tomorrow), 4–5.

LDAvis, BERT: Comparison of Method Application Under Corona Conditions

Walterscheid, H., Matoshi, V., Wiśniewiecka-Brückner, K., Rothenhäusler, K., & Eckardt, F. (2021). LDAvis, BERT: Comparison of Method Application Under Corona Conditions. In T. Z. Ahram, W. Karwowski, & J. Kalra (Eds.), Advances in Artificial Intelligence, Software and Systems Engineering Proceedings of the AHFE 2021 Virtual Conferences on Human Factors in Software and Systems Engineering, Artificial Intelligence and Social Computing, and Energy, July 25-29, 2021, USA (pp. 23–30). Springer Internati-onal Publishing.

Computerlinguistik: Eine Fallstudie zu Corona anhand der Analyse lokaler und bundes-weiter Diskurse in ausgewählten Medien

Walterscheid, H., Matoshi, V., Wiśniewiecka-Brückner, K., Rothenhäusler, K., & Eckardt, F. (2022). Computerlinguistik: Eine Fallstudie zu Corona anhand der Analyse lokaler und bundesweiter Diskurse in ausgewählten Medien. In P. Klimczak, D. Newiak, & C. Pe-tersen (Eds.), Corona und die anderen Wissenschaften: Interdisziplinäre Lehren aus der Pandemie (pp. 173–186). Springer Fachmedien Wiesbaden.

LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain

Niklaus, J., Matoshi, V., Rani, P., Galassi, A., Stürmer, M., & Chalkidis, I. (2023). LEXT-REME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain. arXiv.

MultiLegalPile: A 689GB Multilingual Legal Corpus

Niklaus, J., Matoshi, V., Sturmer, M., Chalkidis, I., & Ho, D. E. (2023). MultiLegalPile: A 689GB Multilingual Legal Corpus. ArXiv, abs/2306.0

SCALE: Scaling up the Complexity for Advanced Language Model Evaluation

Rasiah, V., Stern, R., Matoshi, V., Stürmer, M., Chalkidis, I., Ho, D. E., & Niklaus, J. (2023). SCALE: Scaling up the Complexity for Advanced Language Model Evaluation. 1–40