Models and spaces for MADLAD-400: A Multilingual And Document-Level Large Audited Dataset

NTREX -- News Test References for MT Evaluation. Contribute to MicrosoftTranslator/NTREX development by creating an account on GitHub.

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python. - benbrandt/text-splitter

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way. - segment-any-text/wtpsplit

Natural Language Processing

In this post, we’ll discuss how we taught an AI model to convert PyTorch code into efficient Triton kernels using a reinforcement learning algorithm inspired by PPO called Group Relative Preference Optimization (GRPO).

This tutorial introduces participants to the basics of how to develop and train realistic deep learning models of human spoken language learning (ciwGAN/fiwGAN), as well as techniques to uncover linguistically meaningful representations in deep neural networks…

Jian Zhu, Changbing Yang, Farhan Samir, Jahurul Islam. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.

Generalist and Lightweight Model for Relation Extraction (Extract any relationship types from text) - jackboyla/GLiREL