The dataset comprises transcripts of speeches delivered by members of the Albanian Assembly during parliamentary sessions spanning from 2013. The goal of this repository is to provide a valuable resource for researchers and professionals interested in natural language processing, or political discourse analysis.
The dataset was compiled from publicly available transcripts published on the current and old official website of the Albanian Assembly (https://parlament.al/).
The dataset was compiled by downloading PDF files and converting them to a text format using OCR. The resulting text was then cleaned to fix punctuation and spelling errors. It's important to note that due to the complexity of the PDF-to-text conversion process, the dataset may still contain typos and other errors. As a result, the dataset is provided "as is".
- Conduct additional quality assurance checks to identify and correct any remaining errors in the dataset.
- Add a column for the party of the speaker.
The dataset contains the following fields: text, speaker, date, id, num_tokens.
from datasets import load_dataset
dataset = load_dataset('Kushtrim/Albania-Parliament-Transcriptions')If you use this dataset in your research, please consider citing this repository.