This repository contains the training materials for the course "Open-Source Large Language Models for Behavioral Science", which will be hosted at the University of Basel from February 10th - 12th, 2025. Please see the course website for more information.
@article{hussain2024tutorial,
title={A tutorial on open-source large language models for behavioral science},
author={Hussain, Zak and Binz, Marcel and Mata, Rui and Wulff, Dirk U},
journal={Behavior Research Methods},
pages={1--24},
year={2024},
publisher={Springer}
}
Hugging face documentation
Hugging face book
But what is a GPT (3Blue1Brown)
- Make sure you have a hugging Face account (https://huggingface.co/join).
- Go to the
meta-llama/Llama-3.2-3B-Instruct
model page and fill in the 'COMMUNITY LICENSE AGREEMENT' form at the top of the page to get access to the model (this may take a couple of days). - Once you have been granted access to the model, you can navigate to your Hugging Face profile settings to generate an API token (+Create new token). Set the token type to 'Read' and give it a name.
- If you do not have a Google account, you will need to create one (this can be deleted after the workshop).
- Navigate to Google Drive (https://drive.google.com/).
- In the top-left, click New > More > Colaboratory. If you do not see Colaboratory, you may need to click "Connect more apps", search for 'Colaboratory', and install it. Then click New > More > Colaboratory.
- Copy the following code snipped into the first cell of the notebook. Run it (
shift + enter
or click ► button) to mount your Google Drive to the Colab environment. A pop-up will ask you to connect; click through the steps to connect your Google Drive to Colab (you will have to do this every time you open a new notebook).
from google.colab import drive
drive.mount("/content/drive")
- Create a second cell in your notebook using the "+ Code" button that appears when you hover your cursor right under the first cell. Copy and run the following code snippet in the second cell of your notebook to clone the GitHub repository to your Google Drive :
%cd /content/drive/MyDrive
!git clone https://github.com/Zak-Hussain/LLM4BeSciUnibas.git
- Go back to your Google Drive and navigate to the folder "LLM4BeSciUnibas". You should see the relevant notebooks (.ipynb files) and data (it may take a couple of minutes for the files to appear).
You are now ready to work through the exercises in the course!