New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

英文数据集 #5

Open

zhanghanweii opened this issue Mar 29, 2023 · 0 comments

zhanghanweii commented Mar 29, 2023

请问换成英文数据集的话，token_span和char_span是以字符为单位呢，还是以单词为单位呢
如：Tom：字符为单位，索引是[0,2]；单词为单位是[0,0]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment