SIGHAN Second International Chinese Word Segmentation Bakeoff
Result Summary

The following tables present the results for each corpus and each track, sorted by F score.

Academia Sinica

Closed

Particpant User Run ID R P F OOV ROOV RIV
Masayuki Asahara
Nara institute of Science and Technology		 b 0.952 0.951 0.952 0.043 0.696 0.963
Masayuki Asahara
Nara institute of Science and Technology		 a 0.955 0.939 0.947 0.043 0.606 0.971
Huihsin Tseng
Stanford NLP Group		 0.950 0.943 0.947 0.043 0.718 0.960
Aitao Chen
Yahoo! Inc		 0.955 0.934 0.945 0.043 0.468 0.978
Yaoyong Li
Department of Computer Science, The University of Sheffield		 0.946 0.942 0.944 0.043 0.648 0.959
Guohong Fu
Department of Linguistics, The University of Hong Kong		 0.947 0.934 0.940 0.043 0.523 0.966
Masayuki Asahara
Nara institute of Science and Technology		 c 0.944 0.934 0.939 0.043 0.445 0.967
Chun Yu Kit
City university of Hong Kong		 0.944 0.902 0.923 0.043 0.234 0.976
Heng LI
France Telecom R&D Beijing		 0.948 0.900 0.923 0.043 0.158 0.983
Wei Jiang
ITNLP Lab, Harbin Institute of Technology		 0.943 0.895 0.918 0.043 0.137 0.979
Xiaodong SHI
Xiamen University		 0.877 0.796 0.835 0.043 0.128 0.911

Open

Particpant User Run ID R P F OOV ROOV RIV
Hwee Tou Ng
National University of Singapore		 0.962 0.950 0.956 0.043 0.684 0.975
Aitao Chen
Yahoo! Inc		 0.958 0.938 0.948 0.043 0.506 0.978
Yaoyong Li
Department of Computer Science, The University of Sheffield		 0.949 0.947 0.948 0.043 0.686 0.961
Guohong Fu
Department of Linguistics, The University of Hong Kong		 0.955 0.938 0.946 0.043 0.579 0.972
Ka Po Chow
City University of Hong Kong		 0.943 0.931 0.937 0.043 0.531 0.962
Wei Jiang
ITNLP Lab, Harbin Institute of Technology		 0.952 0.920 0.936 0.043 0.354 0.979
Heng LI
France Telecom R&D Beijing		 0.952 0.919 0.935 0.043 0.311 0.981
Xiaodong SHI
Xiamen University		 0.004 0.004 0.004 0.043 0.085 0.000

City University of Hong Kong

Closed

Particpant User Run ID R P F OOV ROOV RIV
Huihsin Tseng
Stanford NLP Group		 0.941 0.946 0.943 0.074 0.698 0.961
Masayuki Asahara
Nara institute of Science and Technology		 a 0.942 0.941 0.942 0.074 0.629 0.967
Masayuki Asahara
Nara institute of Science and Technology		 b 0.937 0.946 0.941 0.074 0.736 0.953
Aitao Chen
Yahoo! Inc		 0.949 0.931 0.940 0.074 0.561 0.980
Guohong Fu
Department of Linguistics, The University of Hong Kong		 0.944 0.933 0.939 0.074 0.626 0.969
Yaoyong Li
Department of Computer Science, The University of Sheffield		 0.931 0.941 0.936 0.074 0.657 0.953
Tak Pang Lau
The Chinese University of Hong Kong		 d 0.937 0.922 0.929 0.074 0.698 0.956
Masayuki Asahara
Nara institute of Science and Technology		 c 0.915 0.940 0.928 0.074 0.598 0.940
Tak Pang Lau
The Chinese University of Hong Kong		 a 0.938 0.915 0.927 0.074 0.658 0.961
Tak Pang Lau
The Chinese University of Hong Kong		 b 0.936 0.913 0.925 0.074 0.656 0.959
Seungshik Kang
Kookmin University		 0.917 0.925 0.921 0.074 0.539 0.948
Tak Pang Lau
The Chinese University of Hong Kong		 c 0.925 0.896 0.910 0.074 0.639 0.948
Wei Jiang
ITNLP Lab, Harbin Institute of Technology		 0.934 0.865 0.898 0.074 0.248 0.989
Heng LI
France Telecom R&D Beijing		 0.932 0.862 0.895 0.074 0.215 0.989
Xiaodong SHI
Xiamen University		 0.814 0.711 0.759 0.074 0.227 0.860

Open

Particpant User Run ID R P F OOV ROOV RIV
Hwee Tou Ng
National University of Singapore		 0.967 0.956 0.962 0.074 0.806 0.980
Tsai Yu-Fang
Academia Sinica		 0.958 0.950 0.954 0.074 0.775 0.973
Aitao Chen
Yahoo! Inc		 0.952 0.937 0.945 0.074 0.608 0.980
Guohong Fu
Department of Linguistics, The University of Hong Kong		 0.944 0.938 0.941 0.074 0.667 0.966
Yaoyong Li
Department of Computer Science, The University of Sheffield		 0.933 0.940 0.936 0.074 0.653 0.955
Wei Jiang
ITNLP Lab, Harbin Institute of Technology		 0.946 0.898 0.922 0.074 0.417 0.989
Heng LI
France Telecom R&D Beijing		 0.940 0.901 0.920 0.074 0.410 0.982
Xiaodong SHI
Xiamen University		 0.014 0.013 0.013 0.074 0.029 0.012

Peking University

Closed

Particpant User Run ID R P F OOV ROOV RIV
Aitao Chen
Yahoo! Inc		 0.953 0.946 0.950 0.058 0.636 0.972
Huihsin Tseng
Stanford NLP Group		 0.946 0.954 0.950 0.058 0.787 0.956
Huipeng Zhang
Information Retrieval Lab，Harbin Institute of Technology		 a 0.952 0.945 0.949 0.058 0.673 0.969
Huipeng Zhang
Information Retrieval Lab，Harbin Institute of Technology		 b 0.952 0.943 0.947 0.058 0.673 0.969
Chen Jiajun
Nanjing University		 0.941 0.950 0.946 0.058 0.813 0.949
Guohong Fu
Department of Linguistics, The University of Hong Kong		 0.943 0.944 0.944 0.058 0.656 0.961
Masayuki Asahara
Nara institute of Science and Technology		 b 0.930 0.951 0.941 0.058 0.760 0.941
Wei Jiang
ITNLP Lab, Harbin Institute of Technology		 0.954 0.927 0.941 0.058 0.518 0.981
ShuangLong Li
Institute of Computing Technology,Chinese Academy of Sciences		 0.938 0.942 0.940 0.058 0.767 0.948
Masayuki Asahara
Nara institute of Science and Technology		 a 0.930 0.938 0.934 0.058 0.521 0.955
Heng LI
France Telecom R&D Beijing		 0.950 0.919 0.934 0.058 0.449 0.980
Xiaofei Lu
Department of Linguistics, The Ohio State University		 0.922 0.934 0.928 0.058 0.728 0.934
Yaoyong Li
Department of Computer Science, The University of Sheffield		 0.919 0.935 0.927 0.058 0.593 0.939
Masayuki Asahara
Nara institute of Science and Technology		 c 0.904 0.930 0.917 0.058 0.325 0.940
Tak Pang Lau
The Chinese University of Hong Kong		 a 0.926 0.908 0.917 0.058 0.535 0.950
Tak Pang Lau
The Chinese University of Hong Kong		 c 0.918 0.915 0.917 0.058 0.621 0.936
Chun Yu Kit
City university of Hong Kong		 0.929 0.904 0.916 0.058 0.252 0.971
Seungshik Kang
Kookmin University		 0.900 0.925 0.912 0.058 0.389 0.931
Tak Pang Lau
The Chinese University of Hong Kong		 b 0.917 0.903 0.910 0.058 0.600 0.937
Zeng Hua-lin
Computer Science Department, Xiamen University		 a 0.906 0.886 0.896 0.058 0.290 0.943
Zeng Hua-lin
Computer Science Department, Xiamen University		 c 0.907 0.843 0.874 0.058 0.082 0.958
Zeng Hua-lin
Computer Science Department, Xiamen University		 b 0.906 0.842 0.873 0.058 0.081 0.956
Xiaodong SHI
Xiamen University		 0.843 0.737 0.786 0.058 0.153 0.885

Open

Particpant User Run ID R P F OOV ROOV RIV
Hwee Tou Ng
National University of Singapore		 0.968 0.969 0.969 0.058 0.838 0.976
Wei Jiang
ITNLP Lab, Harbin Institute of Technology		 0.968 0.966 0.967 0.058 0.826 0.977
Chen Jiajun
Nanjing University		 0.964 0.970 0.967 0.058 0.864 0.970
Aitao Chen
Yahoo! Inc		 a 0.964 0.966 0.965 0.058 0.841 0.971
Huipeng Zhang
Information Retrieval Lab，Harbin Institute of Technology		 a 0.961 0.969 0.965 0.058 0.872 0.966
Huipeng Zhang
Information Retrieval Lab，Harbin Institute of Technology		 b 0.961 0.966 0.963 0.058 0.869 0.966
Guohong Fu
Department of Linguistics, The University of Hong Kong		 0.959 0.965 0.962 0.058 0.853 0.966
Heng LI
France Telecom R&D Beijing		 0.964 0.960 0.962 0.058 0.788 0.974
Xiaodong SHI
Xiamen University		 0.959 0.954 0.957 0.058 0.776 0.970
ShuangLong Li
Institute of Computing Technology,Chinese Academy of Sciences		 0.944 0.961 0.952 0.058 0.869 0.948
Tsai Yu-Fang
Academia Sinica		 0.945 0.956 0.951 0.058 0.790 0.955
Ka Po Chow
City University of Hong Kong		 0.952 0.951 0.951 0.058 0.784 0.962
Zeng Hua-lin
Computer Science Department, Xiamen University		 a 0.943 0.944 0.943 0.058 0.737 0.955
Yaoyong Li
Department of Computer Science, The University of Sheffield		 0.932 0.944 0.938 0.058 0.755 0.943
Zeng Hua-lin
Computer Science Department, Xiamen University		 b 0.886 0.919 0.902 0.058 0.561 0.905
Aitao Chen
Yahoo! Inc		 b 0.877 0.904 0.890 0.058 0.720 0.886
Thomas Keenan
United States Government, Department of Defense		 0.781 0.846 0.813 0.058 0.628 0.791

Microsoft Research

Closed

Particpant User Run ID R P F OOV ROOV RIV
Huihsin Tseng
Stanford NLP Group		 0.962 0.966 0.964 0.026 0.717 0.968
Guohong Fu
Department of Linguistics, The University of Hong Kong		 0.962 0.962 0.962 0.026 0.592 0.972
Aitao Chen
Yahoo! Inc		 a 0.969 0.952 0.960 0.026 0.379 0.985
Aitao Chen
Yahoo! Inc		 b 0.968 0.953 0.960 0.026 0.381 0.984
Wei Jiang
ITNLP Lab, Harbin Institute of Technology		 0.973 0.945 0.959 0.026 0.323 0.991
Masayuki Asahara
Nara institute of Science and Technology		 b 0.952 0.964 0.958 0.026 0.718 0.958
Heng LI
France Telecom R&D Beijing		 0.974 0.940 0.957 0.026 0.210 0.995
Chen Jiajun
Nanjing University		 0.959 0.956 0.957 0.026 0.496 0.972
Yaoyong Li
Department of Computer Science, The University of Sheffield		 0.952 0.960 0.956 0.026 0.673 0.960
Jia-Lin Tsai
Department of Information Management, Tung Nan Institute of Technology		 06 0.958 0.952 0.955 0.026 0.503 0.970
Jia-Lin Tsai
Department of Information Management, Tung Nan Institute of Technology		 07 0.958 0.952 0.955 0.026 0.504 0.970
Jia-Lin Tsai
Department of Information Management, Tung Nan Institute of Technology		 04 0.958 0.949 0.954 0.026 0.465 0.972
Jia-Lin Tsai
Department of Information Management, Tung Nan Institute of Technology		 05 0.958 0.951 0.954 0.026 0.493 0.971
Jia-Lin Tsai
Department of Information Management, Tung Nan Institute of Technology		 03 0.968 0.938 0.953 0.026 0.205 0.989
Chun Yu Kit
City university of Hong Kong		 0.965 0.935 0.950 0.026 0.189 0.986
Masayuki Asahara
Nara institute of Science and Technology		 a 0.955 0.942 0.949 0.026 0.378 0.971
Seungshik Kang
Kookmin University		 0.945 0.949 0.947 0.026 0.576 0.955
Jia-Lin Tsai
Department of Information Management, Tung Nan Institute of Technology		 00 0.956 0.938 0.947 0.026 0.327 0.973
ShuangLong Li
Institute of Computing Technology,Chinese Academy of Sciences		 0.948 0.942 0.945 0.026 0.664 0.955
Jia-Lin Tsai
Department of Information Management, Tung Nan Institute of Technology		 02 0.964 0.924 0.944 0.026 0.025 0.989
Masayuki Asahara
Nara institute of Science and Technology		 c 0.964 0.923 0.943 0.026 0.025 0.990
Jia-Lin Tsai
Department of Information Management, Tung Nan Institute of Technology		 01 0.963 0.924 0.943 0.026 0.025 0.989
Tak Pang Lau
The Chinese University of Hong Kong		 a 0.946 0.933 0.939 0.026 0.587 0.956
Tak Pang Lau
The Chinese University of Hong Kong		 b 0.941 0.932 0.937 0.026 0.624 0.950
Zeng Hua-lin
Computer Science Department, Xiamen University		 b 0.957 0.917 0.936 0.026 0.025 0.982
Zeng Hua-lin
Computer Science Department, Xiamen University		 c 0.955 0.915 0.935 0.026 0.025 0.980
DUAN Huiming
institute of Computational Linguistics, Peking University		 0.937 0.928 0.932 0.026 0.457 0.950
Xiaodong SHI
Xiamen University		 0.908 0.927 0.917 0.026 0.247 0.926
Zeng Hua-lin
Computer Science Department, Xiamen University		 a 0.898 0.896 0.897 0.026 0.327 0.914

Open

Particpant User Run ID R P F OOV ROOV RIV
Wei Jiang
ITNLP Lab, Harbin Institute of Technology		 0.980 0.965 0.972 0.026 0.590 0.990
Hwee Tou Ng
National University of Singapore		 0.969 0.968 0.968 0.026 0.736 0.975
Guohong Fu
Department of Linguistics, The University of Hong Kong		 0.969 0.966 0.967 0.026 0.612 0.979
Aitao Chen
Yahoo! Inc		 b 0.971 0.961 0.966 0.026 0.512 0.983
Heng LI
France Telecom R&D Beijing		 0.975 0.957 0.966 0.026 0.453 0.989
Chen Jiajun
Nanjing University		 0.959 0.971 0.965 0.026 0.785 0.964
Aitao Chen
Yahoo! Inc		 a 0.970 0.957 0.963 0.026 0.466 0.984
Yaoyong Li
Department of Computer Science, The University of Sheffield		 0.950 0.958 0.954 0.026 0.648 0.958
DUAN Huiming
institute of Computational Linguistics, Peking University		 0.925 0.936 0.930 0.026 0.617 0.933
Zeng Hua-lin
Computer Science Department, Xiamen University		 a 0.940 0.917 0.928 0.026 0.239 0.959
ShuangLong Li
Institute of Computing Technology,Chinese Academy of Sciences		 0.916 0.933 0.924 0.026 0.705 0.922
Zeng Hua-lin
Computer Science Department, Xiamen University		 c 0.928 0.913 0.920 0.026 0.355 0.944
Zeng Hua-lin
Computer Science Department, Xiamen University		 b 0.923 0.914 0.918 0.026 0.354 0.938
wuguang shi
ICL,Beijing university		 0.913 0.915 0.914 0.026 0.725 0.918
Xiaodong SHI
Xiamen University		 0.921 0.897 0.909 0.026 0.562 0.930
Zeng Hua-lin
Computer Science Department, Xiamen University		 d 0.920 0.889 0.904 0.026 0.332 0.936
Zeng Hua-lin
Computer Science Department, Xiamen University		 e 0.900 0.861 0.880 0.026 0.309 0.916
Aitao Chen
Yahoo! Inc		 c 0.865 0.844 0.855 0.026 0.391 0.878
Thomas Keenan
United States Government, Department of Defense		 0.788 0.818 0.803 0.026 0.370 0.800
tree@sighan.org
Last edited: November 18 2005 12:58:09.