WS upuc

GroupTrackRunidRecallCrPrecisionCpF-measureOOV RecallIV RecallOOV Precision
Microsoft Research AsiaC0.9400.001206963985460.9260.001330381241350.9330.7070.9630
National Laboratory on Machine Perception, Peking University, ChinaC0.9360.001243891988750.9230.001354880438330.9300.6830.9610
Natural Language Processing Lab, Northeastern University of ChinaCa0.9400.001206963985460.9140.001424876037520.9270.6340.9690
Institute for Infocomm Research, SingaporeCa0.9360.001243891988750.9170.001402098334510.9260.6170.9660
Institute for Infocomm Research, SingaporeCb0.9320.00127943189170.9100.001454443015020.9210.5770.9660
Simon Fraser UniversityC0.9290.001305244256240.9090.001461697139890.9190.6280.9580
Pattern Recognition and Intelligent System Laboratory,Beijing University of Posts and TelecommunicationsC0.9320.00127943189170.9040.001497181979430.9180.5460.9690
Natural Language Processing Lab, Northeastern University of ChinaCb0.9220.001362911077070.9140.001424876037520.9180.6370.9490
Institue of Software, Chinese Academy of SciencesC0.9220.001362911077070.9120.001439771308080.9170.6800.9450
National Central University at TaiwanC10.9170.001402098334510.9040.001497181979430.9100.6760.9400
Alias-i, Inc.C0.9190.001386612224120.8950.001557976585980.9070.4590.9640
Kookmin UniversityC0.9150.001417342367360.8960.001551405882690.9050.5650.9490
Shenyang Institute of Aeronautical EngineeringC0.9020.00151102296880.8870.001608999062540.8950.5680.9340
Basis Technology Corp.Ca0.8310.001904577386770.8190.001956752952190.8250.4870.8640
Basis Technology Corp.Cb0.8090.001997770996750.8270.001922341606420.8180.6370.8250

WS upuc

GroupTrackRunidRecallCrPrecisionCpF-measureOOV RecallIV RecallOOV Precision
University of Texas at AustinO0.9490.001118080192320.9390.001216332953560.9440.7680.9660
Language Technologies Institute, Carnegie Mellon UniversityO0.9420.001187939183660.9280.001313696357470.9350.7110.9640
Microsoft Research AsiaO0.9400.001206963985460.9270.001322074889180.9330.7410.9590
The University of TokyoO0.9440.001168516287030.9220.001362911077070.9330.6800.9700
NETEASE INFORMATION TECHNOLOGY (BEIJING) CO., LTD.O0.9330.001270670603020.9160.00140975011690.9240.6560.9590
National Laboratory on Machine Perception, Peking University, ChinaO0.9400.001206963985460.9070.001476045949070.9230.5610.9760
Shenyang Institute of Aeronautical EngineeringO0.9280.001313696357470.9060.001483142175890.9170.6600.9540
Beijing University of Posts and TelecommunicationsO0.9250.001338616757640.8970.001544790511680.9110.5930.9570

WS ckip

GroupTrackRunidRecallCrPrecisionCpF-measureOOV RecallIV RecallOOV Precision
Microsoft Research AsiaC0.9610.001280381120340.9550.001371049728270.9580.7020.9720
Intelligent Agent Systems Lab (IASL), Academia SinicaCa0.9610.001280381120340.9530.001399718309680.9570.6580.9740
Intelligent Agent Systems Lab (IASL), Academia SinicaCb0.9610.001280381120340.9520.001413788215210.9570.6560.9740
National Laboratory on Machine Perception, Peking University, ChinaC0.9580.00132663870590.9480.001468422751720.9530.6460.9720
Institute for Infocomm Research, SingaporeC0.9580.00132663870590.9410.001558353862950.9490.5540.9760
Natural Language Processing Lab, Northeastern University of ChinaCb0.9470.001481692861870.9430.001533340259010.9450.6010.9620
Natural Language Processing Lab, Northeastern University of ChinaCa0.9490.001455001558840.9400.001570669521180.9440.6940.9600
Alias-i, Inc.C0.9510.001427688833770.9350.001630450987370.9430.3890.9760
Kookmin UniversityC0.9370.001606886989910.9330.001653573438530.9350.5470.9540
Institue of Software, Chinese Academy of SciencesC0.9390.001582861726430.9290.001698565488010.9340.6060.9540
Basis Technology Corp.Ca0.8360.00244889591680.8340.002460834085650.8350.5210.8490
Basis Technology Corp.Cb0.8360.00244889591680.8280.002495885489680.8320.5900.8470
AI Lab., Department of Information Management, Huafan University, Taiwan.C10.7470.002875185210610.6770.003092721830220.7100.0360.7780

WS ckip

GroupTrackRunidRecallCrPrecisionCpF-measureOOV RecallIV RecallOOV Precision
Microsoft Research AsiaO0.9640.001232069003480.9550.001371049728270.9590.7040.9750
University of Texas at AustinO0.9590.001311434173260.9490.001455001558840.9540.6720.9720
National Laboratory on Machine Perception, Peking University, ChinaO0.9580.00132663870590.9480.001468422751720.9530.6470.9720
Language Technologies Institute, Carnegie Mellon UniversityOa0.9530.001399718309680.9460.001494815912980.9490.6790.9650
Language Technologies Institute, Carnegie Mellon UniversityOb0.9510.001427688833770.9440.001520636024890.9480.6760.9640
AI Lab., Department of Information Management, Huafan University, Taiwan.O20.7240.002956440128810.6680.003114601851550.6950.1610.7490
AI Lab., Department of Information Management, Huafan University, Taiwan.O30.7360.002915319348340.6530.003148231009920.6920.1600.7610
AI Lab., Department of Information Management, Huafan University, Taiwan.O10.6540.003146097574530.5730.00327142156990.6110.0570.6800

WS msra

GroupTrackRunidRecallCrPrecisionCpF-measureOOV RecallIV RecallOOV Precision
National Laboratory on Machine Perception, Peking University, ChinaC0.9640.001176086965330.9610.001222203904190.9630.6120.9760
Institute for Infocomm Research, SingaporeC0.9610.001222203904190.9530.001336118719410.9570.4990.9770
Alias-i, Inc.C0.9590.001251845986480.9550.00130875276440.9570.4940.9750
Natural Language Processing Lab, Northeastern University of ChinaCa0.9550.00130875276440.9560.001294806746880.9560.6500.9660
Intelligent Agent Systems Lab (IASL), Academia SinicaCd0.9530.001336118719410.9560.001294806746880.9550.5740.9660
France Telecom R&D BeijingCa0.9550.00130875276440.9530.001336118719410.9540.5750.9690
Intelligent Agent Systems Lab (IASL), Academia SinicaCb0.9520.001349549324710.9560.001294806746880.9540.5750.9660
Intelligent Agent Systems Lab (IASL), Academia SinicaCc0.9490.00138889004030.9570.0012806777550.9530.6730.9590
Intelligent Agent Systems Lab (IASL), Academia SinicaCa0.9490.00138889004030.9580.001266359664360.9530.6720.9590
Simon Fraser UniversityC0.9520.001349549324710.9540.001322521595990.9530.6040.9640
France Telecom R&D BeijingCb0.9500.001375930425450.9540.001322521595990.9520.6020.9620
Pattern Recognition and Intelligent System Laboratory,Beijing University of Posts and TelecommunicationsC0.9560.001294806746880.9470.001414368559350.9510.4930.9720
Natural Language Processing Lab, Northeastern University of ChinaCb0.9460.001426895332870.9520.001349549324710.9490.5680.9590
Tung Nan Institute of TechnologyCc0.9500.001375930425450.9300.001610794594850.9400.2720.9740
ITNLP, Harbin Intitute of Technolgy, ChinaCa0.9630.001191691042530.9180.00173211983970.9400.1750.9910
Tung Nan Institute of TechnologyCb0.9540.001322521595990.9210.001702915231880.9370.1630.9810
Institue of Software, Chinese Academy of SciencesC0.9330.001578439325870.9420.001475669555730.9370.6400.9430
Kookmin UniversityC0.9330.001578439325870.9390.00151094057160.9360.5260.9480
Shenyang Institute of Aeronautical EngineeringC0.9230.001683045598620.9290.001621387052650.9260.5540.9360
Tung Nan Institute of TechnologyCa0.9490.00138889004030.8970.001918953730470.9220.0220.9820
Basis Technology Corp.Ca0.8300.002371445652730.8320.002360293298710.8310.4730.8420
Basis Technology Corp.Cb0.8170.002441103775850.8210.00242018053340.8190.4910.8290

WS msra

GroupTrackRunidRecallCrPrecisionCpF-measureOOV RecallIV RecallOOV Precision
France Telecom R&D BeijingOa0.9800.0008838482472650.9780.0009260414730910.9790.8390.9850
France Telecom R&D BeijingOb0.9770.0009463697919840.9760.000966229291340.9770.8400.9820
Nanjing University, ChinaO0.9750.0009856483098310.9760.000966229291340.9750.8110.9810
National Laboratory on Machine Perception, Peking University, ChinaO0.9770.0009463697919840.9710.001059395888830.9740.6750.9880
Beijing University of Posts and TelecommunicationsO0.9700.001076951545490.9700.001076951545490.9700.8040.9760
ITNLP, Harbin Intitute of Technolgy, ChinaOa0.9770.0009463697919840.9600.001237129837630.9680.6240.9890
University of Texas at AustinO0.9590.001251845986480.9610.001222203904190.9600.7110.9680
Language Technologies Institute, Carnegie Mellon UniversityO0.9490.00138889004030.9540.001322521595990.9520.6920.9580
The University of TokyoO0.9530.001336118719410.9400.001499302348720.9470.5030.9690
Shenyang Institute of Aeronautical EngineeringO0.9380.00152246365340.9460.001426895332870.9420.7060.9460

WS cityu

GroupTrackRunidRecallCrPrecisionCpF-measureOOV RecallIV RecallOOV Precision
Intelligent Agent Systems Lab (IASL), Academia SinicaCd0.9730.0006908445731850.9720.0007031600629260.9720.7870.9810
Intelligent Agent Systems Lab (IASL), Academia SinicaCb0.9730.0006908445731850.9720.0007031600629260.9720.7870.9810
Microsoft Research AsiaC0.9720.0007031680470210.9710.0007152462562770.9710.7920.9790
National Laboratory on Machine Perception, Peking University, ChinaC0.9690.0007387367677020.9700.0007270988770350.9700.7730.9780
Natural Language Processing Lab, Northeastern University of ChinaCa0.9710.000715238135040.9650.000783320923120.9680.7190.9810
Intelligent Agent Systems Lab (IASL), Academia SinicaCc0.9650.000783320923120.9670.0007613989177590.9660.7920.9720
Intelligent Agent Systems Lab (IASL), Academia SinicaCa0.9660.0007724494529210.9670.0007613989177590.9660.7860.9730
Institute for Infocomm Research, SingaporeC0.9680.00075016992210.9610.0008251653381890.9650.6330.9830
France Telecom R&D BeijingC0.9620.0008149320204740.9620.0008149320204740.9620.7220.9720
Simon Fraser UniversityC0.9630.0008045555847390.9580.0008549671885470.9610.6890.9740
Alias-i, Inc.C0.9660.0007724494529210.9570.0008646338717520.9610.5550.9830
Natural Language Processing Lab, Northeastern University of ChinaCb0.9580.0008549671885470.9630.0008045555847390.9600.7140.9680
Institue of Software, Chinese Academy of SciencesC0.9520.0009111420124830.9540.0008928943658870.9530.7470.9600
Kookmin UniversityC0.9500.000928953091170.9490.0009377027154640.9490.6380.9630
Basis Technology Corp.Cb0.8450.001542539350390.8440.001546591328010.8440.6320.8540
Basis Technology Corp.Ca0.8410.001558614126890.8440.001546591328010.8430.5060.8550
AI Lab., Department of Information Management, Huafan University, Taiwan.C10.5890.002097130892120.5890.002097130892120.5890.0220.6130

WS cityu

GroupTrackRunidRecallCrPrecisionCpF-measureOOV RecallIV RecallOOV Precision
Microsoft Research AsiaO0.9780.0006252126365330.9770.0006389372074310.9770.8400.9840
National Laboratory on Machine Perception, Peking University, ChinaO0.9790.0006111502203410.9760.0006523452569760.9770.8130.9850
University of Texas at AustinO0.9710.000715238135040.9670.0007613989177590.9690.7950.9780
CKIP, Academia Sinica, TaiwanO0.9700.0007270988770350.9650.0007833298174090.9670.7610.9790
Language Technologies Institute, Carnegie Mellon UniversityO0.9640.0007940206834850.9640.0007940206834850.9640.7870.9710
AI Lab., Department of Information Management, Huafan University, Taiwan.O20.5440.00212289664450.5490.002120906009060.5470.1940.5590
AI Lab., Department of Information Management, Huafan University, Taiwan.O30.5240.002128708034090.5030.002131126190110.5130.1950.5380
AI Lab., Department of Information Management, Huafan University, Taiwan.O10.4970.002131126190110.4670.00212651780920.4810.0570.5160

NER ldc

GroupTrackRunidNumphrasesAccuracyPrecisionRecallF-MeasurePer-FLoc-FOrg-FGPE-F
National Institute of Information and Communications Technology, JapanC368295.1680.2672.6576.2778.8430.4665.8582.04
Institue of Software, Chinese Academy of SciencesC368293.8281.4359.5368.7865.7117.0558.5577.27

NER ldc

GroupTrackRunidNumphrasesAccuracyPrecisionRecallF-MeasurePer-FLoc-FOrg-FGPE-F
The University of TokyoO368294.2276.1666.2170.8474.2228.5752.0979.30
HKUST, Human Language Technology CenterOGPE-LOC368292.9767.2065.5466.3674.2070.7845.53
HKUST, Human Language Technology CenterO368289.4530.5829.8230.1974.203.7045.530.00

NER msra

GroupTrackRunidNumphrasesAccuracyPrecisionRecallF-MeasurePer-FLoc-FOrg-FGPE-F
Nanjing University, ChinaC619098.0088.9484.2086.5190.0985.4583.10
Yahoo!Ca619097.9591.2281.7186.2082.5790.5381.96
Yahoo!Cb619098.0388.4382.8885.5684.9590.1376.98
National Institute of Information and Communications Technology, JapanC619098.2288.1482.3485.1479.3890.6281.50
Yahoo!Cf619098.0288.4579.3183.6375.6890.0380.71
Yahoo!Cg619098.0786.6180.3283.3577.5389.9177.42
Institute of Information Science, TaiwanCavdic619097.8086.3777.6781.7981.2682.3381.38
Institute of Information Science, TaiwanCdcrf619097.7886.2377.4081.5880.9382.0781.41
Alias-i, Inc.C619097.5781.8880.9781.4281.9685.2972.95
Institute of Information Science, TaiwanCcnoword619097.7286.7075.5480.7477.6482.5781.00
Institute of Information Science, TaiwanCbvoting619097.6285.8376.0680.6578.9981.3381.45
Institute for Infocomm Research, SingaporeC619097.4381.0578.8279.9276.9983.8574.91
Yahoo!Cr619096.0787.4871.6878.8071.0786.0472.88
Institue of Software, Chinese Academy of SciencesC619092.4481.6431.2445.1935.2150.8445.91

NER msra

GroupTrackRunidNumphrasesAccuracyPrecisionRecallF-MeasurePer-FLoc-FOrg-FGPE-F
Beijing University of Posts and TelecommunicationsO619098.6692.2090.1891.1896.0490.3485.90
Nanjing University, ChinaO619098.4890.7689.2289.9992.6190.9983.97
France Telecom R&D BeijingOb619098.1887.6787.5387.6092.2589.7676.11
France Telecom R&D BeijingOa619097.4286.4583.9985.2091.9987.4569.45
National Laboratory on Machine Perception, Peking University, ChinaO619097.5583.9781.8482.8982.0788.0472.61
The University of TokyoO619097.0984.6878.2281.3282.8085.5269.58
HKUST, Human Language Technology CenterO619096.0881.9569.2675.0769.5582.9164.43
ITNLP, Harbin Intitute of Technolgy, ChinaOa619096.3986.9765.5674.7689.8770.2958.41
Institue of Software, Chinese Academy of SciencesO619096.2883.2067.0374.2475.6580.0056.51
NETEASE INFORMATION TECHNOLOGY (BEIJING) CO., LTD.Ob619094.3770.8354.6461.6971.7161.5441.68
NETEASE INFORMATION TECHNOLOGY (BEIJING) CO., LTD.Oa619093.7173.9551.8660.9670.7461.5441.68

NER cityu

GroupTrackRunidNumphrasesAccuracyPrecisionRecallF-MeasurePer-FLoc-FOrg-FGPE-F
National Institute of Information and Communications Technology, JapanC1640798.2591.4386.7689.0390.8792.1180.46
Institute of Information Science, TaiwanCccrf1640798.1892.0185.4588.6188.7292.5180.54
Yahoo!Ca1640798.1092.6684.7588.5389.3792.3279.73
Yahoo!Cb1640798.1192.4284.9188.5089.2092.3679.76
Institute of Information Science, TaiwanCavdic1640798.1690.7986.2688.4789.1492.3379.84
Institue of Software, Chinese Academy of SciencesC1640797.8092.7681.8186.9487.6991.1477.07
Yahoo!Cf1640797.8191.8882.3186.8386.5291.0578.52
Yahoo!Cg1640797.8291.6482.4686.8186.3691.1478.42
Alias-i, Inc.C1640797.7986.9084.1785.5188.4588.6175.41
Institute of Information Science, TaiwanCbme1640798.0187.4283.0785.1983.9590.1576.67
Institute for Infocomm Research, SingaporeC1640797.2584.6680.6182.5979.2788.6374.67
National Central University at TaiwanC11640795.9790.3569.7378.7159.7489.0577.03
National Taiwan UniversityC1640795.5777.0364.4770.1975.3176.1349.48

NER cityu

GroupTrackRunidNumphrasesAccuracyPrecisionRecallF-MeasurePer-FLoc-FOrg-FGPE-F
HKUST, Human Language Technology CenterO1640796.8286.9274.9880.5180.9886.0468.01