Table 4

The number of segments pairs with English.

LanguagesNb. of filesNb. of tokensNb. of Segments
English11002,134,155275,847
Arabic10901,703,114271,246
Portuguese-BR10851,978,894270,255
Hebrew10851,568,768270,534
Korean10801,417,473266,449
French10742,124,021267,901
Russian10711,684,719270,825
Spanish10681,968,660266,847
Chinese (TW)1065326,739265,535
Italian10481,859,765261,477
Japanese1045406,964264,610
Romanian10031,750,662242,909
Chinese (CN)977298,569258,122
Dutch9571,726,997240,410
Vietnamese9442,279,456232,153
Polish9321,297,125228,738
Greek8981,582,023222,279
Deutsch8941,604,856226,573
Turkish8851,239,183224,495
Serbian8711,378,420212,990
Hungarian8001,188,401202,221
Bulgarian7911,425,035205,132
Portuguese7901,435,525199,333
Farsi7871,673,768193,726
Ukrainian6801,016,555164,927
Croatian6481,019,459158,525
Thai624270,437145,432
Czech581880,445139,670
Indonesian509764,600113,990
Slovenian494607,37596,943
[ViewLarge]
This Feature Is Available To Subscribers Only

or Create an Account

Close Modal
Close Modal