Questions tagged [cld3]

5 questions
3
votes
0 answers

Converting Language Detection Score of CLD2 to CLD3 Accuracy

My cld2 language detection model (langID) returns for the input sentence to classify the following values { reliable: true, textBytes: 181, languages: [ { name: 'ITALIAN', code: 'it', percent: 61, score: 774 }, { name: 'ENGLISH', code:…
loretoparisi
  • 15,724
  • 11
  • 102
  • 146
1
vote
2 answers

"c1xx: fatal error C1083: Cannot open source file: 'cld3/pycld3.cpp': No such file or directory" when installing pycld3 with pip

I am trying to install cld3 with pip on Python 3.9. I have successfully installed protoc and also got the C++ build tools with Visual Studio, however when I run py -m pip install -U pycld3 it fails with a few messages. I am on windows 10 running…
1
vote
0 answers

is it possible to use 2 diffrent liberies when each one of them depends on diffrent version of protobuf?

in my JVM based project, I am loading 2 different libraries 1) CLD3 that uses protobuffer 3.8 and cannot be compiled otherwise 2) libtensorflow - 1.13.1 that uses protobuffer 3.7.1 that's throw error depending on who is loaded first is there…
Naor Tedgi
  • 5,204
  • 3
  • 21
  • 48
0
votes
1 answer

Where to find protobuf@3.6?

My python gcld3 package broke recently because it is linked against libprotobuf.30.dylib and a recent homebrew update replaced this lib with a newer version. The package protobuf@3.6 has libprotobuf.30.dylib but Homebrew disabled it. Do you know…
Barney Szabolcs
  • 11,846
  • 12
  • 66
  • 91
0
votes
1 answer

Why does my function used to detect language work for my pandas dataframe but when wrapped in a UDF it doesn't work for my pyspark dataframe?

I am using cld3 to detect language. I want to apply this to a column of a pyspark dataframe. I am using databricks and this is the code I have right now: def get_language(text): return (cld3.get_language(text)).language get_language_udf =…