Search results

Quincy @quincy@chaos.social
Public

(Now looking for a generic interface to split compounds, or split off suffixes etc., or even sentences into words, for various languages. Even in English, I'd prefer to split off parts like -ed and -s and add them separately to the board)

Quincy @quincy@chaos.social
Public

: is there something in that allows me to parse word forms into their parts, where possible?

So words would get broken down into a tree. Like pos_tag and chunk, but without stopping at tokens or word forms.

Like "stemming", but without throwing away all the other parts.

0
0
0
Quincy @quincy@chaos.social
Public

Quick question

Where can I find a list of most frequent words, not just ranked but with (rough) frequencies?

(Without downloading a huge corpus and compiling it myself?)

edit: fully answered - see replies :D

0
0
0
남정현 @rkttu@hackers.pub
Public

JAR로 되어있는 한글 형태소 분석기 라이브러리인 꼬꼬마 2.0과 Maven에 게시된 open-korean-text를 C 프로젝트 구성없이 불러다 쓰는 예제입니다.

C# 코드 파일과 XML 설정 파일만 있으면 Maven과 JAR 패키지도 손쉽게 가져와서 C 코딩할 수 있습니다. C# 파일 하나만 바라보면 될테니 코드 어시스턴트의 도움도 마음껏 받을 수 있으니 더욱 좋겠죠!

https://forum.dotnetdev.kr/t/file-based-app-maven-jar/13803

File-based App에서 Maven/JAR 가져와서 사용하기

코드 샘플 보기: awesome-dotnet-fba/015-ikvm-mvn-korean-nlp/Program.cs at main · rkttu/awesome-dotnet-fba · GitHub 이전에 IKVM을 이용하여 Maven 패키지와 JAR 패키지를 불러다 쓰는 방법을 설명했던 아티클이 있었습니다. C#으로 KoNLPy 활용하기 (feat. Embeddable Python) - rkttu 님의 게시물 #6 .NET에서 Maven 패키지나 JAR 파일 직접 참조하기 (feat. IKVM) 이것도 File-based App으로 옮길 수 있다면 효과적이면서도 멋질 것이라고 생각해서 옮겨봤는데 당연하게도 잘 작동합니다. 😃 일단 IKVM.Maven.Sdk nuget 패키지를 참조하고, 아래처럼 코드를 작성합니다. #!/usr/bin/env dotnet #:property PublishAot=False // IKVM Maven SDK integration...

forum.dotnetdev.kr · 닷넷데브

1
0
0
Jodie Burchell 🇦🇺🇩🇪 @t_redactyl@fosstodon.org
Public

Hi everyone! :blobcatwave: I'm Jodie and I love all things !

I'm currently working as a developer advocate in at , and in my previous life I worked as a , mostly in . I write tutorials and blog posts, present at conferences and host webinars about a range of , data science and topics. 📊

I'm hoping we can build up an amazing machine learning and data science community here on Mastodon!

0
0
0
:rss: DevelopersIO @dev_classmethod@rss-mstdn.studiofreesia.com
Public

Linderaで日本語を形態素解析してPostgreSQLの全文検索を最小限の努力で動かす
dev.classmethod.jp/articles/li

Linderaで日本語を形態素解析してPostgreSQLの全文検索を最小限の努力で動かす | DevelopersIO

形態素解析ライブラリLinderaを使って日本語を単語分割し、PostgreSQLのto_tsvector/to_tsquery方式の全文検索 を可能にする方法

dev.classmethod.jp · Linderaで日本語を形態素解析してPostgreSQLの全文検索を最小限の努力で動かす | DevelopersIO

0
0
0
Mario Angst @mario_angst_sci@fediscience.org
Public


I'm a researcher at the Institut Urban Landscape at the Zürich University of Applied Sciences (ZHAW). I'm working on the governance and narratives of sustainable digitalization and urban sustainability transformations.

Here for friendly exchanges and critical takes on urban digitalization and sustainability, governance and , + 🐍, , , Bayesian stats, and finding little nuggets of inspiration from your research lifes. Also cycling.

0
0
0
0
0
0
LipnLab @LipnLab@lipn.info
Public

We're the LIPN, a joint Laboratory between the and the University Sorbonne Paris Nord.

We're approximately 150 researchers, within five research teams :
- Machine Learning
- Combinatorial and High Performance Computing
- design and analysis of combinatorial models at the interface of physics, geometry and algorithmic
- and
- Automatic natural language processing and knowledge representation .

0
0
0
pettter @pettter@social.accum.se
Public

I might as well do another specifically for the side of this here fediverse:

Coming from (with applications in ) to doing (computational ), I've now landed in . Specifically, I'm interested in exploring , both sharpening existing critiques of current AI practise by confronting capital and exploring inherent politics of technologies, and finding better ones for a socialist world.

0
0
0

Browser-Native Translation and Language Detection APIs Coming Soon

洪 民憙 (Hong Minhee) @hongminhee@hackers.pub

Just reviewed the W3C draft for the Translator and Language Detector APIs. This is genuinely exciting development for web developers.

The proposal would add native browser support for:

  • Text translation between languages
  • Language detection of arbitrary text
  • Both with streaming capabilities

No more relying on third-party translation services or embedding external APIs for basic language operations. All processing happens locally in the browser.

The API design is clean and straightforward:

// Translation example
const translator = await Translator.create({
  sourceLanguage: "en",
  targetLanguage: "fr"
});

const translatedText = await translator.translate("Hello world");

// Language detection example
const detector = await LanguageDetector.create();
const results = await detector.detect("Hello world");
// Returns array of detected languages with confidence scores

This will be a game-changer for multilingual sites and applications. The browser handles downloading appropriate language models and manages usage quotas.

The spec is still in draft form but shows promising progress toward standardizing these capabilities across browsers. Looking forward to seeing this implemented.

Read more →
0
1
0
0
0
0