What is Hackers' Pub?

Self-Adapting Language Models

Large language models (LLMs) are powerful but static; they lack mechanisms to adapt their weights in response to new tasks, knowledge, or examples. We introduce Self-Adapting LLMs (SEAL), a framework that enables LLMs to self-adapt by generating their own finetuning data and update directives. Given a new input, the model produces a self-edit-a generation that may restructure the information in different ways, specify optimization hyperparameters, or invoke tools for data augmentation and gradient-based updates. Through supervised finetuning (SFT), these self-edits result in persistent weight updates, enabling lasting adaptation. To train the model to produce effective self-edits, we use a reinforcement learning loop with the downstream performance of the updated model as the reward signal. Unlike prior approaches that rely on separate adaptation modules or auxiliary networks, SEAL directly uses the model's own generation to control its adaptation process. Experiments on knowledge incorporation and few-shot generalization show that SEAL is a promising step toward language models capable of self-directed adaptation. Our website and code is available at https://jyopari.github.io/posts/seal.

arxiv.org · arXiv.org

型システムを知りたい人のための型検査器作成入門

# 対象とする聴衆のレベル beginner+intermediate # セッションのテーマ 言語処理系、理論、入門 # セッションの概要 プログラミングにおいて何かを深く学ぶには、それを自分で作ってみるのが最良の方法です。 そこで、型システムを学ぶためのプログラミング演習として、型検査器を書くことを提案します。 前半では、型付きラムダ計算に相当するTypeScriptの極小サブセット言語を定義し、その型検査器を自作します。 この過程で、抽象構文木（AST）の扱いや型検査の基本構造を解説します。 後半では、対象言語を拡張し、最終的に型検査器自身を型検査できるようにする（セルフホスト） ことを目標とします。 具体的には、オブジェクト型、タグ付きunion型、再帰関数、再帰型などを導入し、より強力な型システムへと発展させます。 本発表を通じて、型検査器の実装を通じた型システムの理解を深め、プログラミング言語処理系の基礎に触れる機会を提供します。

fortee.jp

트럼프, 일본제철 US스틸 인수 사실상 승인…행정명령 서명

SBS 뉴스 · 다만 행정명령에서 국가 안보 합의의 구체적인 내용은 밝히지 않았습니다. US스틸과 일본제철은 공동 성명을 통해 일본제철이 2028년까지 약 110억 달러, 우리 돈 15조 458억 원을 투자하고, 미국 정부에는 국가 안보 이익이 침해된다고 판단될 경우 거부권을 행사할 수 있는 지분율인 '황금주'를 부여하는 내용이 합의에 명시됐다고 밝혔습니다.

news.sbs.co.kr · SBS NEWS

ケルヒャー、手のひらサイズのモバイル高圧洗浄機「ハンディエア」。水道電源不要、キャンプ/釣りなど出先ですぐ使える

　ケルヒャー ジャパンは、モバイル高圧洗浄機「OC Handy Compact」（通称：ハンディエア）をMakuakeで先行販売する。期間は6月22日～7月30日。

travel.watch.impress.co.jp · トラベル Watch

Open A Portal To An NES Emulator

The Portal games were revolutionary not only for their puzzle-based, narrative-driven gameplay, but also for their unique physics engine, which let players open portals anywhere and conserve moment…

hackaday.com · Hackaday

【FRENZ2017】夢/あるいは在りし日の【BOFU2017】

恋愛のお話です。FRENZ2017/BOFU2017出展Music : Nego_tiator ( https://twitter.com/Nego_tiatorDTM )Movie : Fiz ( https://twitter.com/fiz03_zip )BMS : http://manbow.nothin...

www.youtube.com · YouTube

Netanyahu: Israel informed US of Iranian strikes in advance | Flipboard

Al Jazeera - Israeli PM Netanyahu said Friday’s strike on Iran was months in the making and that the US was informed in advance.

flipboard.com · Flipboard

What If Disney World Was Rebuilt For Cars Instead?

Take your personal data back with Incogni! Use code STREETCRAFT at the link below and get 60% off an annual plan: https://incogni.com/streetcraftLet's rebuil...

www.youtube.com · YouTube

Seedance 1.0 - Bytedance의 멀티샷 비디오 생성모델 | GeekNews

텍스트와 이미지 기반의 멀티샷 비디오 생성 모델로, 의미 파악과 프롬프트 해석 능력에서 기존 모델보다 더 정확하고 유연한 성능을 보임1080p의 높은 해상도와 더불어 부드러운 장면 전환, 풍부한 디테일, 영화적 느낌의 결과물을 제공세밀한 파인튜닝과 비디오 특화 RLHF 보상 메커니즘으로 전반적 성능 향상텍스트 묘사나 이미지를 토대로 하여, 요구 조건을 만족

news.hada.io · GeekNews