What is Hackers' Pub?

Hackers' Pub is a place for software engineers to share their knowledge and experience with each other. It's also an ActivityPub-enabled social network, so you can follow your favorite hackers in the fediverse and get their latest posts in your feed.

0
0
0
0
0
0
1
0
0
0
0
0
Jack @knapjack@elsewhere.cozysumo.space
Public

Anything that helps reduce the environmental impacts of LLMs is a good thing.
bitnet.cpp is the official inference framework for 1-bit LLMs (e.g., BitNet b1.58). It offers a suite of optimized kernels, that support fast and lossless inference of 1.58-bit models on CPU (with NPU and GPU support coming next).

The first release of bitnet.cpp is to support inference on CPUs. bitnet.cpp achieves speedups of 1.37x to 5.07x on ARM CPUs, with larger models experiencing greater performance gains. Additionally, it reduces energy consumption by 55.4% to 70.0%, further boosting overall efficiency. On x86 CPUs, speedups range from 2.37x to 6.17x with energy reductions between 71.9% to 82.2%. Furthermore, bitnet.cpp can run a 100B BitNet b1.58 model on a single CPU, achieving speeds comparable to human reading (5-7 tokens per second), significantly enhancing the potential for running LLMs on local devices.
https://github.com/microsoft/BitNet
Official inference framework for 1-bit LLMs. Contribute to microsoft/BitNet development by creating an account on GitHub.

GitHub - microsoft/BitNet: Official inference framework for 1-bit LLMs

Official inference framework for 1-bit LLMs. Contribute to microsoft/BitNet development by creating an account on GitHub.

github.com · GitHub

0
0
0
Dr. Anna Latour @anna@mathstodon.xyz
Public
Shared by Dr. Anna Latour

Using the Easter break to indulge in a guilty pleasure: catching up on “Jet lag: the game” during my spring cleaning.

It’s very comforting to see my nerdy YouTube hero from when I was a baby scientist, Tom Scott, masking up in public transport even though, according to him, he only had very mild symptoms when he caught COVID ❤️😷


Tom and Sam on a train. Tom wears a mask. Sam wears a Jet Lag The Game baseball cap and looks at Tom while gesturing with his hand and holding a phone in the other hand. Caption reads: “It’s a tied game, Tom. It’s a tied game.”Sam and Tom in an airplane. Sam is wearing his Jet Lag The Game baseball cap and is looking at his phone. Tom wears a mask and is looking at the camera. Caption reads: - Right. - Do the challenge, head back.Tom Scott walks through an airport gesturing with his hands and wearing a mask, coat and gloves. Caption reads: “We can’t reasonably get to Riga or Vilnius or Tallinn.Sam and Tom in an airplane. Sam is wearing his Jet Lag The Game baseball cap and looks at his phone. Tom wears a mask and leans over Sam’s shoulder to also look at the phone. Caption reads: “and we’ve locked Italy”
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
2
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
6
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
보리 @bori@baram.me
Public

츠루마이카다 만화 《메달리스트》, 유소년 피겨 스케이팅 만화이지요.
왕도 스포츠물의 클리셰와 필수요소들을 다 몰아넣었음에도 너무나도 신선하게 느껴진 작품이었답니다. 라이벌이면서도 친구일 수 있고 선생님과 학생이 쌍방향으로 영향을 주며 성장할 수 있는 입체적인 내면과 인간관계를 잘 그려내고 있답니다. 어린이들의 성장기를 담아내는 작품임에도 어린이도 똑같이 온전하고 어른도 똑같이 모자란 점이 작품의 큰 매력이라고 생각해요. (오타쿠를 대상으로 한 작품들의 초등학교 고학년 캐릭터를 어떻게 묘사하는지 생각해보면 더더욱이요.)
다만 현실을 그대로 담아내다보니 작품 속에서 그려내는 현실의 불합리도 재미의 빌드업이나 주인공이 성과를 내면 다 없는 일이 되어버리는 건 아닌지 막상 찝찝하게 느껴지기도 합니다.

0
0
0
1
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
1
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
1
0
0
0
0
0
1
0
0
TC’s choice @tcpang@liker.social
Public
Shared by MJ

電影 - Last Mile 全面引爆

懸疑、緊湊，想不到名編劇野木亞紀子可以寫一個真緊張的電影劇本。

故事始於連環爆炸事件，矛頭直指超級大型網購平台，正值Black Friday年度促銷檔期，滿島光走馬上任就要揹大鍋，究竟如何能保住客戶，保住公司，又抓到行兇者呢？

故事輕輕滲透幾個社會議題，加速世界的勞役，大企業的壓榨，低技術人口的困局，甚至人口老化、下崗工人種種問題都一併集中在故事線內，沒有什麼硬道理，只是種種問題都會是引爆線，令這齣電影不只是偵探緝兇那麼簡單。

這次輕輕運用了兩部前作人物，主線仍然在滿島光，而她的表現簡直亮麗，期待再寫一齣電視劇給她。

精彩，推薦。

0
0
0
1
0
0