Maybe this concept killed the future GPU mafia! 🤯 They've open-sourced bitnet.cpp, a blazing-fast 1-bit LLM inference framework optimized for CPUs. This is a major step forward for running large models locally, without expensive GPUs or cloud costs. Key highlights: - Achieve up to 6x faster inference with 82% lower energy consumption - Run 100B parameter models directly on x86 CPUs - Leverage ternary weights (-1, 0, 1) and 8-bit activations to dramatically reduce memory usage Alongside this, Mi
Maybe this concept killed the future GPU mafia! 🤯 They've open-source…
3.6K views3 months ago
FacebookMd Ismail Sojal
C++ | Microsoft Developer
C++ | Microsoft Developer
Dec 17, 2024
microsoft.com
C |Microsoft デベロッパー
C |Microsoft デベロッパー
Dec 17, 2024
microsoft.com
4.3K views · 47 reactions | Microsoft researchers release bitnet.cpp, the official inference framework for 1-bit LLMs like BitNet b1.58. It has optimized kernels for fast, lossless inference on CPUs, achieving impressive speedups on ARM and x86 CPUs and significant energy reductions. https://msft.it/6180WGJjy | Microsoft Research | Facebook
0:35
4.3K views · 47 reactions | Microsoft researchers release bitnet.cpp, th…
1.2K views2 weeks ago
FacebookMicrosoft Research
Introduction to C++/WinRT
55:02
Introduction to C++/WinRT
6 months ago
Microsoftstevewhims
You can now run 100B parameter models on your local CPU without GPUs. Microsoft finally open-sourced their 1-bit LLM inference framework called bitnet.cpp: > 6.17x faster inference > 82.2% less energy on CPUs > Supports Llama3, Falcon3, and BitNet models | Md Ismail Sojal
You can now run 100B parameter models on your local CPU withou…
9.3K views3 months ago
FacebookMd Ismail Sojal
18K views · 229 reactions | bitnet.cpp - framework giúp chạy LLM trên...
0:14
18K views · 229 reactions | bitnet.cpp - framework giúp chạy …
6.2K views1 week ago
FacebookViệt Nguyễn AI
1:45
How Microsoft's Copilot Team Rebuilt Their Backend with .NET …
Nov 26, 2024
Microsoftv-trmyl
3:37
Visual Studio 2022 17.10 and GitHub Copilot: Your Coding Partner for F…
May 21, 2024
Microsoft BlogsMark Downie
34:35
Unleashing the Power of Visual Studio 2022 for C++ Game Develo…
Aug 16, 2023
Microsoft BlogsDavid Li
0:13
Microsoft opensources bitnet.cpp: a fast 1-bit LLM inference framewor…
38 views7 months ago
linkedin.com
Microsoft’s “1‑bit” AI model runs on a CPU only, while matching larger …
8 months ago
arstechnica.com
174 reactions · 64 shares | انتهى عصر احتكار الـGPU أو يكاد: شركة...
4.2K views3 weeks ago
FacebookMohammed Nasser
13:49
Microsoft GPU Killer? Why BitNet B1.58 Runs Complex LLMs on CP…
187 views2 months ago
YouTubeDeepCombinator
How Microsoft's BitNet.cpp Makes It Possible to Run a 100B AI Model o…
654 views1 month ago
YouTubeTech Edge AI-ML
7:21
This Tiny 1-Bit Model Could Change AI Forever
10.7K views3 months ago
YouTubeBetter Stack
1:20:04
Writing a Network Client with POCO
8.6K viewsMay 12, 2022
YouTubeUtah Cpp Programmers
1:56
Introduction [Pt 1] | Generative AI with .NET for Beginners
59.3K viewsNov 10, 2023
YouTubedotnet
.NET Conf 2022 - Day 1
118.6K viewsNov 8, 2022
YouTubedotnet
36:42
Building .NET apps on WSL | .NET Conf 2022
8.6K viewsNov 14, 2022
YouTubedotnet
23:12
Monitoring of Containerized NET Applications in Azure | .NET Conf …
2.2K viewsNov 16, 2023
YouTubedotnet
Learn std::bitset (binary operations) in C++ | Part 1
4.4K viewsSep 25, 2022
YouTubeCode, Tech, and Tutorials
1:13:52
C++ Network Programming Part 1: Sockets
187.6K viewsJul 20, 2021
YouTubeNicholas Day
9:24
C++ MFC Desktop Application in Visual Studio 2019
68.5K viewsFeb 17, 2021
YouTubeHacked
16:07
C++ and GitHub Copilot
1.2K views1 month ago
YouTubeMicrosoft Visual Studio
1:00
.NET Conf 2021 Opener
10.2K viewsNov 10, 2021
YouTubedotnet
5:21
Build Insights in Visual Studio
4K viewsMay 30, 2023
YouTubeMicrosoft Visual Studio
35:35
.NET 💖 AI | .NET Conf 2023
9.9K viewsNov 15, 2023
YouTubedotnet
25:24
How to Create a C++ Connection to Microsoft Access Database in C+…
5.5K viewsJan 3, 2023
YouTubeDJ Oamen
8:34
C++ in Visual Studio 2026 | Beginner’s Guide
2.3K views3 months ago
YouTubeHacked
See more videos
Static thumbnail place holder