87 39 351

Florian Zimmermeister

flozi00

AI & ML interests

ASR, German LLM

Recent Activity

liked a dataset 1 day ago

facebook/natural_reasoning

liked a dataset 1 day ago

SakanaAI/AI-CUDA-Engineer-Archive

upvoted a paper 3 days ago

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention

View all activity

Organizations

$A\\Ware's profile picture$

flozi00's activity

upvoted a paper 3 days ago

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention

Paper • 2502.11089 • Published 5 days ago • 129

upvoted 2 papers 4 days ago

SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models

Paper • 2502.09604 • Published 8 days ago • 29

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Paper • 2502.08910 • Published 9 days ago • 139

upvoted a paper 15 days ago

SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

Paper • 2502.02737 • Published 17 days ago • 187

upvoted an article about 1 month ago

Article

The Large Language Model Course

•

Jan 16

• 105

upvoted a paper about 1 month ago

Scaling Laws for Floating Point Quantization Training

Paper • 2501.02423 • Published Jan 5 • 26

upvoted a paper 2 months ago

Transformers Can Navigate Mazes With Multi-Step Prediction

Paper • 2412.05117 • Published Dec 6, 2024 • 5

upvoted an article 2 months ago

Article

Uncensor any LLM with abliteration

•

Jun 13, 2024

• 446

upvoted 2 articles 3 months ago

Article

Releasing the largest multilingual open pretraining dataset

and 2 others •

Nov 13, 2024

• 99

Article

SauerkrautLM's Multi-Phase Spectrum Training: A Technical Deep Dive

•

Nov 9, 2024

• 9

upvoted a paper 4 months ago

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

Paper • 2411.02355 • Published Nov 4, 2024 • 48

upvoted an article 4 months ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

Sep 18, 2024

• 223

upvoted a paper 4 months ago

Differential Transformer

Paper • 2410.05258 • Published Oct 7, 2024 • 171

upvoted an article 4 months ago

Article

Welcome, Gradio 5

Oct 9, 2024

• 125

upvoted 2 papers 5 months ago

Fast Matrix Multiplications for Lookup Table-Quantized LLMs

Paper • 2407.10960 • Published Jul 15, 2024 • 12

Spectrum: Targeted Training on Signal to Noise Ratio

Paper • 2406.06623 • Published Jun 7, 2024 • 13

upvoted a collection 5 months ago

Strong German fp8 LLM's

Collection

Strong Large Language Models for the german language in fp8 format • 6 items • Updated Sep 24, 2024 • 3

upvoted 3 papers 5 months ago

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform

Paper • 2405.03003 • Published May 5, 2024 • 8

Qwen2.5-Coder Technical Report

Paper • 2409.12186 • Published Sep 18, 2024 • 141

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients

Paper • 2407.08296 • Published Jul 11, 2024 • 32