Adam Filipek's picture

2 1

Adam Filipek PRO

AdamF92

·

https://rxai.dev

AI & ML interests

Research: AGI, Awareness Models, Memory Systems, Transformers, Reactive Neural Networks & Event-driven AI

Recent Activity

updated a collection 4 days ago

updated a collection 4 days ago

updated a collection 4 days ago

View all activity

Organizations

AdamF92's activity

upvoted a collection about 1 month ago

Sparse Query Attention (SQA) Research

Experimental models with Sparse Query Attention layers. Reducing training time/cost by ~3-10% compared to GQA & MQA, with the same level performance • 9 items • Updated 22 days ago • 1