ScienceToStartup

Trends Topics Saved Articles Changelog Careers About

113 Cherry St #92768

Seattle, WA 98104-2205

Backed by Research Labs

All systems operational

Product

Dashboard
Workspace
Build Loop
Research Map
Trends
Topics
Articles

Enterprise

TTO Dashboard
Scout Reports
RFP Marketplace
API

Resources

All Resources
Benchmark
Database
Dataset
Calculator
Glossary
State Reports
Industry Index
Directory
Templates
Alternatives
Changelog
FAQ
Docs

Company

About
Careers
For Media
Privacy Policy
Legal
Contact

Community

Open Source
Community

Copyright © 2026 ScienceToStartup. All rights reserved.

Privacy Policy|Legal

State of Efficient Transformers | Report | ScienceToStartup

Home
Resources
State Reports
Efficient Transformers

State of Efficient Transformers

3 papers · avg viability 5.3

View topic page

Top papers

Retrieval-Aware Distillation for Transformer-SSM Hybrids(6.0)
Shiva-DiT: Residual-Based Differentiable Top-$k$ Selection for Efficient Diffusion Transformers(5.0)
ZeroS: Zero-Sum Linear Attention for Efficient Transformers(5.0)