Library/attention-residuals
Library/attention-residualsForked

MoonshotAI/Attention-Residuals

attention-residuals

This repository appears to be related to attention mechanisms and residual connections in machine learning models, likely focusing on transformer architectures.

Builder

MoonshotAI

MoonshotAI

MoonshotAI • individual

Stars

2,924

Using upstream star count

Forks

141

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Mar 15, 2026

Project creation date

README Summary

This repository appears to be related to attention mechanisms and residual connections in machine learning models, likely focusing on transformer architectures. Without access to the actual repository content, the specific implementation details and methodology cannot be determined. The repository is associated with MoonshotAI and deals with attention residuals research or implementation.

AI Dev Skills

Unmapped

Attention MechanismsResidual ConnectionsTransformer Architecture

Tags

Attention MechanismsResidual ConnectionsTransformer Architecture

Taxonomy

Recent Activity

Updated 27 days ago

7 Days

0

30 Days

0

90 Days

0

Quality

research
Quality
low
Maturity
research

Categories

Foundation ModelsPrimary

PM Skills

Scale & Reliability

Languages

No language breakdown recorded.

Timeline

Project created
Mar 15, 2026
Forked
Mar 16, 2026
Your last push
27 days ago
Upstream last push
27 days ago
Tracked since
Mar 17, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…