Recurrent Looped Transformer

(yifanzhang-pro.github.io)

14 points | by MayCXC 2 hours ago

2 comments

  • dankai 29 minutes ago
    Is this just a theory about an architecture or are there actually some benchmarks/results to substantiate it?
    • jal278 25 minutes ago
      appears it's just a theory, sort of surprised this lifted up so far on hn
  • jal278 30 minutes ago
    not sure w/o context why this is important -- no results/implementation & i believe there are prior combinations of transformers/RNNs. but perhaps I'm missing the relevance/insight