Ethan Ewer (@ethan_ewer) profile picture
Joined October 2024
Well, that's it! While ENTP might not replace decoder models for now, it offers a promising direction if we overcome current computational limitations. Check out our full paper on Arxiv for details—we’d love your feedback! arxiv.org/abs/2410.01600
1
3
20
1,975
P.S.: ENTP also happens to be my Myers-Briggs type—pure coincidence, I swear! 😅
2
2
19
1,922
🚀 Excited to share our work on Encoder-only Next Token Prediction (ENTP)! While most successful LLMs are decoder-based, we asked: Can encoder-only TFs be used for next-token prediction? Yes! Moreover, ENTP might be better than decoder-only models!!! 😎
11
78
16
461
62,494