๐Ÿ“š ์„ธํ˜„'s Vault

๐ŸŒ ๋„๋ฉ”์ธ

  • ๐Ÿ”ฎ3D-Vision
  • ๐ŸŽจRendering
  • ๐Ÿค–Robotics
  • ๐Ÿง LLM
  • ๐Ÿ‘๏ธVLM
  • ๐ŸŽฌGenAI
  • ๐ŸฅฝXR
  • ๐ŸŽฎSimulation
  • ๐Ÿ› ๏ธDev-Tools
  • ๐Ÿ’ฐCrypto
  • ๐Ÿ“ˆFinance
  • ๐Ÿ“‹Productivity
  • ๐Ÿ“ฆ๊ธฐํƒ€

๐Ÿ“„ Papers

  • ๐Ÿ“š์ „์ฒด ๋…ผ๋ฌธ172
Home

โฏ

bookmarks

โฏ

can transformers be used to learn object centric representations yes if we inver

can-transformers-be-used-to-learn-object-centric-representations-yes-if-we-inver

2023๋…„ 12์›” 15์ผ1 min read

  • LLM
  • training

Yi-Fu Wu (@yifuwu)

2023-12-15 | โค๏ธ 99 | ๐Ÿ” 15


Can Transformers be used to learn object-centric representations? Yes! If we โ€œinvertโ€ the attention operation by taking the softmax over the queries instead of the keys.

paper: https://openreview.net/pdf?id=m9s6rnYWqm https://x.com/yifuwu/status/1735696057651081567/photo/1

๋ฏธ๋””์–ด

photo


Tags

domain-llm


๊ทธ๋ž˜ํ”„ ๋ทฐ

  • Yi-Fu Wu (@yifuwu)
  • ๋ฏธ๋””์–ด
  • Tags

๋ฐฑ๋งํฌ

  • domain-LLM

Created with Quartz v4.5.2 ยฉ 2026

  • GitHub
  • Sehyeon Park