Toggle Side Panel
Close search

Activity Feed › Forums › Public Forum › Sparse attention in low-resource settings

  • Public Forum

    Sparse attention in low-resource settings

    Posted by xingxing on 2026年8月17日 at pm12:03

    Just finished a deep dive into the sparse attention variants from the “Longformer” paper. The implementation seems promising for long sequences, but I’m wondering if it’s practical for low-resource NLP tasks. Has anyone experimented with it on small datasets? Curious about your experience.

    xingxing replied 3 weeks, 4 days ago 1 Member · 0 Replies
  • 0 Replies

Sorry, there were no replies found.

Log in to reply.

Start of Discussion
0 of 0 replies June 2018
Now

Report

Harassment or bullying behavior
Contains mature or sensitive content
Contains misleading or false information
Contains abusive or derogatory content
Contains spam, fake content or potential malware

Block Member?

Please confirm you want to block this member.

You will no longer be able to:

  • See blocked member's posts
  • Mention this member in posts
  • Invite this member to groups
  • Message this member
  • Add this member as a connection

Please note: This action will also remove this member from your connections and send a report to the site admin. Please allow a few minutes for this process to complete.

Report

You have already reported this .