text:   Malware Detection",9,"['Used MalConv and annoyed with the huge training cost? Looked at it with disdain for being unable to learn feature interactions? With @willcfleshman @rjzak @drhyrum &amp; @filar we have what you need: A new @RealAAAI #AAAI2021 paper📝<LINK>\n🧑\u200d💻 <LINK> <LINK>', ""MalConv up to 25x faster and over 100x+ more memory efficient with a new chunked approach to temporal max pooling. Max pooling's gradient is sparse, but no one ever exploits it because their problems are too small. With this we can now train on files with T=100,000,000+ steps! https://t.co/FFtxMs0i8W"", 'We want feature interactions, but 100M+ steps is still too much for transformers. So we develop a new attention based gating mechanism ""Global Channel Gating"" (GCG) that allows learning interactions over 100M+ steps! https://t.co/NXkJxQFOy8', 'Using GCG we have MalConv2, which has a feature extraction and context extraction sub-networks, which interact through GCG to modulate parts of the input based on other content. https://t.co/OCMzlyeqyh', 'All of this work isn\'t getting us to domain knowledge levels yet, but a nice improvement work learning from raw bytes! We are also circumventing a trivial attack, we can process the _entire_ file even if its hundreds of MB. No trivial ""just append to the end"" evasion. https://t.co/8Zcsw4kBKC', 'As mentioned, also way fafster! We are processing more data in less time and less RAM! The huge reductions is what allows us to re-invest those savings into MalConv2.0 https://t.co/RxL6pio2qc', 'Impossible without @willcfleshman in particular, we can also look at how the GCG attention impacts what is/is-not used to make decisions. The results are pretty good, and seems to learn kind of intuitive logic an analyst might use. Hard to scale these kinds of studies up though. https://t.co/5AnA6MBbuY', 'Happy to get this work out there, and would not have been possible without so many people. Especially all the wonderful people who have used and attacked MalConv! Hearing about the successes and troubles in using it drove a lot of the thought behind this work.', ""If MalConv2 is useful in anyway to you, please drop a line and let us know! Especially with this pandemic thing, my normal feedback network of conferences doesn't work as well as normal 🙃""]",20,12,2133