Convolutional Networks on Tabular data
Yam Peleg examines a kaggle solution using convolutional neural networks which can process tabular data while being columns order agnostic.
Machine Learning
Various Machine-Learning and AI related articles: computer vision, natural language processing, deep learning model tuning and more.
Keep-Current - April 2021 Summary
Self-Supervised Learning keynote talk by Yann LeCunn; Perceiver - computation efficient transformer algorithm; Data Visualization also for summaries and more news in this monthly update.
Perceiver: General Perception with Iterative Attention
To overcome Transformers' squared complexity (w.r.t input length), the Perceiver article here offers a novel method to learn the QKV matrices. Check it out!
Discriminator Rejection Sampling
A summary of a method to improve GAN generated images by exploiting accumulated "information" from the Discriminator during the GAN training process.
Sharpness-Aware Minimization for Efficiently Improving Generalization
This very relevant article suggests an unusual method to improve neural network regularization abilities. I believe that this method has a great potential to enter the standard neural network training toolkit. I was also impressed by the detailed comparison to other methods.