Learnings.md

Graph Neural Network

Gradient Descent

• Architectures such as GCN and ChebNet, MoNet and GAT were trained using full-batch gradient descent, which holds the entire graph adjacency matrix and node features in memory.
  
• First-Order Optimization Algorithms for Machine Learning