transfer_and_multi_task.md

Can be found in repository: paper-on-AI.

Underfitting and overfitting

Another variable

Why deep learning

Find more data or ...

• data argumentation
• generating data
• multi-task learning / transfer learning

transfer learning

• Transfer learning and domain adaptation

multi-task learning

• HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition

• Mask RNN
  

• An Overview of Multi-Task Learning in Deep Neural Networks

1. Recent approaches have thus looked towards learning what to share and generally outperform hard parameter sharing
2. it is helpful to enable model to learn how the tasks should interact with each other(or add structure to the model).

REFERENCES

transfer learning

• A survey of transfer learning
• Transfer learning and domain adaptationsecond frozone; fine-turn; domain; distillation; semi-supervised
• Transfer Learning — The Next Frontier for ML
• Transfer Learning - Machine Learning's Next Frontier

multi-task learning

• An Overview of Multi-Task Learning in Deep Neural Networks
• Multi-task Self-Supervised Visual Learning
• HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition
• Multi-task, Multi-lingual Learning