Code

Refactor visual encoder and features#101

Code

Merged

shaikh58 merged 13 commits intomaintalmolab/dreem:mainfrom mustafa-compact-visual-featurestalmolab/dreem:mustafa-compact-visual-featuresCopy head branch name to clipboardDec 5, 2024

+298-22

Commits

Commits on Nov 25, 2024

• - refactor visual_encoder to use a global registry and router to select appropriate encoder

  Show description for 9f28461
  shaikh58

  committed
  9f28461

  Copy full SHA for 9f28461

Commits on Nov 26, 2024

• Integrate feature descriptor calculation into visual encoder class

  shaikh58

  committed
  b956420

  Copy full SHA for b956420

• remove stdev to make model dimension even number for embeddings

  Show description for 3ef6155
  shaikh58

  committed
  3ef6155

  Copy full SHA for 3ef6155

Commits on Nov 27, 2024

• - implement learnable fourier positional embeddings to bring compact visual features to larger d_model

  Show description for c7496c4
  shaikh58

  committed
  c7496c4

  Copy full SHA for c7496c4

• - add fn to make fourier coefficients

  Show description for 72ff55d
  shaikh58

  committed
  72ff55d

  Copy full SHA for 72ff55d

• - disable image normalization to prevent empty crops in low intensity regions - empty crops prevent calculation of visual features

  shaikh58

  committed
  5017663

  Copy full SHA for 5017663

• - add logic to disable image normalization if descriptor features are used (for training stability)

  Show description for 29d7f1c
  shaikh58

  committed
  29d7f1c

  Copy full SHA for 29d7f1c

• - add config param to allow user to enable Hu moments

  Show description for 0668076
  shaikh58

  committed
  0668076

  Copy full SHA for 0668076

• - add support for removing hu moments

  Show description for dc5a6f0
  shaikh58

  committed
  dc5a6f0

  Copy full SHA for dc5a6f0

• docstyling + lint

  shaikh58

  committed
  1c2d1bb

  Copy full SHA for 1c2d1bb

• minor bug fixes for unit tests

  Show description for 44912b5
  shaikh58

  committed
  44912b5

  Copy full SHA for 44912b5

• lint

  shaikh58

  committed
  f37c4c4

  Copy full SHA for f37c4c4

Commits on Dec 5, 2024

• disable strict loading from checkpoint to enable partial loading

  shaikh58

  committed
  c7aa8bd

  Copy full SHA for c7aa8bd