Particle Swarm Optimization Search
Using a Population-based algorithm for Neural Architecture Search
This demo is only available on larger screens.

Evolution during the search of a Recurrent Cell vs LSTM cell

  • Inputs of the Cell
  • Internal Nodes
  • Outputs of the Cell

Automatic Cell internal configuration
LSTM internal configuration

Perplexity on test set of the two cells on PTB dataset

Test set ppl
LSTM + skip connections
LSTM + 5 softmax experts
PSO Best cell so far
  • 60
  • 40
  • 20