feed_forward

hypembed::model::ff

Function feed_forward 

Source 
pub fn feed_forward(
    hidden: &Tensor,
    weights: &FeedForwardWeights,
) -> Result<Tensor>
Expand description

Run the feed-forward block.

§Arguments

  • hidden: Input tensor [batch, seq, hidden_size]
  • weights: Feed-forward weights

§Returns

Output tensor [batch, seq, hidden_size]