Merge branch 'feat/thresholded_relu' of https://github.com/0x73e/orion …

…into pr/391
gizatechxyz · Oct 24, 2023 · 575c127 · 575c127
2 parents b7310dc + 63275cc
commit 575c127
Show file tree

Hide file tree

Showing 4 changed files with 4 additions and 0 deletions.
diff --git a/docs/SUMMARY.md b/docs/SUMMARY.md
@@ -97,6 +97,7 @@
     * [nn.softplus](framework/operators/neural-network/nn.softplus.md)
     * [nn.linear](framework/operators/neural-network/nn.linear.md)
     * [nn.hard\_sigmoid](framework/operators/neural-network/nn.hard\_sigmoid.md)
+    * [nn.thresholded\_relu](framework/operators/neural-network/nn.thresholded_relu.md)
   * [Machine Learning](framework/operators/machine-learning/README.md)
     * [Tree Regressor](framework/operators/machine-learning/tree-regressor/README.md)
       * [tree.predict](framework/operators/machine-learning/tree-regressor/tree.predict.md)

diff --git a/docs/framework/compatibility.md b/docs/framework/compatibility.md
@@ -34,6 +34,7 @@ You can see below the list of current supported ONNX Operators:
 |          [Flatten](operators/tensor/tensor.flatten.md)          | :white\_check\_mark: |
 |           [Relu](operators/neural-network/nn.relu.md)           | :white\_check\_mark: |
 |     [LeakyRelu](operators/neural-network/nn.leaky\_relu.md)     | :white\_check\_mark: |
+|[ThresholdedRelu](operators/neural-network/nn.thresholded\_relu.md)| :white\_check\_mark: |
 |        [Sigmoid](operators/neural-network/nn.sigmoid.md)        | :white\_check\_mark: |
 |        [Softmax](operators/neural-network/nn.softmax.md)        | :white\_check\_mark: |
 |     [LogSoftmax](operators/neural-network/nn.logsoftmax.md)     | :white\_check\_mark: |

diff --git a/docs/framework/operators/neural-network/README.md b/docs/framework/operators/neural-network/README.md
@@ -32,4 +32,5 @@ Orion supports currently these `NN` types.
 | [`nn.softplus`](nn.softplus.md) | Applies the Softplus function element-wise. |
 | [`nn.linear`](nn.linear.md) | Performs a linear transformation of the input tensor using the provided weights and bias. |
 | [`nn.hard_sigmoid`](nn.hard\_sigmoid.md) | Applies the Hard Sigmoid function to an n-dimensional input tensor. |
+| [`nn.thresholded_relu`](nn.thresholded\_relu.md) | performs the thresholded relu activation function element-wise. |
 
diff --git a/src/operators/nn/core.cairo b/src/operators/nn/core.cairo
@@ -11,6 +11,7 @@ use orion::operators::tensor::core::Tensor;
 /// softplus - Applies the Softplus function element-wise.
 /// linear - Performs a linear transformation of the input tensor using the provided weights and bias.
 /// hard_sigmoid - Applies the Hard Sigmoid function to an n-dimensional input tensor.
+/// thresholded_relu - performs the thresholded relu activation function element-wise.
 trait NNTrait<T> {
     /// # NNTrait::relu
     ///