Skip to content

Commit

Permalink
Fix broken predict_batch_udf links (#489)
Browse files Browse the repository at this point in the history
Signed-off-by: Rishi Chandra <rishic@nvidia.com>
  • Loading branch information
rishic3 authored Feb 6, 2025
1 parent 7561c5f commit 59b4920
Show file tree
Hide file tree
Showing 12 changed files with 12 additions and 12 deletions.
2 changes: 1 addition & 1 deletion examples/ML+DL-Examples/Spark-DL/dl_inference/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Deep Learning Inference on Spark

Example notebooks demonstrating **distributed deep learning inference** using the [predict_batch_udf](https://developer.nvidia.com/blog/distributed-deep-learning-made-easy-with-spark-3-4/) introduced in Spark 3.4.0.
Example notebooks demonstrating **distributed deep learning inference** using the [predict_batch_udf](https://developer.nvidia.com/blog/distributed-deep-learning-made-easy-with-spark-3-4/#distributed_inference) introduced in Spark 3.4.0.
These notebooks also demonstrate integration with [Triton Inference Server](https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html), an open-source, GPU-accelerated serving solution for DL.

## Contents:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -561,7 +561,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses Tensorflow APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -622,7 +622,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses PyTorch APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -564,7 +564,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses Tensorflow APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -461,7 +461,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses PyTorch APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -395,7 +395,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses PyTorch APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -1151,7 +1151,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses PyTorch APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -1743,7 +1743,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses PyTorch APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -1000,7 +1000,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses Tensorflow APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -1160,7 +1160,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses Tensorflow APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -613,7 +613,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses Tensorflow APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -1374,7 +1374,7 @@
"source": [
"## Inference using Spark DL API\n",
"\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/3.4.0/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"Distributed inference using the PySpark [predict_batch_udf](https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.ml.functions.predict_batch_udf.html#pyspark.ml.functions.predict_batch_udf):\n",
"\n",
"- predict_batch_fn uses Tensorflow APIs to load the model and return a predict function which operates on numpy arrays \n",
"- predict_batch_udf will convert the Spark DataFrame columns into numpy input batches for the predict function"
Expand Down

0 comments on commit 59b4920

Please sign in to comment.