What are two of the characteristics of using online prediction rather than batch prediction?
It is optimized to handle a high volume of data instances in a job and to run more complex models.
Predictions are returned in the response message.
Predictions are written to output files in a Cloud Storage location that you specify.
It is optimized to minimize the latency of serving predictions.
Online prediction
Optimized to minimize the latency of serving predictions.
Predictions returned in the response message.
Batch prediction
Optimized to handle a high volume of instances in a job and to run more complex models.
Predictions written to output files in a Cloud Storage location that you specify.
Submit