Copyright | (c) 2013-2021 Brendan Hay |
---|---|
License | Mozilla Public License, v. 2.0. |
Maintainer | Brendan Hay <brendan.g.hay+amazonka@gmail.com> |
Stability | auto-generated |
Portability | non-portable (GHC extensions) |
Safe Haskell | None |
Provides metrics on the accuracy of the models that were trained by the CreatePredictor operation. Use metrics to see how well the model performed and to decide whether to use the predictor to generate a forecast. For more information, see Predictor Metrics.
This operation generates metrics for each backtest window that was
evaluated. The number of backtest windows (NumberOfBacktestWindows
) is
specified using the EvaluationParameters object, which is optionally
included in the CreatePredictor
request. If NumberOfBacktestWindows
isn't specified, the number defaults to one.
The parameters of the filling
method determine which items contribute
to the metrics. If you want all items to contribute, specify zero
. If
you want only those items that have complete data in the range being
evaluated to contribute, specify nan
. For more information, see
FeaturizationMethod.
Before you can get accuracy metrics, the Status
of the predictor must
be ACTIVE
, signifying that training has completed. To get the status,
use the DescribePredictor operation.
Synopsis
- data GetAccuracyMetrics = GetAccuracyMetrics' {
- predictorArn :: Text
- newGetAccuracyMetrics :: Text -> GetAccuracyMetrics
- getAccuracyMetrics_predictorArn :: Lens' GetAccuracyMetrics Text
- data GetAccuracyMetricsResponse = GetAccuracyMetricsResponse' {}
- newGetAccuracyMetricsResponse :: Int -> GetAccuracyMetricsResponse
- getAccuracyMetricsResponse_predictorEvaluationResults :: Lens' GetAccuracyMetricsResponse (Maybe [EvaluationResult])
- getAccuracyMetricsResponse_optimizationMetric :: Lens' GetAccuracyMetricsResponse (Maybe OptimizationMetric)
- getAccuracyMetricsResponse_autoMLOverrideStrategy :: Lens' GetAccuracyMetricsResponse (Maybe AutoMLOverrideStrategy)
- getAccuracyMetricsResponse_httpStatus :: Lens' GetAccuracyMetricsResponse Int
Creating a Request
data GetAccuracyMetrics Source #
See: newGetAccuracyMetrics
smart constructor.
GetAccuracyMetrics' | |
|
Instances
newGetAccuracyMetrics Source #
Create a value of GetAccuracyMetrics
with all optional fields omitted.
Use generic-lens or optics to modify other optional fields.
The following record fields are available, with the corresponding lenses provided for backwards compatibility:
$sel:predictorArn:GetAccuracyMetrics'
, getAccuracyMetrics_predictorArn
- The Amazon Resource Name (ARN) of the predictor to get metrics for.
Request Lenses
getAccuracyMetrics_predictorArn :: Lens' GetAccuracyMetrics Text Source #
The Amazon Resource Name (ARN) of the predictor to get metrics for.
Destructuring the Response
data GetAccuracyMetricsResponse Source #
See: newGetAccuracyMetricsResponse
smart constructor.
GetAccuracyMetricsResponse' | |
|
Instances
newGetAccuracyMetricsResponse Source #
Create a value of GetAccuracyMetricsResponse
with all optional fields omitted.
Use generic-lens or optics to modify other optional fields.
The following record fields are available, with the corresponding lenses provided for backwards compatibility:
$sel:predictorEvaluationResults:GetAccuracyMetricsResponse'
, getAccuracyMetricsResponse_predictorEvaluationResults
- An array of results from evaluating the predictor.
$sel:optimizationMetric:GetAccuracyMetricsResponse'
, getAccuracyMetricsResponse_optimizationMetric
- The accuracy metric used to optimize the predictor.
$sel:autoMLOverrideStrategy:GetAccuracyMetricsResponse'
, getAccuracyMetricsResponse_autoMLOverrideStrategy
- The LatencyOptimized
AutoML override strategy is only available in
private beta. Contact AWS Support or your account manager to learn more
about access privileges.
The AutoML strategy used to train the predictor. Unless
LatencyOptimized
is specified, the AutoML strategy optimizes predictor
accuracy.
This parameter is only valid for predictors trained using AutoML.
$sel:httpStatus:GetAccuracyMetricsResponse'
, getAccuracyMetricsResponse_httpStatus
- The response's http status code.
Response Lenses
getAccuracyMetricsResponse_predictorEvaluationResults :: Lens' GetAccuracyMetricsResponse (Maybe [EvaluationResult]) Source #
An array of results from evaluating the predictor.
getAccuracyMetricsResponse_optimizationMetric :: Lens' GetAccuracyMetricsResponse (Maybe OptimizationMetric) Source #
The accuracy metric used to optimize the predictor.
getAccuracyMetricsResponse_autoMLOverrideStrategy :: Lens' GetAccuracyMetricsResponse (Maybe AutoMLOverrideStrategy) Source #
The LatencyOptimized
AutoML override strategy is only available in
private beta. Contact AWS Support or your account manager to learn more
about access privileges.
The AutoML strategy used to train the predictor. Unless
LatencyOptimized
is specified, the AutoML strategy optimizes predictor
accuracy.
This parameter is only valid for predictors trained using AutoML.
getAccuracyMetricsResponse_httpStatus :: Lens' GetAccuracyMetricsResponse Int Source #
The response's http status code.