openapi: 3.0.0 info: version: 2017-07-25 x-release: v4 title: AWS Glue DataBrew Datasets Rulesets API description: Glue DataBrew is a visual, cloud-scale data-preparation service. DataBrew simplifies data preparation tasks, targeting data issues that are hard to spot and time-consuming to fix. DataBrew empowers users of all technical levels to visualize the data and perform one-click data transformations, with no coding required. x-logo: url: https://api.apis.guru/v2/cache/logo/https_twitter.com_awscloud_profile_image.png backgroundColor: '#FFFFFF' termsOfService: https://aws.amazon.com/service-terms/ contact: name: Mike Ralphson email: mike.ralphson@gmail.com url: https://github.com/mermade/aws2openapi x-twitter: PermittedSoc license: name: Apache 2.0 License url: http://www.apache.org/licenses/ x-providerName: amazonaws.com x-serviceName: databrew x-aws-signingName: databrew x-origin: - contentType: application/json url: https://raw.githubusercontent.com/aws/aws-sdk-js/master/apis/databrew-2017-07-25.normal.json converter: url: https://github.com/mermade/aws2openapi version: 1.0.0 x-apisguru-driver: external x-apiClientRegistration: url: https://portal.aws.amazon.com/gp/aws/developer/registration/index.html?nc2=h_ct x-apisguru-categories: - cloud x-preferred: true servers: - url: http://databrew.{region}.amazonaws.com variables: region: description: The AWS region enum: - us-east-1 - us-east-2 - us-west-1 - us-west-2 - us-gov-west-1 - us-gov-east-1 - ca-central-1 - eu-north-1 - eu-west-1 - eu-west-2 - eu-west-3 - eu-central-1 - eu-south-1 - af-south-1 - ap-northeast-1 - ap-northeast-2 - ap-northeast-3 - ap-southeast-1 - ap-southeast-2 - ap-east-1 - ap-south-1 - sa-east-1 - me-south-1 default: us-east-1 description: The AWS Glue DataBrew multi-region endpoint - url: https://databrew.{region}.amazonaws.com variables: region: description: The AWS region enum: - us-east-1 - us-east-2 - us-west-1 - us-west-2 - us-gov-west-1 - us-gov-east-1 - ca-central-1 - eu-north-1 - eu-west-1 - eu-west-2 - eu-west-3 - eu-central-1 - eu-south-1 - af-south-1 - ap-northeast-1 - ap-northeast-2 - ap-northeast-3 - ap-southeast-1 - ap-southeast-2 - ap-east-1 - ap-south-1 - sa-east-1 - me-south-1 default: us-east-1 description: The AWS Glue DataBrew multi-region endpoint - url: http://databrew.{region}.amazonaws.com.cn variables: region: description: The AWS region enum: - cn-north-1 - cn-northwest-1 default: cn-north-1 description: The AWS Glue DataBrew endpoint for China (Beijing) and China (Ningxia) - url: https://databrew.{region}.amazonaws.com.cn variables: region: description: The AWS region enum: - cn-north-1 - cn-northwest-1 default: cn-north-1 description: The AWS Glue DataBrew endpoint for China (Beijing) and China (Ningxia) security: - hmac: [] tags: - name: Rulesets paths: /rulesets: parameters: - $ref: '#/components/parameters/X-Amz-Content-Sha256' - $ref: '#/components/parameters/X-Amz-Date' - $ref: '#/components/parameters/X-Amz-Algorithm' - $ref: '#/components/parameters/X-Amz-Credential' - $ref: '#/components/parameters/X-Amz-Security-Token' - $ref: '#/components/parameters/X-Amz-Signature' - $ref: '#/components/parameters/X-Amz-SignedHeaders' post: operationId: CreateRuleset description: Creates a new ruleset that can be used in a profile job to validate the data quality of a dataset. responses: '200': description: Success content: application/json: schema: $ref: '#/components/schemas/CreateRulesetResponse' examples: CreateRuleset200Example: summary: Default CreateRuleset 200 response x-microcks-default: true value: status: SUCCEEDED '480': description: ConflictException content: application/json: schema: $ref: '#/components/schemas/ConflictException' examples: CreateRuleset480Example: summary: Default CreateRuleset 480 response x-microcks-default: true value: status: SUCCEEDED '481': description: ServiceQuotaExceededException content: application/json: schema: $ref: '#/components/schemas/ServiceQuotaExceededException' examples: CreateRuleset481Example: summary: Default CreateRuleset 481 response x-microcks-default: true value: status: SUCCEEDED '482': description: ValidationException content: application/json: schema: $ref: '#/components/schemas/ValidationException' examples: CreateRuleset482Example: summary: Default CreateRuleset 482 response x-microcks-default: true value: status: SUCCEEDED parameters: [] requestBody: required: true content: application/json: schema: type: object required: - Name - TargetArn - Rules properties: Name: description: The name of the ruleset to be created. Valid characters are alphanumeric (A-Z, a-z, 0-9), hyphen (-), period (.), and space. type: string minLength: 1 maxLength: 255 Description: description: The description of the ruleset. type: string maxLength: 1024 TargetArn: description: The Amazon Resource Name (ARN) of a resource (dataset) that the ruleset is associated with. type: string minLength: 20 maxLength: 2048 Rules: description: A list of rules that are defined with the ruleset. A rule includes one or more checks to be validated on a DataBrew dataset. type: array items: $ref: '#/components/schemas/Rule' minItems: 1 Tags: description: Metadata tags to apply to the ruleset. type: object minProperties: 1 maxProperties: 200 additionalProperties: $ref: '#/components/schemas/TagValue' summary: Amazon Glue DataBrew Create Ruleset x-microcks-operation: delay: 0 dispatcher: FALLBACK tags: - Rulesets get: operationId: ListRulesets description: List all rulesets available in the current account or rulesets associated with a specific resource (dataset). responses: '200': description: Success content: application/json: schema: $ref: '#/components/schemas/ListRulesetsResponse' examples: ListRulesets200Example: summary: Default ListRulesets 200 response x-microcks-default: true value: status: SUCCEEDED '480': description: ResourceNotFoundException content: application/json: schema: $ref: '#/components/schemas/ResourceNotFoundException' examples: ListRulesets480Example: summary: Default ListRulesets 480 response x-microcks-default: true value: status: SUCCEEDED '481': description: ValidationException content: application/json: schema: $ref: '#/components/schemas/ValidationException' examples: ListRulesets481Example: summary: Default ListRulesets 481 response x-microcks-default: true value: status: SUCCEEDED parameters: - name: targetArn in: query required: false description: The Amazon Resource Name (ARN) of a resource (dataset). Using this parameter indicates to return only those rulesets that are associated with the specified resource. schema: type: string minLength: 20 maxLength: 2048 - name: maxResults in: query required: false description: The maximum number of results to return in this request. schema: type: integer minimum: 1 maximum: 100 - name: nextToken in: query required: false description: A token generated by DataBrew that specifies where to continue pagination if a previous request was truncated. To get the next set of pages, pass in the NextToken value from the response object of the previous page call. schema: type: string minLength: 1 maxLength: 2000 - name: MaxResults in: query schema: type: string description: Pagination limit required: false - name: NextToken in: query schema: type: string description: Pagination token required: false summary: Amazon Glue DataBrew List Rulesets x-microcks-operation: delay: 0 dispatcher: FALLBACK tags: - Rulesets /rulesets/{name}: parameters: - $ref: '#/components/parameters/X-Amz-Content-Sha256' - $ref: '#/components/parameters/X-Amz-Date' - $ref: '#/components/parameters/X-Amz-Algorithm' - $ref: '#/components/parameters/X-Amz-Credential' - $ref: '#/components/parameters/X-Amz-Security-Token' - $ref: '#/components/parameters/X-Amz-Signature' - $ref: '#/components/parameters/X-Amz-SignedHeaders' delete: operationId: DeleteRuleset description: Deletes a ruleset. responses: '200': description: Success content: application/json: schema: $ref: '#/components/schemas/DeleteRulesetResponse' examples: DeleteRuleset200Example: summary: Default DeleteRuleset 200 response x-microcks-default: true value: status: SUCCEEDED '480': description: ResourceNotFoundException content: application/json: schema: $ref: '#/components/schemas/ResourceNotFoundException' examples: DeleteRuleset480Example: summary: Default DeleteRuleset 480 response x-microcks-default: true value: status: SUCCEEDED '481': description: ValidationException content: application/json: schema: $ref: '#/components/schemas/ValidationException' examples: DeleteRuleset481Example: summary: Default DeleteRuleset 481 response x-microcks-default: true value: status: SUCCEEDED '482': description: ConflictException content: application/json: schema: $ref: '#/components/schemas/ConflictException' examples: DeleteRuleset482Example: summary: Default DeleteRuleset 482 response x-microcks-default: true value: status: SUCCEEDED parameters: - name: name in: path required: true description: The name of the ruleset to be deleted. schema: type: string minLength: 1 maxLength: 255 summary: Amazon Glue DataBrew Delete Ruleset x-microcks-operation: delay: 0 dispatcher: FALLBACK tags: - Rulesets get: operationId: DescribeRuleset description: Retrieves detailed information about the ruleset. responses: '200': description: Success content: application/json: schema: $ref: '#/components/schemas/DescribeRulesetResponse' examples: DescribeRuleset200Example: summary: Default DescribeRuleset 200 response x-microcks-default: true value: status: SUCCEEDED '480': description: ResourceNotFoundException content: application/json: schema: $ref: '#/components/schemas/ResourceNotFoundException' examples: DescribeRuleset480Example: summary: Default DescribeRuleset 480 response x-microcks-default: true value: status: SUCCEEDED '481': description: ValidationException content: application/json: schema: $ref: '#/components/schemas/ValidationException' examples: DescribeRuleset481Example: summary: Default DescribeRuleset 481 response x-microcks-default: true value: status: SUCCEEDED parameters: - name: name in: path required: true description: The name of the ruleset to be described. schema: type: string minLength: 1 maxLength: 255 summary: Amazon Glue DataBrew Describe Ruleset x-microcks-operation: delay: 0 dispatcher: FALLBACK tags: - Rulesets put: operationId: UpdateRuleset description: Updates specified ruleset. responses: '200': description: Success content: application/json: schema: $ref: '#/components/schemas/UpdateRulesetResponse' examples: UpdateRuleset200Example: summary: Default UpdateRuleset 200 response x-microcks-default: true value: status: SUCCEEDED '480': description: ResourceNotFoundException content: application/json: schema: $ref: '#/components/schemas/ResourceNotFoundException' examples: UpdateRuleset480Example: summary: Default UpdateRuleset 480 response x-microcks-default: true value: status: SUCCEEDED '481': description: ValidationException content: application/json: schema: $ref: '#/components/schemas/ValidationException' examples: UpdateRuleset481Example: summary: Default UpdateRuleset 481 response x-microcks-default: true value: status: SUCCEEDED parameters: - name: name in: path required: true description: The name of the ruleset to be updated. schema: type: string minLength: 1 maxLength: 255 requestBody: required: true content: application/json: schema: type: object required: - Rules properties: Description: description: The description of the ruleset. type: string maxLength: 1024 Rules: description: A list of rules that are defined with the ruleset. A rule includes one or more checks to be validated on a DataBrew dataset. type: array items: $ref: '#/components/schemas/Rule' minItems: 1 summary: Amazon Glue DataBrew Update Ruleset x-microcks-operation: delay: 0 dispatcher: FALLBACK tags: - Rulesets components: schemas: ColumnSelectorList: type: array items: $ref: '#/components/schemas/ColumnSelector' minItems: 1 ValuesMap: type: object additionalProperties: $ref: '#/components/schemas/ConditionValue' RuleName: type: string minLength: 1 maxLength: 128 AccountId: type: string maxLength: 255 Expression: type: string pattern: ^[<>0-9A-Za-z_.,:)(!= ]+$ minLength: 4 maxLength: 1024 TagValue: type: string maxLength: 256 DeleteRulesetResponse: type: object required: - Name properties: Name: allOf: - $ref: '#/components/schemas/RulesetName' - description: The name of the deleted ruleset. ThresholdValue: type: number format: double minimum: 0 ConflictException: {} ListRulesetsResponse: type: object required: - Rulesets properties: Rulesets: allOf: - $ref: '#/components/schemas/RulesetItemList' - description: A list of RulesetItem. RulesetItem contains meta data of a ruleset. NextToken: allOf: - $ref: '#/components/schemas/NextToken' - description: A token that you can use in a subsequent call to retrieve the next set of results. ColumnSelector: type: object properties: Regex: allOf: - $ref: '#/components/schemas/ColumnName' - description: A regular expression for selecting a column from a dataset. Name: allOf: - $ref: '#/components/schemas/ColumnName' - description: The name of a column from a dataset. description: Selector of a column from a dataset for profile job configuration. One selector includes either a column name or a regular expression. ThresholdType: type: string enum: - GREATER_THAN_OR_EQUAL - LESS_THAN_OR_EQUAL - GREATER_THAN - LESS_THAN ServiceQuotaExceededException: {} CreateRulesetResponse: type: object required: - Name properties: Name: allOf: - $ref: '#/components/schemas/RulesetName' - description: The unique name of the created ruleset. ConditionValue: type: string maxLength: 1024 Date: type: string format: date-time Rule: type: object required: - Name - CheckExpression properties: Name: allOf: - $ref: '#/components/schemas/RuleName' - description: The name of the rule. Disabled: allOf: - $ref: '#/components/schemas/Disabled' - description: A value that specifies whether the rule is disabled. Once a rule is disabled, a profile job will not validate it during a job run. Default value is false. CheckExpression: allOf: - $ref: '#/components/schemas/Expression' - description:

The expression which includes column references, condition names followed by variable references, possibly grouped and combined with other conditions. For example, (:col1 starts_with :prefix1 or :col1 starts_with :prefix2) and (:col1 ends_with :suffix1 or :col1 ends_with :suffix2). Column and value references are substitution variables that should start with the ':' symbol. Depending on the context, substitution variables' values can be either an actual value or a column name. These values are defined in the SubstitutionMap. If a CheckExpression starts with a column reference, then ColumnSelectors in the rule should be null. If ColumnSelectors has been defined, then there should be no column reference in the left side of a condition, for example, is_between :val1 and :val2.

For more information, see Available checks

SubstitutionMap: allOf: - $ref: '#/components/schemas/ValuesMap' - description: 'The map of substitution variable names to their values used in a check expression. Variable names should start with a '':'' (colon). Variable values can either be actual values or column names. To differentiate between the two, column names should be enclosed in backticks, for example, ":col1": "`Column A`". ' Threshold: allOf: - $ref: '#/components/schemas/Threshold' - description: The threshold used with a non-aggregate check expression. Non-aggregate check expressions will be applied to each row in a specific column, and the threshold will be used to determine whether the validation succeeds. ColumnSelectors: allOf: - $ref: '#/components/schemas/ColumnSelectorList' - description: List of column selectors. Selectors can be used to select columns using a name or regular expression from the dataset. Rule will be applied to selected columns. description: Represents a single data quality requirement that should be validated in the scope of this dataset. ColumnName: type: string minLength: 1 maxLength: 255 ResourceNotFoundException: {} Threshold: type: object required: - Value properties: Value: allOf: - $ref: '#/components/schemas/ThresholdValue' - description: The value of a threshold. Type: allOf: - $ref: '#/components/schemas/ThresholdType' - description: The type of a threshold. Used for comparison of an actual count of rows that satisfy the rule to the threshold value. Unit: allOf: - $ref: '#/components/schemas/ThresholdUnit' - description: Unit of threshold value. Can be either a COUNT or PERCENTAGE of the full sample size used for validation. description: The threshold used with a non-aggregate check expression. The non-aggregate check expression will be applied to each row in a specific column. Then the threshold will be used to determine whether the validation succeeds. Disabled: type: boolean LastModifiedBy: type: string ThresholdUnit: type: string enum: - COUNT - PERCENTAGE CreatedBy: type: string RulesetItem: type: object required: - Name - TargetArn properties: AccountId: allOf: - $ref: '#/components/schemas/AccountId' - description: The ID of the Amazon Web Services account that owns the ruleset. CreatedBy: allOf: - $ref: '#/components/schemas/CreatedBy' - description: The Amazon Resource Name (ARN) of the user who created the ruleset. CreateDate: allOf: - $ref: '#/components/schemas/Date' - description: The date and time that the ruleset was created. Description: allOf: - $ref: '#/components/schemas/RulesetDescription' - description: The description of the ruleset. LastModifiedBy: allOf: - $ref: '#/components/schemas/LastModifiedBy' - description: The Amazon Resource Name (ARN) of the user who last modified the ruleset. LastModifiedDate: allOf: - $ref: '#/components/schemas/Date' - description: The modification date and time of the ruleset. Name: allOf: - $ref: '#/components/schemas/RulesetName' - description: The name of the ruleset. ResourceArn: allOf: - $ref: '#/components/schemas/Arn' - description: The Amazon Resource Name (ARN) for the ruleset. RuleCount: allOf: - $ref: '#/components/schemas/RuleCount' - description: The number of rules that are defined in the ruleset. Tags: allOf: - $ref: '#/components/schemas/TagMap' - description: Metadata tags that have been applied to the ruleset. TargetArn: allOf: - $ref: '#/components/schemas/Arn' - description: The Amazon Resource Name (ARN) of a resource (dataset) that the ruleset is associated with. description: Contains metadata about the ruleset. Arn: type: string minLength: 20 maxLength: 2048 NextToken: type: string minLength: 1 maxLength: 2000 RulesetDescription: type: string maxLength: 1024 RuleCount: type: integer minimum: 0 DescribeRulesetResponse: type: object required: - Name properties: Name: allOf: - $ref: '#/components/schemas/RulesetName' - description: The name of the ruleset. Description: allOf: - $ref: '#/components/schemas/RulesetDescription' - description: The description of the ruleset. TargetArn: allOf: - $ref: '#/components/schemas/Arn' - description: The Amazon Resource Name (ARN) of a resource (dataset) that the ruleset is associated with. Rules: allOf: - $ref: '#/components/schemas/RuleList' - description: A list of rules that are defined with the ruleset. A rule includes one or more checks to be validated on a DataBrew dataset. CreateDate: allOf: - $ref: '#/components/schemas/Date' - description: The date and time that the ruleset was created. CreatedBy: allOf: - $ref: '#/components/schemas/CreatedBy' - description: The Amazon Resource Name (ARN) of the user who created the ruleset. LastModifiedBy: allOf: - $ref: '#/components/schemas/LastModifiedBy' - description: The Amazon Resource Name (ARN) of the user who last modified the ruleset. LastModifiedDate: allOf: - $ref: '#/components/schemas/Date' - description: The modification date and time of the ruleset. ResourceArn: allOf: - $ref: '#/components/schemas/Arn' - description: The Amazon Resource Name (ARN) for the ruleset. Tags: allOf: - $ref: '#/components/schemas/TagMap' - description: Metadata tags that have been applied to the ruleset. ValidationException: {} UpdateRulesetResponse: type: object required: - Name properties: Name: allOf: - $ref: '#/components/schemas/RulesetName' - description: The name of the updated ruleset. RulesetName: type: string minLength: 1 maxLength: 255 RulesetItemList: type: array items: $ref: '#/components/schemas/RulesetItem' RuleList: type: array items: $ref: '#/components/schemas/Rule' minItems: 1 TagMap: type: object minProperties: 1 maxProperties: 200 additionalProperties: $ref: '#/components/schemas/TagValue' parameters: X-Amz-Credential: name: X-Amz-Credential in: header schema: type: string required: false X-Amz-Algorithm: name: X-Amz-Algorithm in: header schema: type: string required: false X-Amz-Content-Sha256: name: X-Amz-Content-Sha256 in: header schema: type: string required: false X-Amz-Security-Token: name: X-Amz-Security-Token in: header schema: type: string required: false X-Amz-SignedHeaders: name: X-Amz-SignedHeaders in: header schema: type: string required: false X-Amz-Date: name: X-Amz-Date in: header schema: type: string required: false X-Amz-Signature: name: X-Amz-Signature in: header schema: type: string required: false securitySchemes: hmac: type: apiKey name: Authorization in: header description: Amazon Signature authorization v4 x-amazon-apigateway-authtype: awsSigv4 externalDocs: description: Amazon Web Services documentation url: https://docs.aws.amazon.com/databrew/ x-hasEquivalentPaths: true