Acceptance Tests - YakDriver/fardvag GitHub Wiki

Acceptance Tests Failures

acm (7)

  • TestAccAWSAcmCertificateValidation_basic
  • TestAccAWSAcmCertificateValidation_validationRecordFqdns
  • TestAccAWSAcmCertificateValidation_validationRecordFqdnsRoot
  • TestAccAWSAcmCertificateValidation_validationRecordFqdnsRootAndWildcard
  • TestAccAWSAcmCertificateValidation_validationRecordFqdnsSan
  • TestAccAWSAcmCertificateValidation_validationRecordFqdnsWildcard
  • TestAccAWSAcmCertificateValidation_validationRecordFqdnsWildcardAndRoot

apigateway (1)

  • TestAccAWSAPIGatewayV2DomainName_MutualTlsAuthentication

applicationautoscaling (5)

  • TestAccAWSAppautoScalingPolicy_spotFleetRequest
  • TestAccAWSAppautoscalingScheduledAction_EMR
  • TestAccAWSAppautoscalingScheduledAction_SpotFleet
  • TestAccAWSAppautoScalingTarget_emrCluster
  • TestAccAWSAppautoScalingTarget_spotFleetRequest

backup (1)

  • TestAccAwsBackupRegionSettings_basic

codebuild (4)

  • TestAccAWSCodeBuildProject_ARMContainer
  • TestAccAWSCodeBuildProject_Cache
  • TestAccAWSCodeBuildProject_Environment_EnvironmentVariable_Type
  • TestAccAWSCodeBuildProject_WindowsServer2019Container

cognitoidentityprovider (2)

  • TestAccAWSCognitoUserPool_withAdvancedSecurityMode
  • TestAccAWSCognitoUserPoolClient_analyticsConfig

directconnect (9)

  • TestAccAWSDxConnection_basic
  • TestAccAWSDxConnection_tags
  • TestAccAWSDxConnectionAssociation_basic
  • TestAccAWSDxConnectionAssociation_multiConns
  • TestAccAwsDxGatewayAssociation_allowedPrefixesVpnGatewayCrossAccount
  • TestAccAwsDxGatewayAssociation_allowedPrefixesVpnGatewaySingleAccount
  • TestAccAwsDxGatewayAssociation_basicVpnGatewayCrossAccount
  • TestAccAWSDxLag_basic
  • TestAccAWSDxLag_tags

directoryservice (1)

  • TestAccAWSDirectoryServiceLogSubscription_basic

ec2 (38)

  • TestAccAWSDefaultSecurityGroup_Vpc_empty
  • TestAccAWSDefaultVpcDhcpOptions_basic
  • TestAccAWSEBSVolume_multiAttach
  • TestAccAWSEBSVolume_updateIops_Io2
  • TestAccAwsEc2ClientVpn_serial
  • TestAccAwsEc2ManagedPrefixList_AddressFamily_IPv6
  • TestAccAwsEc2ManagedPrefixList_basic
  • TestAccAwsEc2ManagedPrefixList_disappears
  • TestAccAwsEc2ManagedPrefixList_Entry
  • TestAccAwsEc2ManagedPrefixList_Name
  • TestAccAwsEc2ManagedPrefixList_Tags
  • TestAccAWSEc2TransitGatewayPeeringAttachment_differentAccount
  • TestAccAWSEc2TransitGatewayPeeringAttachment_Tags_sameAccount
  • TestAccAWSEc2TransitGatewayRoute_disappears
  • TestAccAWSInstance_dedicatedInstance
  • TestAccAWSInstance_EbsRootDevice_ModifyIOPS_Io2
  • TestAccAWSInstance_enclaveOptions
  • TestAccAWSInstanceDataSource_enclaveOptions
  • TestAccAWSRouteTable_VpcClassicLink
  • TestAccAWSSecurityGroup_ruleLimitCidrBlockExceededAppend
  • TestAccAWSSecurityGroup_ruleLimitExceededAllNew
  • TestAccAWSSecurityGroup_ruleLimitExceededAppend
  • TestAccAWSSecurityGroup_ruleLimitExceededPrepend
  • TestAccAWSVpc_classiclinkDnsSupportOptionSet
  • TestAccAWSVpc_classiclinkOptionSet
  • TestAccAWSVPCPeeringConnectionAccepter_differentRegionDifferentAccount
  • TestAccAWSVPCPeeringConnectionAccepter_sameRegionDifferentAccount
  • TestAccAWSVpnConnection_tunnelOptions
  • TestAccAWSVpnConnection_withEnableAcceleration
  • TestAccAWSVpnGateway_delete
  • TestAccAWSVpnGateway_reattach
  • TestAccAWSVpnGateway_tags
  • TestAccAWSVpnGatewayAttachment_basic
  • TestAccAWSVpnGatewayAttachment_disappears
  • TestAccAWSVPNGatewayRoutePropagation_basic
  • TestAccDataSourceAwsEc2ManagedPrefixList_basic
  • TestAccDataSourceAwsEc2ManagedPrefixList_filter
  • TestAccDataSourceAwsEc2ManagedPrefixList_matchesTooMany

ecr (1)

  • TestAccAWSEcrDataSource_ecrImage

ecs (1)

  • TestAccAWSEcsTaskDefinition_inferenceAccelerator

eks (1)

  • TestAccAWSEksNodeGroup_AmiType

elasticache (1)

  • TestAccAWSElasticacheReplicationGroup_useCmkKmsKeyId

elasticbeanstalk (4)

  • TestAccAWSBeanstalkConfigurationTemplate_basic
  • TestAccAWSBeanstalkConfigurationTemplate_Setting
  • TestAccAWSBeanstalkConfigurationTemplate_VPC
  • TestAccAWSBeanstalkEnv_cname_prefix

elasticsearchservice (1)

  • TestAccAWSElasticSearchDomainPolicy_basic

elbv2 (6)

  • TestAccAWSLB_networkLoadbalancerEIP
  • TestAccAWSLB_updatedSubnets
  • TestAccAWSLBListener_cognito
  • TestAccAWSLBListener_LoadBalancerArn_GatewayLoadBalancer
  • TestAccAWSLBListenerRule_cognito
  • TestAccDataSourceAWSLBListener_https

emr (4)

  • TestAccAWSEMRCluster_bootstrap_ordering
  • TestAccAWSEMRCluster_instance_fleet
  • TestAccAWSEMRCluster_instance_fleet_master_only
  • TestAccAwsEmrManagedScalingPolicy_disappears

fsx (20)

Issue #17109

#17105:

  • TestAccAWSFsxLustreFileSystem_autoImportPolicy
  • TestAccAWSFsxLustreFileSystem_basic
  • TestAccAWSFsxLustreFileSystem_disappears
  • TestAccAWSFsxLustreFileSystem_ExportPath
  • TestAccAWSFsxLustreFileSystem_ImportedFileChunkSize
  • TestAccAWSFsxLustreFileSystem_ImportPath
  • TestAccAWSFsxLustreFileSystem_SecurityGroupIds
  • TestAccAWSFsxLustreFileSystem_StorageCapacity
  • TestAccAWSFsxLustreFileSystem_Tags
  • TestAccAWSFsxLustreFileSystem_WeeklyMaintenanceStartTime

Two Support Tickets (increase limit on directories, remove indestructible directories):

  • TestAccAWSFsxWindowsFileSystem_CopyTagsToBackups
  • TestAccAWSFsxWindowsFileSystem_DailyAutomaticBackupStartTime
  • TestAccAWSFsxWindowsFileSystem_KmsKeyId
  • TestAccAWSFsxWindowsFileSystem_SecurityGroupIds
  • TestAccAWSFsxWindowsFileSystem_SelfManagedActiveDirectory
  • TestAccAWSFsxWindowsFileSystem_SelfManagedActiveDirectory_Username
  • TestAccAWSFsxWindowsFileSystem_StorageCapacity
  • TestAccAWSFsxWindowsFileSystem_Tags
  • TestAccAWSFsxWindowsFileSystem_ThroughputCapacity
  • TestAccAWSFsxWindowsFileSystem_WeeklyMaintenanceStartTime

glue (1)

  • TestAccGlueDevEndpoint_NumberOfWorkers

iot (3)

  • TestAccAWSIotEndpointDataSource_EndpointType_IOTData
  • TestAccAWSIoTTopicRule_iot_analytics
  • TestAccAWSIoTTopicRule_iot_events

kinesis (2)

  • TestAccAWSKinesisFirehoseDeliveryStream_ElasticsearchWithVpcConfigUpdates
  • TestAccAWSKinesisFirehoseDeliveryStream_RedshiftConfigUpdates

kms (5)

  • TestAccAWSKmsExternalKey_Policy
  • TestAccAWSKmsExternalKey_Tags
  • TestAccAWSKmsExternalKey_ValidTo
  • TestAccAWSKmsKey_policy
  • TestAccAWSKmsKey_tags

lambda (6)

  • TestAccAWSLambdaCodeSigningConfig_basic
  • TestAccAWSLambdaCodeSigningConfig_UpdatePolicy
  • TestAccAWSLambdaCodeSigningConfig_UpdatePublishers
  • TestAccDataSourceAWSLambdaCodeSigningConfig_basic
  • TestAccDataSourceAWSLambdaCodeSigningConfig_Description
  • TestAccDataSourceAWSLambdaCodeSigningConfig_PolicyConfigId

networkfirewall (1)

  • TestAccAwsNetworkFirewallRuleGroup_statefulRule_header

ram (1)

  • TestAccAwsRamResourceShareAccepter_basic

rds (13)

  • TestAccAWSDbEventCategories_basic
  • TestAccAWSDynamoDbTable_Replica_Multiple
  • TestAccAWSRDSCluster_BacktrackWindow
  • TestAccAWSRDSCluster_EnableHttpEndpoint
  • TestAccAWSRDSCluster_EngineMode
  • TestAccAWSRDSCluster_EngineMode_Multimaster
  • TestAccAWSRDSCluster_EngineMode_ParallelQuery
  • TestAccAWSRDSCluster_ReplicationSourceIdentifier_KmsKeyId
  • TestAccAWSRDSCluster_ScalingConfiguration
  • TestAccAWSRDSCluster_ScalingConfiguration_DefaultMinCapacity
  • TestAccAWSRDSCluster_SnapshotIdentifier_EngineMode_ParallelQuery
  • TestAccAWSRDSClusterEndpoint_basic
  • TestAccAWSRDSClusterEndpoint_tags

redshift (17)

  • TestAccAWSRedshiftCluster_basic
  • TestAccAWSRedshiftCluster_changeAvailabilityZone
  • TestAccAWSRedshiftCluster_changeEncryption1
  • TestAccAWSRedshiftCluster_changeEncryption2
  • TestAccAWSRedshiftCluster_enhancedVpcRoutingEnabled
  • TestAccAWSRedshiftCluster_forceNewUsername
  • TestAccAWSRedshiftCluster_iamRoles
  • TestAccAWSRedshiftCluster_kmsKey
  • TestAccAWSRedshiftCluster_loggingEnabled
  • TestAccAWSRedshiftCluster_publiclyAccessible
  • TestAccAWSRedshiftCluster_snapshotCopy
  • TestAccAWSRedshiftCluster_tags
  • TestAccAWSRedshiftCluster_updateNodeType
  • TestAccAWSRedshiftCluster_withFinalSnapshot
  • TestAccAWSRedshiftSnapshotCopyGrant_Update
  • TestAccAWSRedshiftSnapshotSchedule_withForceDestroy
  • TestAccAWSRedshiftSnapshotScheduleAssociation_basic

route53 (2)

  • TestAccAWSRoute53Record_Alias_VpcEndpoint
  • TestAccAWSRoute53ResolverRulesDataSource_ResolverEndpointId

s3 (3)

  • TestAccAWSS3Account_serial
  • TestAccAWSS3BucketObject_updatesWithVersioning
  • TestAccDataSourceAwsCanonicalUserId_basic

sagemaker (9)

  • TestAccAWSSagemakerCodeRepository_basic
  • TestAccAWSSagemakerCodeRepository_disappears
  • TestAccAWSSagemakerCodeRepository_gitConfig_branch
  • TestAccAWSSagemakerCodeRepository_gitConfig_secret
  • TestAccAWSSagemakerEndpoint_basic
  • TestAccAWSSagemakerEndpoint_EndpointConfigName
  • TestAccAWSSagemakerEndpoint_Tags
  • TestAccAWSSagemakerEndpointConfiguration_productionVariants_AcceleratorType
  • TestAccAWSSagemakerNotebookInstance_default_code_repository_sagemakerRepo

secretsmanager (2)

  • TestAccAwsSecretsManagerSecretVersion_Base64Binary
  • TestAccAwsSecretsManagerSecretVersion_BasicString

sns (1)

  • TestAccAWSSNSTopic_deliveryStatus

sqs (1)

  • TestAccAWSSQSQueue_basic

ssm (1)

  • TestAccAWSSSMDocument_package

storagegateway (7)

  • TestAccAWSStorageGatewayGateway_SmbActiveDirectorySettings
  • TestAccAWSStorageGatewayGateway_SmbActiveDirectorySettings_timeout
  • TestAccAWSStorageGatewaySmbFileShare_AdminUserList
  • TestAccAWSStorageGatewaySmbFileShare_Authentication_ActiveDirectory
  • TestAccAWSStorageGatewaySmbFileShare_InvalidUserList
  • TestAccAWSStorageGatewaySmbFileShare_smb_acl
  • TestAccAWSStorageGatewaySmbFileShare_ValidUserList

transfer (12)

  • TestAccAWSTransferServer_basic
  • TestAccAWSTransferServer_disappears
  • TestAccAWSTransferServer_forcedestroy
  • TestAccAWSTransferServer_hostKey
  • TestAccAWSTransferServer_vpcEndpointId
  • TestAccAWSTransferSshKey_basic
  • TestAccAWSTransferUser_basic
  • TestAccAWSTransferUser_disappears
  • TestAccAWSTransferUser_homeDirectoryMappings
  • TestAccAWSTransferUser_modifyWithOptions
  • TestAccDataSourceAwsTransferServer_basic
  • TestAccDataSourceAwsTransferServer_service_managed

workspaces (2)

  • TestAccAwsWorkspacesDirectory_ipGroupIds
  • TestAccDataSourceAwsWorkspacesDirectory_basic

Multi Failures (Both GovCloud & Commercial)

Currently not actively working (69):

  • TestAccAWSAcmCertificateDataSource_multipleIssued
  • TestAccAWSAcmCertificateDataSource_singleIssued
  • TestAccAWSAutoscalingAttachment_albTargetGroup
  • TestAccAWSCodeBuildProject_Source_Auth
  • TestAccAWSCodeBuildWebhook_Bitbucket
  • TestAccAWSCodeBuildWebhook_BranchFilter
  • TestAccAWSCodeBuildWebhook_FilterGroup
  • TestAccAWSCodeBuildWebhook_GitHub
  • TestAccAWSCodeBuildWebhook_GitHubEnterprise
  • TestAccAWSDBInstance_DbSubnetGroupName_RamShared
  • TestAccAWSDBInstance_MSSQL_Domain
  • TestAccAWSDBInstance_MSSQL_DomainSnapshotRestore
  • TestAccAWSDBInstance_MSSQL_TZ
  • TestAccAWSDBInstance_ReplicateSourceDb_DbSubnetGroupName_RamShared
  • TestAccAWSDBInstance_S3Import
  • TestAccAWSDBInstance_SnapshotIdentifier_DbSubnetGroupName_RamShared
  • TestAccAWSDefaultRouteTable_IPv4_To_VpcEndpoint
  • TestAccAWSDmsReplicationTask_basic
  • TestAccAWSEc2TransitGatewayVpcAttachment_SharedTransitGateway
  • TestAccAWSEc2TransitGatewayVpcAttachmentAccepter_basic
  • TestAccAWSEc2TransitGatewayVpcAttachmentAccepter_Tags
  • TestAccAWSEc2TransitGatewayVpcAttachmentAccepter_TransitGatewayDefaultRouteTableAssociationAndPropagation
  • TestAccAWSEcsService_withLaunchTypeFargateAndPlatformVersion
  • TestAccAWSElasticacheParameterGroup_switchReservedMemoryParameter
  • TestAccAWSElasticacheParameterGroup_updateReservedMemoryParameter
  • TestAccAwsEmrManagedScalingPolicy_basic
  • TestAccAwsEmrManagedScalingPolicy_ComputeLimits_MaximumCoreCapacityUnits
  • TestAccAwsEmrManagedScalingPolicy_ComputeLimits_MaximumOndemandCapacityUnits
  • TestAccAWSFmsPolicy_basic
  • TestAccAWSFmsPolicy_includeMap
  • TestAccAWSFmsPolicy_tags
  • TestAccAWSFmsPolicy_update
  • TestAccAWSGlueCrawler_CatalogTarget
  • TestAccAWSGlueCrawler_CatalogTarget_Multiple
  • TestAccAWSIAMAccountAlias_serial
  • TestAccAWSIoTPolicy_invalidJson
  • TestAccAWSKinesisFirehoseDeliveryStream_ExtendedS3_DataFormatConversionConfiguration_Deserializer_Update
  • TestAccAWSKinesisFirehoseDeliveryStream_ExtendedS3_DataFormatConversionConfiguration_Enabled
  • TestAccAWSKinesisFirehoseDeliveryStream_ExtendedS3_DataFormatConversionConfiguration_HiveJsonSerDe_Empty
  • TestAccAWSKinesisFirehoseDeliveryStream_ExtendedS3_DataFormatConversionConfiguration_OpenXJsonSerDe_Empty
  • TestAccAWSKinesisFirehoseDeliveryStream_ExtendedS3_DataFormatConversionConfiguration_OrcSerDe_Empty
  • TestAccAWSKinesisFirehoseDeliveryStream_ExtendedS3_DataFormatConversionConfiguration_ParquetSerDe_Empty
  • TestAccAWSKinesisFirehoseDeliveryStream_ExtendedS3_DataFormatConversionConfiguration_Serializer_Update
  • TestAccAwsMskScramSecretAssociation_update
  • TestAccAwsRamResourceAssociation_basic
  • TestAccAwsRamResourceAssociation_disappears
  • TestAccAWSRDSCluster_s3Restore
  • TestAccAWSRedshiftCluster_updateNodeCount
  • TestAccAWSRoute53ResolverRuleDataSource_SharedByMe
  • TestAccAWSRoute53ResolverRuleDataSource_SharedWithMe
  • TestAccAWSRouteDataSource_basic
  • TestAccAWSSagemakerEndpointConfiguration_tags
  • TestAccAWSSagemakerImage_basic
  • TestAccAWSSagemakerImage_description
  • TestAccAWSSagemakerImage_disappears
  • TestAccAWSSagemakerImage_displayName
  • TestAccAWSSagemakerImage_tags
  • TestAccAWSSagemakerModel_tags
  • TestAccAwsSecretsManagerSecret_policy
  • TestAccAWSSecurityHub_serial
  • TestAccAWSSfnStateMachine_createUpdate
  • TestAccAWSVPCPeeringConnection_region
  • TestAccAwsWorkspacesIpGroup_MultipleDirectories
  • TestAccDataSourceAwsRouteTable_basic
  • TestAccDataSourceAwsSecretsManagerSecretRotation_basic
  • TestAccDataSourceAwsSecretsManagerSecretVersion_VersionID
  • TestAccDataSourceAwsVpcPeeringConnection_basic
  • TestAccDataSourceAwsWorkspacesWorkspace_byDirectoryID_userName
  • TestAccDataSourceAwsWorkspacesWorkspace_byWorkspaceID