home.social

#s3express — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #s3express, aggregated by home.social.

fetched live
  1. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Amazon S3 introduces support for AWS Dedicated Local Zones.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  2. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Amazon S3 introduces support for AWS Dedicated Local Zones.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  3. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Amazon S3 introduces support for AWS Dedicated Local Zones.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  4. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Amazon S3 introduces support for AWS Dedicated Local Zones.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  5. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Amazon S3 introduces support for AWS Dedicated Local Zones.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  6. michabbb @[email protected] ·

    Modern Database Architecture: #Cloud Storage Evolution 🚀

    🔹 #ZeroDisk architecture leverages #AWS #S3 as primary storage, eliminating need for traditional disk management

    🔸 #Database systems gain instant scalability and elasticity through separation of compute and storage

    🔹 New approach enables three deployment options:
    - Direct #S3 writes
    - #S3Express as cache layer
    - #Raft cluster with S3 backend

    🔸 Major platforms adopting this architecture:
    #Snowflake, #Clickhouse, #Neon, #TiDB

    🔹 Trade-offs balance between latency, cost, and durability metrics

    🔸 Benefits include serverless operation, instant failover, and unlimited storage capacity

    avi.im/blag/2024/zero-disk-arc

    #DevOps

    #cloud #zerodisk #aws #s3 #database #s3express
  7. michabbb @[email protected] ·

    Modern Database Architecture: #Cloud Storage Evolution 🚀

    🔹 #ZeroDisk architecture leverages #AWS #S3 as primary storage, eliminating need for traditional disk management

    🔸 #Database systems gain instant scalability and elasticity through separation of compute and storage

    🔹 New approach enables three deployment options:
    - Direct #S3 writes
    - #S3Express as cache layer
    - #Raft cluster with S3 backend

    🔸 Major platforms adopting this architecture:
    #Snowflake, #Clickhouse, #Neon, #TiDB

    🔹 Trade-offs balance between latency, cost, and durability metrics

    🔸 Benefits include serverless operation, instant failover, and unlimited storage capacity

    avi.im/blag/2024/zero-disk-arc

    #DevOps

    #cloud #zerodisk #aws #s3 #database #s3express
  8. michabbb @[email protected] ·

    Modern Database Architecture: #Cloud Storage Evolution 🚀

    🔹 #ZeroDisk architecture leverages #AWS #S3 as primary storage, eliminating need for traditional disk management

    🔸 #Database systems gain instant scalability and elasticity through separation of compute and storage

    🔹 New approach enables three deployment options:
    - Direct #S3 writes
    - #S3Express as cache layer
    - #Raft cluster with S3 backend

    🔸 Major platforms adopting this architecture:
    #Snowflake, #Clickhouse, #Neon, #TiDB

    🔹 Trade-offs balance between latency, cost, and durability metrics

    🔸 Benefits include serverless operation, instant failover, and unlimited storage capacity

    avi.im/blag/2024/zero-disk-arc

    #DevOps

    #cloud #zerodisk #aws #s3 #database #s3express
  9. michabbb @[email protected] ·

    Modern Database Architecture: #Cloud Storage Evolution 🚀

    🔹 #ZeroDisk architecture leverages #AWS #S3 as primary storage, eliminating need for traditional disk management

    🔸 #Database systems gain instant scalability and elasticity through separation of compute and storage

    🔹 New approach enables three deployment options:
    - Direct #S3 writes
    - #S3Express as cache layer
    - #Raft cluster with S3 backend

    🔸 Major platforms adopting this architecture:
    #Snowflake, #Clickhouse, #Neon, #TiDB

    🔹 Trade-offs balance between latency, cost, and durability metrics

    🔸 Benefits include serverless operation, instant failover, and unlimited storage capacity

    avi.im/blag/2024/zero-disk-arc

    #DevOps

    #devops #tidb #neon #clickhouse #snowflake #raft
  10. michabbb @[email protected] ·

    Modern Database Architecture: #Cloud Storage Evolution 🚀

    🔹 #ZeroDisk architecture leverages #AWS #S3 as primary storage, eliminating need for traditional disk management

    🔸 #Database systems gain instant scalability and elasticity through separation of compute and storage

    🔹 New approach enables three deployment options:
    - Direct #S3 writes
    - #S3Express as cache layer
    - #Raft cluster with S3 backend

    🔸 Major platforms adopting this architecture:
    #Snowflake, #Clickhouse, #Neon, #TiDB

    🔹 Trade-offs balance between latency, cost, and durability metrics

    🔸 Benefits include serverless operation, instant failover, and unlimited storage capacity

    avi.im/blag/2024/zero-disk-arc

    #DevOps

    #cloud #zerodisk #aws #s3 #database #s3express
  11. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket Rule

    Specifies lifecycle rules for an Amazon S3 bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  12. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket Rule

    Specifies lifecycle rules for an Amazon S3 bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  13. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket Rule

    Specifies lifecycle rules for an Amazon S3 bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  14. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket Rule

    Specifies lifecycle rules for an Amazon S3 bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  15. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket Rule

    Specifies lifecycle rules for an Amazon S3 bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  16. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket LifecycleConfiguration

    Container for lifecycle rules. You can add as many as 1000 rules.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  17. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket LifecycleConfiguration

    Container for lifecycle rules. You can add as many as 1000 rules.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  18. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket LifecycleConfiguration

    Container for lifecycle rules. You can add as many as 1000 rules.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  19. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket LifecycleConfiguration

    Container for lifecycle rules. You can add as many as 1000 rules.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  20. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket LifecycleConfiguration

    Container for lifecycle rules. You can add as many as 1000 rules.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  21. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket AbortIncompleteMultipartUpload

    Specifies the days since the initiation of an incomplete multipart upload that Amazon S3 will wait before permanently removing all parts of the upload.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  22. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket AbortIncompleteMultipartUpload

    Specifies the days since the initiation of an incomplete multipart upload that Amazon S3 will wait before permanently removing all parts of the upload.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  23. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket AbortIncompleteMultipartUpload

    Specifies the days since the initiation of an incomplete multipart upload that Amazon S3 will wait before permanently removing all parts of the upload.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  24. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket AbortIncompleteMultipartUpload

    Specifies the days since the initiation of an incomplete multipart upload that Amazon S3 will wait before permanently removing all parts of the upload.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  25. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket AbortIncompleteMultipartUpload

    Specifies the days since the initiation of an incomplete multipart upload that Amazon S3 will wait before permanently removing all parts of the upload.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  26. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Use the AvailabilityZoneName property to return the code for the Availability Zone where the directory bucket was created.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  27. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Use the AvailabilityZoneName property to return the code for the Availability Zone where the directory bucket was created.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  28. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Use the AvailabilityZoneName property to return the code for the Availability Zone where the directory bucket was created.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  29. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Use the AvailabilityZoneName property to return the code for the Availability Zone where the directory bucket was created.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  30. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Use the AvailabilityZoneName property to return the code for the Availability Zone where the directory bucket was created.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  31. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault property to apply the default server-side encryption to new objects in a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  32. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault property to apply the default server-side encryption to new objects in a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  33. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault property to apply the default server-side encryption to new objects in a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  34. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault property to apply the default server-side encryption to new objects in a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  35. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault property to apply the default server-side encryption to new objects in a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  36. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionRule

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionRule resource to specify the default server-side encryption configuration for an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  37. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionRule

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionRule resource to specify the default server-side encryption configuration for an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  38. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionRule

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionRule resource to specify the default server-side encryption configuration for an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  39. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionRule

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionRule resource to specify the default server-side encryption configuration for an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  40. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionRule

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionRule resource to specify the default server-side encryption configuration for an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  41. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket BucketEncryption

    Use the AWS::S3Express::DirectoryBucket BucketEncryption property to specify default encryption for a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  42. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket BucketEncryption

    Use the AWS::S3Express::DirectoryBucket BucketEncryption property to specify default encryption for a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  43. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket BucketEncryption

    Use the AWS::S3Express::DirectoryBucket BucketEncryption property to specify default encryption for a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  44. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket BucketEncryption

    Use the AWS::S3Express::DirectoryBucket BucketEncryption property to specify default encryption for a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  45. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket BucketEncryption

    Use the AWS::S3Express::DirectoryBucket BucketEncryption property to specify default encryption for a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  46. CFN Updates @[email protected] ·

    New AWS::S3Express::BucketPolicy

    Use the AWS::S3Express::BucketPolicy resource to apply an S3 bucket policy to an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  47. CFN Updates @[email protected] ·

    New AWS::S3Express::BucketPolicy

    Use the AWS::S3Express::BucketPolicy resource to apply an S3 bucket policy to an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  48. CFN Updates @[email protected] ·

    New AWS::S3Express::BucketPolicy

    Use the AWS::S3Express::BucketPolicy resource to apply an S3 bucket policy to an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  49. CFN Updates @[email protected] ·

    New AWS::S3Express::BucketPolicy

    Use the AWS::S3Express::BucketPolicy resource to apply an S3 bucket policy to an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  50. CFN Updates @[email protected] ·

    New AWS::S3Express::BucketPolicy

    Use the AWS::S3Express::BucketPolicy resource to apply an S3 bucket policy to an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  51. CFN Updates @[email protected] ·

    New AWS::S3Express::DirectoryBucket

    Use the AWS::S3Express::DirectoryBucket resource to create an Amazon S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  52. CFN Updates @[email protected] ·

    New AWS::S3Express::DirectoryBucket

    Use the AWS::S3Express::DirectoryBucket resource to create an Amazon S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  53. CFN Updates @[email protected] ·

    New AWS::S3Express::DirectoryBucket

    Use the AWS::S3Express::DirectoryBucket resource to create an Amazon S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  54. CFN Updates @[email protected] ·

    New AWS::S3Express::DirectoryBucket

    Use the AWS::S3Express::DirectoryBucket resource to create an Amazon S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #cloudformation #s3express
  55. CFN Updates @[email protected] ·

    New AWS::S3Express::DirectoryBucket

    Use the AWS::S3Express::DirectoryBucket resource to create an Amazon S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  56. Steve Loughran @[email protected] ·

    And my PR for S3A #s3express support is up. Test coverage incomplete; some fail…proposed a followup rather than a “fix it here” PR as this has production changes for treewalk code to skip “hallucinated directories” which surface above incomplete uploads. Adds pathCapabilities probes for: v2 SDK support, store is s3 express and dir listings potentially inconsistent.

    github.com/apache/hadoop/pull/

    #s3express
  57. Steve Loughran @[email protected] ·

    And my PR for S3A #s3express support is up. Test coverage incomplete; some fail…proposed a followup rather than a “fix it here” PR as this has production changes for treewalk code to skip “hallucinated directories” which surface above incomplete uploads. Adds pathCapabilities probes for: v2 SDK support, store is s3 express and dir listings potentially inconsistent.

    github.com/apache/hadoop/pull/

    #s3express
  58. Steve Loughran @stevel ·

    And my PR for S3A support is up. Test coverage incomplete; some fail…proposed a followup rather than a “fix it here” PR as this has production changes for treewalk code to skip “hallucinated directories” which surface above incomplete uploads. Adds pathCapabilities probes for: v2 SDK support, store is s3 express and dir listings potentially inconsistent.

    github.com/apache/hadoop/pull/

    #s3express
  59. Steve Loughran @[email protected] ·

    And my PR for S3A #s3express support is up. Test coverage incomplete; some fail…proposed a followup rather than a “fix it here” PR as this has production changes for treewalk code to skip “hallucinated directories” which surface above incomplete uploads. Adds pathCapabilities probes for: v2 SDK support, store is s3 express and dir listings potentially inconsistent.

    github.com/apache/hadoop/pull/

    #s3express
  60. Steve Loughran @[email protected] ·

    #AwS support #S3Express through the S3A connector! Not their one “legacy” s3 connector
    The core of the move to AWS v2 SDK was done by a single AWS employee in the S3 team; we did most of the dev in the open; a hint of “third party support” PRs covered minor nits. The EMR release timing makes me think they left out the last “corner cases in NFQE/Benchmarking”, looks like their region code is as still broken as Hadoop trunk. Really unhappy with that SDK change
    #reinvent

    docs.aws.amazon.com/emr/latest

    #aws #s3express #reinvent