home.social

#s3express — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #s3express, aggregated by home.social.

  1. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Amazon S3 introduces support for AWS Dedicated Local Zones.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  2. michabbb @[email protected] ·

    Modern Database Architecture: #Cloud Storage Evolution 🚀

    🔹 #ZeroDisk architecture leverages #AWS #S3 as primary storage, eliminating need for traditional disk management

    🔸 #Database systems gain instant scalability and elasticity through separation of compute and storage

    🔹 New approach enables three deployment options:
    - Direct #S3 writes
    - #S3Express as cache layer
    - #Raft cluster with S3 backend

    🔸 Major platforms adopting this architecture:
    #Snowflake, #Clickhouse, #Neon, #TiDB

    🔹 Trade-offs balance between latency, cost, and durability metrics

    🔸 Benefits include serverless operation, instant failover, and unlimited storage capacity

    avi.im/blag/2024/zero-disk-arc

    #DevOps

    #cloud #zerodisk #aws #s3 #database #s3express
  3. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket Rule

    Specifies lifecycle rules for an Amazon S3 bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  4. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket LifecycleConfiguration

    Container for lifecycle rules. You can add as many as 1000 rules.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  5. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket AbortIncompleteMultipartUpload

    Specifies the days since the initiation of an incomplete multipart upload that Amazon S3 will wait before permanently removing all parts of the upload.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  6. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket

    Use the AvailabilityZoneName property to return the code for the Availability Zone where the directory bucket was created.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  7. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionByDefault property to apply the default server-side encryption to new objects in a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  8. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket ServerSideEncryptionRule

    Use the AWS::S3Express::DirectoryBucket ServerSideEncryptionRule resource to specify the default server-side encryption configuration for an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  9. CFN Updates @[email protected] ·

    Updated AWS::S3Express::DirectoryBucket BucketEncryption

    Use the AWS::S3Express::DirectoryBucket BucketEncryption property to specify default encryption for a directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  10. CFN Updates @[email protected] ·

    New AWS::S3Express::BucketPolicy

    Use the AWS::S3Express::BucketPolicy resource to apply an S3 bucket policy to an S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  11. CFN Updates @[email protected] ·

    New AWS::S3Express::DirectoryBucket

    Use the AWS::S3Express::DirectoryBucket resource to create an Amazon S3 directory bucket.
    docs.aws.amazon.com/AWSCloudFo #s3express #cloudformation

    #s3express #cloudformation
  12. Steve Loughran @[email protected] ·

    And my PR for S3A #s3express support is up. Test coverage incomplete; some fail…proposed a followup rather than a “fix it here” PR as this has production changes for treewalk code to skip “hallucinated directories” which surface above incomplete uploads. Adds pathCapabilities probes for: v2 SDK support, store is s3 express and dir listings potentially inconsistent.

    github.com/apache/hadoop/pull/

    #s3express
  13. Steve Loughran @[email protected] ·

    #AwS support #S3Express through the S3A connector! Not their one “legacy” s3 connector
    The core of the move to AWS v2 SDK was done by a single AWS employee in the S3 team; we did most of the dev in the open; a hint of “third party support” PRs covered minor nits. The EMR release timing makes me think they left out the last “corner cases in NFQE/Benchmarking”, looks like their region code is as still broken as Hadoop trunk. Really unhappy with that SDK change
    #reinvent

    docs.aws.amazon.com/emr/latest

    #aws #s3express #reinvent