The S3 Requester Pays feature shifts the cost of data retrieval and data transfer out of the S3 bucket to the requester. This means that if the requesters accesses or downloads data from the owner’s S3 bucket, the requesters will bear the cost of these operations. This solution directly addresses the requirement to keep the data transfer costs as low as possible for the owner sharing the data.
Create a read replica of the rds database. Configure the script to query only the read replica. This approach offloads the read load from the primary database, which is being affected by the script’s queries. By directing read queries to a read replica, it ensures that the primary database can handle other operations more efficiently, such as those required by the development team, without the added load of the script queries. This solution specifically targets the performance issue with minimal changes to the existing setup and operational practices.
Amazon FSx for Lustre provides fully managed shared storage with the scalability and performance of the popular Lustre file system.
https://aws.amazon.com/fsx/lustre/