[OUTPUT]
Name firehose
Match *
delivery_stream my-delivery-stream
region us-east-1
buffer_chunk_size 1M
buffer_max_size 1G
flush_interval 10s
import boto3
client = boto3.client('firehose')
def get_limit():
response = client.describe_limits()
print(response['AccountLimit']['MaxNumberOfDeliveryStreams'])
print(response['AccountLimit']['DeliveryStreamLimit'])
print(response['AccountLimit']['TotalSizeInMB'])
print(response['AccountLimit']['NumberOfDeliveryStreams'])
print(response['AccountUsage']['DeliveryStreamUsage'])
print(response['AccountUsage']['TotalSizeInMB'])
[OUTPUT]
Name s3
Match logs
s3_bucket_name my_bucket_name
s3_bucket_region my_bucket_region
s3_key_format %{time_slice}/%{hostname}/%{processor}-%{thread_id}-%{sequence}.%{file_extension}
flush_interval 5s
utc
以上是解决AWS Firehose限流记录摄取问题的几种方法和示例代码。您可以根据自己的需求进行选择和调整。