修复此错误需要将AWS Glue数据目录爬虫以增量模式运行,并将其忽略错误。以下是示例代码:
job = Job(glue_context)
job.init(args['JOB_NAME'], args)
datasource = glue_context.create_dynamic_frame.from_catalog(database=db_name, table_name=table_name, transformation_ctx="datasource")
# Ignore Errors
job.commit = False
try:
apply_mapping(create_or_update_person_object, datasource)
job.commit()
except:
print("Error while commiting job, ignoring...")