Skip to main content
Version: devel

dlt.destinations.impl.athena.athena

LfTagsManager Objects​

class LfTagsManager()

View source on GitHub

Class used to manage lakeformation tags on glue/athena database.

Heavily inspired by dbt-athena implementation: https://github.com/dbt-labs/dbt-athena/blob/main/dbt-athena/src/dbt/adapters/athena/lakeformation.py

process_lf_tags_database​

def process_lf_tags_database() -> None

View source on GitHub

Add or remove lf tags from athena database.

AthenaClient Objects​

class AthenaClient(SqlJobClientWithStagingDataset, SupportsStagingDestination)

View source on GitHub

manage_lf_tags​

def manage_lf_tags() -> None

View source on GitHub

Manage Lakeformation tags on the glue database.

create_load_job​

def create_load_job(table: PreparedTableSchema,
                    file_path: str,
                    load_id: str,
                    restore: bool = False) -> LoadJob

View source on GitHub

Starts SqlLoadJob for files ending with .sql or returns None to let derived classes to handle their specific jobs

should_load_data_to_staging_dataset_on_staging_destination​

def should_load_data_to_staging_dataset_on_staging_destination(
        table_name: str) -> bool

View source on GitHub

iceberg table data goes into staging on staging destination

This demo works on codespaces. Codespaces is a development environment available for free to anyone with a Github account. You'll be asked to fork the demo repository and from there the README guides you with further steps.
The demo uses the Continue VSCode extension.

Off to codespaces!

DHelp

Ask a question

Welcome to "Codex Central", your next-gen help center, driven by OpenAI's GPT-4 model. It's more than just a forum or a FAQ hub – it's a dynamic knowledge base where coders can find AI-assisted solutions to their pressing problems. With GPT-4's powerful comprehension and predictive abilities, Codex Central provides instantaneous issue resolution, insightful debugging, and personalized guidance. Get your code running smoothly with the unparalleled support at Codex Central - coding help reimagined with AI prowess.