The dativa tools library provides functionality to extend other Python libraries, typically boto3 and pandas, to make it easier to process, cleanse, and load large datasets at scale.
you can install it using pip as follows:
pip install dativatools
Full documentation for each function is shown below:
- Querying AWS Athena and getting the results in Parquet format - (more)
- Dativa tools data validation - A library to perform basic validation on incoming data files (more)
- Dativa tools pandas extensions - A set of extensions to pandas for consistent CSV processing and better date time handling (more)
- Dativa tools Athena client - The AthenaClient wraps the AWS boto client in an easy to use wrapper to create and manage tables in S3 (more)