Web: https://www.reddit.com/r/aws/comments/s0ixkm/is_it_possible_to_access_glue_datacatalog_to_work/

Jan. 10, 2022, 12:26 p.m. | /u/miccoli30

Amazon Web Services (AWS): S3, EC2, SQS, RDS, DynamoDB, IAM, CloudFormation, Route 53, VPC and more reddit.com

Hi community

I am very new working with AWS Glue and I am trying to use Spark SQL module to transform data placed in Glue Datacatalog.

When I configured the Glue Job I checked the box Use Glue data catalog as the Hive metastore and then I tried to get data from Glue DataCatalog in a Glue job.

I have a Database called job_crawler_db and when I tried to access it the gave me the error

AnalysisException: "Database 'job_crawler_db' not found;"

My code is:

import sys from awsglue.context import GlueContext …

aws spark sql work

DevOps Software Engineer

@ Sinch | Malmö, Skåne County, Sweden

Senior Staff Engineer, Cloud Systems

@ Life360 | Remote, USA

Junior DevOps Engineer

@ SmartBear | Wrocław, Lower Silesian Voivodeship, Poland

Senior DevOps Engineer - Data Engineering

@ Life360 | Ukraine

DevOps Engineer , Team Lead ( Remote )

@ AssistRx | Remote - Orlando, Florida, United States

Senior DevSecOps

@ Prodigy Education | Oakville, Ontario