Can we write script in Java for AWS Glue

2020-08-21T19:32:07

I am trying to create job script using Java. In AWS Glue Console, I could be able to find only "Python, Spark", so which means we cant write script using Java at all? If yes, then whats this api used for: aws-java-sdk-glue

I even found some example: https://stackoverflow.com/questions/48256281/how-to-read-aws-glue-data-catalog-table-schemas-programmatically

In above, seems like we can able to write aws glue script in Java too. Can anyone please confirm this?

EDIT: In Scala, we are writing as: glueContext.getCatalogSource(database = "my_data_base", tableName = "my_table")

In Java, I found below class, which has method names: withDatabaseName and withTableName https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/glue/model/CatalogEntry.html

Then, may I know what is the purpose of above class?

Copyright License:
Author:「john」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/63522110/can-we-write-script-in-java-for-aws-glue

About “Can we write script in Java for AWS Glue” questions

I am trying to create job script using Java. In AWS Glue Console, I could be able to find only "Python, Spark", so which means we cant write script using Java at all? If yes, then whats t...
Can we use java for ETL in AWS Glue? It seems like there is only two option for Glue ETL programming i.e. Python and Scala.
I am creating glue job creation using Java Sdk. It has only two required params Command and Glue version. But i need to create job with auto script generation. As we can do from console, we add data
In AWS Glue job, we can write some script and execute the script via job. In AWS Lambda too, we can write the same script and execute the same logic provided in above job. So, my query is not whats...
How can we write user-defined functions in AWS-Glue script using PySpark (Python) on either Dynamic-frame or Data-frame?
We know that, the procedure of writing from pyspark script (aws glue job) to AWS data catalog is to write in s3 bucket (eg.csv) use a crawler and schedule it. Is there any other way of writing to aws
I am trying to write a CloudFormation template for glue job. I see that there is no option available in official documentation to use apply mapping feature just like we see in the console. How can ...
I need to do some grouping job from a Source DynamoDB table, then write each resulting Item to another Target DynamoDB table (or a secondary index of the Source one). Here I see that DynamoDB can be
I have an AWS Glue job that should write the results from a dynamic frame to a Redshift database. For that I have set up a Glue Connection to Redshift and tested it, and it works fine. However, whe...
We are trying to use AWS Glue for our ETL process. While running AWS Glue job process is being killed due to Out of memory error. LogType:stdout Log Upload Time:Mon Jan 08 20:35:34 +0000 2018 LogL...

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.