AWS Glue and module not found (configparser)

2020-03-03T23:13:16

I am setting up a AWS Glue job that is created on trigger from a lambda function. The Glue job is created without issue, but I am using a custom python package that I've built (it's pure python). When the package goes and imports, I get the following error message when the job eventually runs:

ImportError: No module named configparser

When I run the packaged code locally thru testing, it works no issue.

Copyright License:
Author:「OpenDataAlex」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/60510255/aws-glue-and-module-not-found-configparser

About “AWS Glue and module not found (configparser)” questions

I am setting up a AWS Glue job that is created on trigger from a lambda function. The Glue job is created without issue, but I am using a custom python package that I've built (it's pure python). ...
I am trying to read a config file from S3 bucket via python script run by AWS glue. But the file is not read. from __future__ import print_function from pyspark import SparkContext from awsglue.ut...
I am using AWS glue to create ETL workflow, where I am fetching the data from the API and loading it into RDS. In AWS Glue, I used pyspark script. In the same script, I have used the 'aiohttp' and '
I have a problem trying to execute aws example fro Aws Glue Etl - locally after read all those steps: https://docs.aws.amazon.com/glue/latest/dg/dev-endpoint-tutorial-local-notebook.html and crea...
In my glue script (Spark 3.1, Python 3, Glue 3) I'm trying to use df.to_excel() function from pandas library. Apparently pandas library has dependencies on openpyxl. My code is: import sys import b...
Have some lambdas that request schemas form AWS Glue. Would like to know if there is a limit of requests to AWS Glue after which Glue cannot handle it? Load testing in other words. Have not found
I have a Glue job resource defined in module A, now I want to import it and use the job name in module B, how can I achieve this? I tried something like, in the module B: variable "
Pandas not working in AWS GLUE 4.0 version:- I tried importing pandas in AWS Glue 4.0 but getting following error, pandas is working in AWS Glue 3.0 version but not in 4.0. ModuleNotFoundError: No ...
I installed each prerequisites according to https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-libraries.html#develop-local-python and still getting No module named 'awsglue' error...
In order to speed up the execution of an ETL job, I've implemented a regression algorithm in Cython "regression.pyx" rather than python. Unfortunately, I couldn't find any documentation, ...

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.