aws cloud filter metric for glue logs /aws-glue/python-jobs/

2022-11-10T01:56:54

I am unable to create metric via Terraform it's not recognizing the log path as log name.

data "aws_cloudwatch_log_group" "aws_glue_log" {
   
    name = "/aws-glue/python-jobs/"

}

resource "aws_cloudwatch_log_metric_filter" "event_filter" {
  name           = "someNAme"
  pattern        = "ALERT"
  log_group_name = data.aws_cloudwatch_log_group.aws_glue_log.name
  metric_transformation {
    name      = "filtermetric"
    namespace     = "Glue"
    value         = "1"
    default_value = "0"
  }
}

Error: No log group named /aws-glue/python-jobs/ found
11:21:34  
11:21:34  

i can create metric via console

Copyright License:
Author:「vivek ashodha」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/74379361/aws-cloud-filter-metric-for-glue-logs-aws-glue-python-jobs

About “aws cloud filter metric for glue logs /aws-glue/python-jobs/” questions

I am unable to create metric via Terraform it's not recognizing the log path as log name. data "aws_cloudwatch_log_group" "aws_glue_log" { name = "/aws-glue/python-...
I have AWS Glue jobs of type python shell. Logs of the python shell glue jobs are getting stored in two different cloudwatch log groups. /aws-glue/python-jobs/output:- To store non error logs /aw...
I have some "Python Shell" type Glue jobs and I want to send the job logs to a custom CloudWatch log group instead of the default log group. I am able to achieve this for "Spark" type glue jobs by
I have configured a AWS Glue Job in which I have enabled continuous-logging and then defined the continuous-logging in the job-parameters. Parameters: --enable-continuous-cloudwatch-log - true --...
Need to pass the Glue job logs to Custom Log group (aws-glue/schema) as by default the Glue job logs go into /aws-glue/jobs/output. Found this on aws documentation '--continuous-log-logGroup': '
I am trying to use python "requests" package in aws-glue. I tried with making .egg file for that package and it won't work. Also tried the making zip of request package and added to the glue job. ...
I am running glueetl (Glue version 2.0) job using Python with the below configuration for logging. I have continuous logging enabled. I get INFO entries from the driver present in /aws-glue/jobs/ou...
I am trying to use AWS Glue to run an ETL job that fetches data from Redshift to S3. When I run a crawler it successfully connects to Redshift and fetches schema information. Relevant logs are cre...
i came forward reading this amazon article about flattening a json file and uploading in redshift. https://aws.amazon.com/blogs/big-data/simplify-querying-nested-json-with-the-aws-glue-relationalize-
I have a Python shell job in aws-glue that talks to a rds/mysql server. I receive an error when running the job saying below. I guess it is the mysql server's security group settings. How can I upd...

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.