AWS ElasticSearch connectivity issue #5681

ramzan07 · 2022-07-06T11:42:44Z

ramzan07
Jul 6, 2022

Hi, I am trying to connect to Elasticsearch 7.10 running as aws.

Here is my sample config

[INPUT]
    Name        tail
    Path        /Users/xyz/test.log
    Read_from_Head true

[OUTPUT]
    Name  es
    Match *
    Host  vpc**************.eu-central-1.es.amazonaws.com
    Port  443
    HTTP_User  *************
    HTTP_Passwd  *************
    Index my_index
    Type  my_type
    AWS_Auth On
    AWS_Region eu-central-1
    Buffer_Size  False
    tls On

but I am getting the below error

[2022/07/06 17:37:41] [error] [output:es:es.0] HTTP status=400 URI=/_bulk, response:
<html>
<head><title>400 Bad Request</title></head>
<body>
<center><h1>400 Bad Request</h1></center>
</body>
</html>


[2022/07/06 17:37:41] [ warn] [engine] failed to flush chunk '31881-1657121860.314800000.flb', retry in 11 seconds: task_id=0, input=tail.0 > output=es.0 (out_id=0)

What's the issue here please, how can I make this work. Thank you

edsiper · 2022-07-06T18:27:03Z

edsiper
Jul 6, 2022
Maintainer

do you have a copy of the chunk 31881-1657121860.314800000.flb somewhere ?, I would like to inspect the content

1 reply

ramzan07 Jul 6, 2022
Author

@edsiper Thanks for the reply, Yes I have the content of the log file.

2022-07-06 14:58:13,778 - INFO - Server initialized for action
2022-07-06 14:58:13,778 - INFO - Connecting...

ramzan07 · 2022-07-12T09:17:39Z

ramzan07
Jul 12, 2022
Author

This is how my issue solved

[OUTPUT]
    Name  es
    Match *
    Host  vpc-xxxxxxxxxxxxxxxxxxxxxxxxx.es.amazonaws.com
    Port  443
    HTTP_User  xxxxxxxxxxxxxx
    HTTP_Passwd  xxxxxxxxxxxxxx
    Index test-index
    AWS_Region eu-central-1
    tls  On
    net.keepalive On
    Buffer_Size 25M
    Suppress_Type_Name On

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

AWS ElasticSearch connectivity issue #5681

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments 1 reply

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

AWS ElasticSearch connectivity issue #5681

ramzan07 Jul 6, 2022

Replies: 2 comments · 1 reply

edsiper Jul 6, 2022 Maintainer

ramzan07 Jul 6, 2022 Author

ramzan07 Jul 12, 2022 Author

ramzan07
Jul 6, 2022

Replies: 2 comments 1 reply

edsiper
Jul 6, 2022
Maintainer

ramzan07 Jul 6, 2022
Author

ramzan07
Jul 12, 2022
Author